2023-10-08T15:26:28.352 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T15:26:28.352 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418275 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418275/orig.config.yaml 2023-10-08T15:26:28.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T15:26:28.507 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418275 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7418275' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-06-0949-quincy sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 owner: scheduled_yuriw@teuthology priority: 74 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-06-0949-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgK6YgZ6UFWtR0PZiZebo/LfTh6SkAS6jSiI+iH6SmorJiiCnxmc+mKGW1rwJNRcxcyAuZ/kEZu7r3aAaX6Plo= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYvSVvC79OLk4lEruKOocz3g4g+Tp9QwaTmzMXX/mUBkFkNvGUGXn0MMS5UMxFsWbC1O01z0JEM3rXqqntRJvQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-08_15:12:05 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T15:26:28.507 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa; will attempt to use it 2023-10-08T15:26:28.508 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks 2023-10-08T15:26:28.508 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T15:26:28.510 INFO:teuthology.task.internal:Checking packages... 2023-10-08T15:26:28.533 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-08T15:26:28.534 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T15:26:28.534 INFO:teuthology.packaging:ref: None 2023-10-08T15:26:28.534 INFO:teuthology.packaging:tag: None 2023-10-08T15:26:28.534 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:26:28.534 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:26:28.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:26:28.707 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-08T15:26:28.707 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T15:26:28.714 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T15:26:28.714 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T15:26:28.730 INFO:teuthology.task.internal:Saving configuration 2023-10-08T15:26:28.747 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T15:26:28.753 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T15:26:28.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:21:02.180739', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgK6YgZ6UFWtR0PZiZebo/LfTh6SkAS6jSiI+iH6SmorJiiCnxmc+mKGW1rwJNRcxcyAuZ/kEZu7r3aAaX6Plo='} 2023-10-08T15:26:28.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:21:02.178725', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYvSVvC79OLk4lEruKOocz3g4g+Tp9QwaTmzMXX/mUBkFkNvGUGXn0MMS5UMxFsWbC1O01z0JEM3rXqqntRJvQ='} 2023-10-08T15:26:28.796 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T15:26:28.802 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-08T15:26:28.802 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-08T15:26:28.802 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T15:26:28.877 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fba1ff0cb80>, signals=[15]) 2023-10-08T15:26:28.878 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T15:26:28.884 INFO:teuthology.task.internal:Opening connections... 2023-10-08T15:26:28.884 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:26:28.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:28.957 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:26:28.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:26:29.023 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T15:26:29.030 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-10-08T15:26:29.047 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-10-08T15:26:29.048 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-10-08T15:26:29.104 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T15:26:29.104 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.4 (Ootpa)" 2023-10-08T15:26:29.104 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-10-08T15:26:29.104 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.4" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-08T15:26:29.105 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T15:26:29.106 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-08T15:26:29.106 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-10-08T15:26:29.143 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-08T15:26:29.160 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-08T15:26:29.160 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-08T15:26:29.216 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T15:26:29.216 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.4 (Ootpa)" 2023-10-08T15:26:29.216 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-10-08T15:26:29.216 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-10-08T15:26:29.216 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.4" 2023-10-08T15:26:29.216 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-10-08T15:26:29.216 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-08T15:26:29.216 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T15:26:29.217 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-08T15:26:29.217 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-08T15:26:29.242 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T15:26:29.431 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T15:26:29.437 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T15:26:29.437 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:26:29.439 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:26:29.455 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T15:26:29.462 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T15:26:29.462 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:26:29.493 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:26:29.505 INFO:teuthology.orchestra.run.smithi029.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-08T15:26:29.512 INFO:teuthology.orchestra.run.smithi183.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-08T15:26:29.513 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T15:26:29.570 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T15:26:29.585 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T15:26:29.586 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-08T15:26:29.586 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-08T15:26:29.586 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:26:29.587 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:26:29.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:26:29.600 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-10-08T15:26:29.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:26:29.603 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-10-08T15:26:29.656 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:26:29.656 INFO:teuthology.task.kernel:Running kernel on smithi029: 4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:26:29.656 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2023-10-08T15:26:29.659 INFO:teuthology.orchestra.run.smithi183.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:26:29.659 INFO:teuthology.task.kernel:Running kernel on smithi183: 4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:26:29.659 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum install -y kernel 2023-10-08T15:26:31.247 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T15:26:31.247 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2023-10-08T15:26:32.156 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-08T15:26:32.157 INFO:teuthology.orchestra.run.smithi029.stdout:Unable to read consumer identity 2023-10-08T15:26:32.645 INFO:teuthology.orchestra.run.smithi183.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-08T15:26:34.288 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 16 MB 00:01 2023-10-08T15:26:35.062 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-08T15:26:36.305 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-10-08T15:26:37.593 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-08T15:26:38.266 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-08T15:26:38.266 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-08T15:26:38.266 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-08T15:26:38.416 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-08T15:26:38.417 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-08T15:26:38.417 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-08T15:26:38.524 DEBUG:teuthology.orchestra.run.smithi183:> echo no | sudo yum reinstall kernel || true 2023-10-08T15:26:38.868 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T15:26:38.868 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2023-10-08T15:26:39.167 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 03:26:37 PM UTC. 2023-10-08T15:26:39.286 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T15:26:39.286 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:26:39.286 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:26:39.312 INFO:teuthology.orchestra.run.smithi183.stderr:Error: No packages marked for reinstall. 2023-10-08T15:26:39.365 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum reinstall -y kernel || true 2023-10-08T15:26:39.708 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T15:26:39.708 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2023-10-08T15:26:39.827 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 3.1 MB/s | 24 kB 00:00 2023-10-08T15:26:40.000 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 03:26:37 PM UTC. 2023-10-08T15:26:40.127 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T15:26:40.127 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:26:40.128 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:26:40.166 INFO:teuthology.orchestra.run.smithi183.stderr:Error: No packages marked for reinstall. 2023-10-08T15:26:40.217 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T15:26:40.342 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:40.342 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:40.342 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:40.342 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:26:40.342 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:26:40.343 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-08T15:26:40.343 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:26:40.343 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T15:26:40.469 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:40.469 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:40.469 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -qi grub2-tools 2023-10-08T15:26:40.496 INFO:teuthology.orchestra.run.smithi183.stdout:Name : grub2-tools 2023-10-08T15:26:40.496 INFO:teuthology.orchestra.run.smithi183.stdout:Epoch : 1 2023-10-08T15:26:40.496 INFO:teuthology.orchestra.run.smithi183.stdout:Version : 2.02 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Release : 99.el8_4.1 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: x86_64 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Group : System Environment/Base 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Size : 9264631 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:License : GPLv3+ 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-08T15:26:40.497 INFO:teuthology.orchestra.run.smithi183.stdout:Relocations : (not relocatable) 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:Packager : Red Hat, Inc. 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:Vendor : Red Hat, Inc. 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:Summary : Support tools for GRUB. 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:Description : 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T15:26:40.498 INFO:teuthology.orchestra.run.smithi183.stdout:hardware devices. 2023-10-08T15:26:40.499 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:26:40.499 INFO:teuthology.orchestra.run.smithi183.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T15:26:40.500 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T15:26:40.500 INFO:teuthology.task.kernel:Updating grub on smithi183 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:40.500 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T15:26:40.616 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-08T15:26:40.616 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-08T15:26:40.616 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-08T15:26:40.787 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-10-08T15:26:40.788 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-10-08T15:26:40.788 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-10-08T15:26:40.911 DEBUG:teuthology.orchestra.run.smithi029:> echo no | sudo yum reinstall kernel || true 2023-10-08T15:26:41.279 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-08T15:26:41.279 INFO:teuthology.orchestra.run.smithi029.stdout:Unable to read consumer identity 2023-10-08T15:26:41.594 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 03:26:39 PM UTC. 2023-10-08T15:26:41.738 INFO:teuthology.orchestra.run.smithi029.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T15:26:41.738 INFO:teuthology.orchestra.run.smithi029.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:26:41.738 INFO:teuthology.orchestra.run.smithi029.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:26:41.787 INFO:teuthology.orchestra.run.smithi029.stderr:Error: No packages marked for reinstall. 2023-10-08T15:26:41.838 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum reinstall -y kernel || true 2023-10-08T15:26:41.879 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2023-10-08T15:26:42.201 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-08T15:26:42.202 INFO:teuthology.orchestra.run.smithi029.stdout:Unable to read consumer identity 2023-10-08T15:26:42.513 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 03:26:39 PM UTC. 2023-10-08T15:26:42.671 INFO:teuthology.orchestra.run.smithi029.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T15:26:42.671 INFO:teuthology.orchestra.run.smithi029.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:26:42.671 INFO:teuthology.orchestra.run.smithi029.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T15:26:42.695 INFO:teuthology.orchestra.run.smithi029.stderr:Error: No packages marked for reinstall. 2023-10-08T15:26:42.752 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T15:26:42.882 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:42.883 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:42.883 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:42.883 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T15:26:42.883 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T15:26:42.883 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-08T15:26:42.883 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T15:26:42.883 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T15:26:43.014 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:43.014 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:43.014 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2023-10-08T15:26:43.042 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2023-10-08T15:26:43.042 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2023-10-08T15:26:43.042 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.02 2023-10-08T15:26:43.042 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 99.el8_4.1 2023-10-08T15:26:43.042 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2023-10-08T15:26:43.042 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Group : System Environment/Base 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 9264631 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Relocations : (not relocatable) 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : Red Hat, Inc. 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : Red Hat, Inc. 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T15:26:43.043 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2023-10-08T15:26:43.044 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2023-10-08T15:26:43.044 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:26:43.044 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T15:26:43.044 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T15:26:43.044 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T15:26:43.044 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2023-10-08T15:26:43.044 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:26:43.044 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T15:26:43.045 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T15:26:43.045 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:43.045 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T15:26:43.889 INFO:teuthology.orchestra.run.smithi183.stderr:done 2023-10-08T15:26:43.891 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-10-08T15:26:43.905 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.JrZhkFV9xJ 2023-10-08T15:26:43.905 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JrZhkFV9xJ 2023-10-08T15:26:43.974 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.JrZhkFV9xJ 2023-10-08T15:26:44.139 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.JrZhkFV9xJ is 6KB 2023-10-08T15:26:44.187 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.JrZhkFV9xJ 2023-10-08T15:26:44.200 DEBUG:teuthology.orchestra.run.smithi183:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T15:26:44.270 INFO:teuthology.orchestra.run.smithi183.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-08T15:26:44.271 INFO:teuthology.orchestra.run.smithi183.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-08T15:26:44.271 INFO:teuthology.orchestra.run.smithi183.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-08T15:26:44.271 INFO:teuthology.orchestra.run.smithi183.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-08T15:26:44.272 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:44.470 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2023-10-08T15:26:44.965 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2023-10-08T15:26:47.239 INFO:teuthology.orchestra.run.smithi029.stderr:done 2023-10-08T15:26:47.241 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-10-08T15:26:47.280 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.qErffE8XbZ 2023-10-08T15:26:47.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qErffE8XbZ 2023-10-08T15:26:47.361 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.qErffE8XbZ 2023-10-08T15:26:47.513 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.qErffE8XbZ is 6KB 2023-10-08T15:26:48.020 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.qErffE8XbZ 2023-10-08T15:26:48.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T15:26:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-08T15:26:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-08T15:26:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-08T15:26:48.650 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-08T15:26:48.651 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-08T15:26:48.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2023-10-08T15:27:14.478 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-08T15:27:14.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T15:27:14.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:27:18.829 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-08T15:27:18.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:27:18.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:27:32.986 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-08T15:27:37.342 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-10-08T15:27:41.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T15:27:41.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:27:46.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:27:46.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:28:42.046 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T15:28:46.354 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T15:28:54.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T15:28:54.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:28:54.377 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-08T15:28:54.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T15:28:54.623 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-08T15:28:54.623 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-10-08T15:28:54.637 INFO:teuthology.orchestra.run.smithi183.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-08T15:28:54.638 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:28:54.638 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:28:54.638 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T15:28:55.639 DEBUG:teuthology.parallel:result is None 2023-10-08T15:28:58.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:28:58.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:28:58.679 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-10-08T15:28:59.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:28:59.010 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-08T15:28:59.010 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-10-08T15:28:59.026 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-08T15:28:59.026 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-08T15:28:59.026 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:28:59.026 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T15:29:00.027 DEBUG:teuthology.parallel:result is None 2023-10-08T15:29:00.027 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T15:29:00.035 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T15:29:00.035 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:29:00.038 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:29:00.053 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T15:29:00.060 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T15:29:00.066 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T15:29:00.067 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:29:00.095 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:29:00.127 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T15:29:00.134 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T15:29:00.134 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:29:00.163 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:29:00.248 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:29:00.264 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:29:00.267 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:29:00.278 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:29:00.279 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T15:29:00.286 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T15:29:00.286 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:29:00.288 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:29:00.314 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T15:29:00.323 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T15:29:00.323 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:29:00.356 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:29:00.371 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:29:00.455 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:29:00.518 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:29:00.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:29:00.600 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:29:00.600 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:29:00.665 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:29:00.706 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:29:00.774 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:29:00.815 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:29:00.857 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:29:00.860 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:29:00.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2023-10-08T15:29:00.920 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2023-10-08T15:29:00.966 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T15:29:01.009 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T15:29:01.447 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T15:29:01.455 INFO:teuthology.task.internal:Starting timer... 2023-10-08T15:29:01.455 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T15:29:01.465 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T15:29:01.477 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T15:29:01.477 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2023-10-08T15:29:01.560 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: [ OK ] 2023-10-08T15:29:01.562 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2023-10-08T15:29:01.624 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: [ OK ] 2023-10-08T15:29:01.626 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T15:29:01.626 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2023-10-08T15:29:01.644 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2023-10-08T15:29:01.644 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2023-10-08T15:29:01.671 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2023-10-08T15:29:01.671 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2023-10-08T15:29:01.671 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T15:29:01.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:29:01.710 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T15:29:01.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:29:01.737 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T15:29:01.737 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2023-10-08T15:29:01.779 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2023-10-08T15:29:01.805 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T15:29:01.814 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-08T15:29:01.819 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-08T15:29:01.925 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T15:29:01.942 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T15:29:01.943 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T15:37:38.117 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2023-10-08T15:37:38.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:37:38.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:37:38.187 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-10-08T15:37:38.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:37:38.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T15:37:38.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:37:38.320 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-08T15:37:38.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-08T15:37:38.386 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T15:37:38.396 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T15:37:38.396 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T15:37:38.397 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:37:38.399 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T15:37:38.399 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:37:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T15:37:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T15:37:38.455 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T15:37:38.470 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T15:37:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2023-10-08T15:37:38.490 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2023-10-08T15:37:38.503 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2023-10-08T15:37:38.504 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T15:37:38.514 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2023-10-08T15:37:38.518 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T15:37:38.528 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T15:37:38.541 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T15:37:38.607 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-10-08T15:37:38.608 INFO:teuthology.orchestra.run.smithi183.stderr:bash: ntpq: command not found 2023-10-08T15:37:38.610 INFO:teuthology.orchestra.run.smithi029.stdout:210 Number of sources = 4 2023-10-08T15:37:38.610 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T15:37:38.610 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-10-08T15:37:38.610 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T15:37:38.610 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T15:37:38.610 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T15:37:38.611 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T15:37:38.611 INFO:teuthology.orchestra.run.smithi183.stdout:210 Number of sources = 4 2023-10-08T15:37:38.612 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T15:37:38.612 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-10-08T15:37:38.612 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T15:37:38.612 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T15:37:38.612 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T15:37:38.612 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T15:37:38.612 INFO:teuthology.run_tasks:Running task install... 2023-10-08T15:37:38.622 DEBUG:teuthology.task.install:project ceph 2023-10-08T15:37:38.622 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-08T15:37:38.622 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-08T15:37:38.622 INFO:teuthology.task.install:Using flavor: default 2023-10-08T15:37:38.628 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T15:37:38.628 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T15:37:38.629 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-08T15:37:38.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:37:38.631 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-08T15:37:38.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:37:38.870 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-08T15:37:38.959 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-08T15:37:38.964 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-08T15:37:38.964 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-08T15:37:39.082 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T15:37:39.289 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:37:39.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T15:37:39.319 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T15:37:39.408 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T15:37:39.410 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T15:37:39.411 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:37:39.411 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T15:37:39.437 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T15:37:39.440 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T15:37:39.440 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T15:37:39.507 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T15:37:39.514 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T15:37:39.579 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2023-10-08T15:37:39.580 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2023-10-08T15:37:39.582 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T15:37:39.647 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2023-10-08T15:37:39.649 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2023-10-08T15:37:39.992 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-08T15:37:40.037 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T15:37:40.306 INFO:teuthology.orchestra.run.smithi029.stdout:44 files removed 2023-10-08T15:37:40.313 INFO:teuthology.orchestra.run.smithi183.stdout:44 files removed 2023-10-08T15:37:40.361 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T15:37:40.363 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T15:37:40.712 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2023-10-08T15:37:40.729 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-08T15:37:41.464 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 246 kB/s | 78 kB 00:00 2023-10-08T15:37:41.546 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 223 kB/s | 78 kB 00:00 2023-10-08T15:37:41.822 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 29 kB/s | 9.2 kB 00:00 2023-10-08T15:37:41.829 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-08T15:37:42.047 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 7.9 kB/s | 1.5 kB 00:00 2023-10-08T15:37:42.098 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-10-08T15:37:42.169 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 38 kB/s | 3.5 kB 00:00 2023-10-08T15:37:42.207 INFO:teuthology.orchestra.run.smithi183.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-08T15:37:43.119 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-08T15:37:43.757 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-08T15:37:46.634 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 2.8 MB/s | 24 kB 00:00 2023-10-08T15:37:47.073 INFO:teuthology.orchestra.run.smithi029.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 109 MB/s | 38 MB 00:00 2023-10-08T15:37:47.073 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2023-10-08T15:37:47.449 INFO:teuthology.orchestra.run.smithi183.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 130 MB/s | 38 MB 00:00 2023-10-08T15:37:52.875 INFO:teuthology.orchestra.run.smithi029.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 106 MB/s | 33 MB 00:00 2023-10-08T15:37:52.983 INFO:teuthology.orchestra.run.smithi183.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 125 MB/s | 33 MB 00:00 2023-10-08T15:38:00.898 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T15:38:00.899 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T15:38:00.910 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-08T15:38:00.910 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-08T15:38:00.911 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-08T15:38:00.912 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T15:38:00.914 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T15:38:00.916 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-08T15:38:00.917 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-08T15:38:01.411 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-08T15:38:01.422 INFO:teuthology.orchestra.run.smithi183.stdout:====================================================================================================================== 2023-10-08T15:38:01.422 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-08T15:38:01.422 INFO:teuthology.orchestra.run.smithi183.stdout:====================================================================================================================== 2023-10-08T15:38:01.422 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-08T15:38:01.422 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T15:38:01.422 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-08T15:38:01.422 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-08T15:38:01.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-08T15:38:01.424 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-08T15:38:01.425 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2023-10-08T15:38:01.426 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T15:38:01.426 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-08T15:38:01.426 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-08T15:38:01.426 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T15:38:01.426 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-08T15:38:01.426 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-08T15:38:01.426 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-08T15:38:01.427 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-08T15:38:01.427 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-08T15:38:01.427 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T15:38:01.427 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-08T15:38:01.427 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-08T15:38:01.427 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T15:38:01.427 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T15:38:01.428 INFO:teuthology.orchestra.run.smithi183.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-08T15:38:01.428 INFO:teuthology.orchestra.run.smithi183.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T15:38:01.428 INFO:teuthology.orchestra.run.smithi183.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T15:38:01.428 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-08T15:38:01.428 INFO:teuthology.orchestra.run.smithi183.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-08T15:38:01.428 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-08T15:38:01.428 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T15:38:01.428 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T15:38:01.429 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-08T15:38:01.430 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T15:38:01.431 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T15:38:01.432 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T15:38:01.433 INFO:teuthology.orchestra.run.smithi183.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T15:38:01.434 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:38:01.435 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-08T15:38:01.435 INFO:teuthology.orchestra.run.smithi183.stdout:====================================================================================================================== 2023-10-08T15:38:01.435 INFO:teuthology.orchestra.run.smithi183.stdout:Install 118 Packages 2023-10-08T15:38:01.435 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 2 Packages 2023-10-08T15:38:01.435 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:38:01.435 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 202 M 2023-10-08T15:38:01.435 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-08T15:38:01.607 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T15:38:01.633 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T15:38:01.633 INFO:teuthology.orchestra.run.smithi029.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-08T15:38:01.633 INFO:teuthology.orchestra.run.smithi029.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-08T15:38:01.633 INFO:teuthology.orchestra.run.smithi029.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-08T15:38:01.633 INFO:teuthology.orchestra.run.smithi029.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T15:38:01.633 INFO:teuthology.orchestra.run.smithi029.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T15:38:01.633 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-08T15:38:01.633 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-08T15:38:01.747 INFO:teuthology.orchestra.run.smithi183.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 42 kB/s | 6.4 kB 00:00 2023-10-08T15:38:02.135 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-10-08T15:38:02.142 INFO:teuthology.orchestra.run.smithi183.stdout:(2/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 9.4 MB/s | 5.2 MB 00:00 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================================== 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================================== 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-08T15:38:02.148 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-08T15:38:02.149 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-08T15:38:02.150 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-08T15:38:02.151 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-08T15:38:02.152 INFO:teuthology.orchestra.run.smithi029.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T15:38:02.153 INFO:teuthology.orchestra.run.smithi029.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T15:38:02.154 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T15:38:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T15:38:02.156 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T15:38:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:38:02.158 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-10-08T15:38:02.159 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================================== 2023-10-08T15:38:02.159 INFO:teuthology.orchestra.run.smithi029.stdout:Install 118 Packages 2023-10-08T15:38:02.159 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 2 Packages 2023-10-08T15:38:02.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:38:02.159 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 202 M 2023-10-08T15:38:02.159 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-10-08T15:38:02.175 INFO:teuthology.orchestra.run.smithi183.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 4.8 MB/s | 162 kB 00:00 2023-10-08T15:38:02.348 INFO:teuthology.orchestra.run.smithi183.stdout:(4/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.4 MB/s | 876 kB 00:00 2023-10-08T15:38:02.388 INFO:teuthology.orchestra.run.smithi183.stdout:(5/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 11 MB/s | 2.3 MB 00:00 2023-10-08T15:38:02.402 INFO:teuthology.orchestra.run.smithi029.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 31 kB/s | 6.4 kB 00:00 2023-10-08T15:38:02.745 INFO:teuthology.orchestra.run.smithi183.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 11 MB/s | 3.9 MB 00:00 2023-10-08T15:38:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 949 kB/s | 876 kB 00:00 2023-10-08T15:38:03.385 INFO:teuthology.orchestra.run.smithi029.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 2.6 MB/s | 162 kB 00:00 2023-10-08T15:38:03.460 INFO:teuthology.orchestra.run.smithi183.stdout:(7/120): ceph-common-17.2.6-1320.g08cac018.el8. 13 MB/s | 23 MB 00:01 2023-10-08T15:38:03.478 INFO:teuthology.orchestra.run.smithi183.stdout:(8/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 1.4 MB/s | 1.6 MB 00:01 2023-10-08T15:38:03.562 INFO:teuthology.orchestra.run.smithi183.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 289 kB/s | 24 kB 00:00 2023-10-08T15:38:04.335 INFO:teuthology.orchestra.run.smithi029.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 2.4 MB/s | 2.3 MB 00:00 2023-10-08T15:38:04.347 INFO:teuthology.orchestra.run.smithi183.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 10 MB/s | 17 MB 00:01 2023-10-08T15:38:04.415 INFO:teuthology.orchestra.run.smithi183.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.7 MB/s | 255 kB 00:00 2023-10-08T15:38:04.471 INFO:teuthology.orchestra.run.smithi183.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 447 kB/s | 25 kB 00:00 2023-10-08T15:38:04.556 INFO:teuthology.orchestra.run.smithi183.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 9.2 MB/s | 797 kB 00:00 2023-10-08T15:38:04.616 INFO:teuthology.orchestra.run.smithi183.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.9 MB/s | 174 kB 00:00 2023-10-08T15:38:04.669 INFO:teuthology.orchestra.run.smithi183.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 2.5 MB/s | 130 kB 00:00 2023-10-08T15:38:04.749 INFO:teuthology.orchestra.run.smithi029.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 3.8 MB/s | 1.6 MB 00:00 2023-10-08T15:38:04.802 INFO:teuthology.orchestra.run.smithi183.stdout:(16/120): ceph-radosgw-17.2.6-1320.g08cac018.el 13 MB/s | 17 MB 00:01 2023-10-08T15:38:04.806 INFO:teuthology.orchestra.run.smithi183.stdout:(17/120): libradosstriper1-17.2.6-1320.g08cac01 3.6 MB/s | 507 kB 00:00 2023-10-08T15:38:04.851 INFO:teuthology.orchestra.run.smithi183.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 990 kB/s | 45 kB 00:00 2023-10-08T15:38:04.899 INFO:teuthology.orchestra.run.smithi183.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 2.4 MB/s | 115 kB 00:00 2023-10-08T15:38:04.951 INFO:teuthology.orchestra.run.smithi183.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 3.6 MB/s | 190 kB 00:00 2023-10-08T15:38:05.007 INFO:teuthology.orchestra.run.smithi183.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 6.4 MB/s | 371 kB 00:00 2023-10-08T15:38:05.065 INFO:teuthology.orchestra.run.smithi183.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 6.1 MB/s | 358 kB 00:00 2023-10-08T15:38:05.114 INFO:teuthology.orchestra.run.smithi183.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.2 MB/s | 107 kB 00:00 2023-10-08T15:38:05.161 INFO:teuthology.orchestra.run.smithi183.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 1.9 MB/s | 90 kB 00:00 2023-10-08T15:38:05.195 INFO:teuthology.orchestra.run.smithi183.stdout:(25/120): librgw2-17.2.6-1320.g08cac018.el8.x86 14 MB/s | 5.6 MB 00:00 2023-10-08T15:38:05.250 INFO:teuthology.orchestra.run.smithi183.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 3.1 MB/s | 173 kB 00:00 2023-10-08T15:38:05.297 INFO:teuthology.orchestra.run.smithi183.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 494 kB/s | 23 kB 00:00 2023-10-08T15:38:05.349 INFO:teuthology.orchestra.run.smithi183.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 2.3 MB/s | 121 kB 00:00 2023-10-08T15:38:05.439 INFO:teuthology.orchestra.run.smithi183.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 12 MB/s | 3.5 MB 00:00 2023-10-08T15:38:05.536 INFO:teuthology.orchestra.run.smithi183.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 9.1 MB/s | 1.7 MB 00:00 2023-10-08T15:38:05.592 INFO:teuthology.orchestra.run.smithi183.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 4.2 MB/s | 238 kB 00:00 2023-10-08T15:38:05.645 INFO:teuthology.orchestra.run.smithi183.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 893 kB/s | 47 kB 00:00 2023-10-08T15:38:05.691 INFO:teuthology.orchestra.run.smithi183.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 315 kB/s | 14 kB 00:00 2023-10-08T15:38:05.699 INFO:teuthology.orchestra.run.smithi029.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 4.1 MB/s | 3.9 MB 00:00 2023-10-08T15:38:05.740 INFO:teuthology.orchestra.run.smithi183.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 5.4 MB/s | 267 kB 00:00 2023-10-08T15:38:05.790 INFO:teuthology.orchestra.run.smithi183.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.6 MB/s | 80 kB 00:00 2023-10-08T15:38:05.841 INFO:teuthology.orchestra.run.smithi183.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 356 kB/s | 18 kB 00:00 2023-10-08T15:38:05.960 INFO:teuthology.orchestra.run.smithi183.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 14 MB/s | 7.4 MB 00:00 2023-10-08T15:38:05.987 INFO:teuthology.orchestra.run.smithi183.stdout:(38/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2023-10-08T15:38:06.020 INFO:teuthology.orchestra.run.smithi183.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 2.2 MB/s | 75 kB 00:00 2023-10-08T15:38:06.050 INFO:teuthology.orchestra.run.smithi183.stdout:(40/120): liboath-2.6.2-3.el8.x86_64.rpm 657 kB/s | 59 kB 00:00 2023-10-08T15:38:06.095 INFO:teuthology.orchestra.run.smithi183.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 971 kB/s | 44 kB 00:00 2023-10-08T15:38:06.120 INFO:teuthology.orchestra.run.smithi183.stdout:(42/120): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2023-10-08T15:38:06.144 INFO:teuthology.orchestra.run.smithi183.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.4 MB/s | 33 kB 00:00 2023-10-08T15:38:06.161 INFO:teuthology.orchestra.run.smithi183.stdout:(44/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.8 MB/s | 185 kB 00:00 2023-10-08T15:38:06.163 INFO:teuthology.orchestra.run.smithi183.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 859 kB/s | 16 kB 00:00 2023-10-08T15:38:06.204 INFO:teuthology.orchestra.run.smithi029.stdout:(7/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.3 MB/s | 5.2 MB 00:04 2023-10-08T15:38:06.218 INFO:teuthology.orchestra.run.smithi183.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 7.0 MB/s | 384 kB 00:00 2023-10-08T15:38:06.218 INFO:teuthology.orchestra.run.smithi183.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-10-08T15:38:06.236 INFO:teuthology.orchestra.run.smithi183.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 4.2 MB/s | 81 kB 00:00 2023-10-08T15:38:06.237 INFO:teuthology.orchestra.run.smithi183.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 600 kB/s | 11 kB 00:00 2023-10-08T15:38:06.256 INFO:teuthology.orchestra.run.smithi183.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 900 kB/s | 18 kB 00:00 2023-10-08T15:38:06.276 INFO:teuthology.orchestra.run.smithi183.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 2.5 MB/s | 49 kB 00:00 2023-10-08T15:38:06.295 INFO:teuthology.orchestra.run.smithi183.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 3.0 MB/s | 59 kB 00:00 2023-10-08T15:38:06.314 INFO:teuthology.orchestra.run.smithi183.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 3.1 MB/s | 60 kB 00:00 2023-10-08T15:38:06.358 INFO:teuthology.orchestra.run.smithi183.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 6.3 MB/s | 283 kB 00:00 2023-10-08T15:38:06.381 INFO:teuthology.orchestra.run.smithi183.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 693 kB/s | 16 kB 00:00 2023-10-08T15:38:06.400 INFO:teuthology.orchestra.run.smithi183.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2023-10-08T15:38:06.421 INFO:teuthology.orchestra.run.smithi183.stdout:(57/120): python3-kubernetes-11.0.0-6.el8.noarc 6.3 MB/s | 1.2 MB 00:00 2023-10-08T15:38:06.423 INFO:teuthology.orchestra.run.smithi183.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 8.4 MB/s | 196 kB 00:00 2023-10-08T15:38:06.441 INFO:teuthology.orchestra.run.smithi183.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 3.3 MB/s | 64 kB 00:00 2023-10-08T15:38:06.441 INFO:teuthology.orchestra.run.smithi183.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 1.0 MB/s | 19 kB 00:00 2023-10-08T15:38:06.462 INFO:teuthology.orchestra.run.smithi183.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 1.1 MB/s | 24 kB 00:00 2023-10-08T15:38:06.462 INFO:teuthology.orchestra.run.smithi183.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2023-10-08T15:38:06.480 INFO:teuthology.orchestra.run.smithi183.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.5 MB/s | 27 kB 00:00 2023-10-08T15:38:06.500 INFO:teuthology.orchestra.run.smithi183.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 6.7 MB/s | 255 kB 00:00 2023-10-08T15:38:06.520 INFO:teuthology.orchestra.run.smithi183.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 3.2 MB/s | 61 kB 00:00 2023-10-08T15:38:06.541 INFO:teuthology.orchestra.run.smithi183.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.1 MB/s | 251 kB 00:00 2023-10-08T15:38:06.541 INFO:teuthology.orchestra.run.smithi183.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 3.7 MB/s | 85 kB 00:00 2023-10-08T15:38:06.582 INFO:teuthology.orchestra.run.smithi183.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 557 kB/s | 23 kB 00:00 2023-10-08T15:38:06.586 INFO:teuthology.orchestra.run.smithi183.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-10-08T15:38:06.623 INFO:teuthology.orchestra.run.smithi183.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 507 kB/s | 19 kB 00:00 2023-10-08T15:38:06.637 INFO:teuthology.orchestra.run.smithi183.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.2 MB/s | 43 kB 00:00 2023-10-08T15:38:06.651 INFO:teuthology.orchestra.run.smithi183.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 10 MB/s | 155 kB 00:00 2023-10-08T15:38:06.666 INFO:teuthology.orchestra.run.smithi183.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-10-08T15:38:06.680 INFO:teuthology.orchestra.run.smithi183.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.6 MB/s | 48 kB 00:00 2023-10-08T15:38:06.695 INFO:teuthology.orchestra.run.smithi183.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-10-08T15:38:06.708 INFO:teuthology.orchestra.run.smithi183.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.2 MB/s | 43 kB 00:00 2023-10-08T15:38:06.746 INFO:teuthology.orchestra.run.smithi183.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 61 MB/s | 2.3 MB 00:00 2023-10-08T15:38:06.759 INFO:teuthology.orchestra.run.smithi183.stdout:(78/120): thrift-0.13.0-2.el8.x86_64.rpm 8.0 MB/s | 1.7 MB 00:00 2023-10-08T15:38:06.760 INFO:teuthology.orchestra.run.smithi183.stdout:(79/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.2 MB/s | 18 kB 00:00 2023-10-08T15:38:06.779 INFO:teuthology.orchestra.run.smithi183.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 4.2 MB/s | 83 kB 00:00 2023-10-08T15:38:06.797 INFO:teuthology.orchestra.run.smithi183.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 3.3 MB/s | 59 kB 00:00 2023-10-08T15:38:06.803 INFO:teuthology.orchestra.run.smithi183.stdout:(82/120): pcre2-devel-10.32-2.el8.x86_64.rpm 13 MB/s | 605 kB 00:00 2023-10-08T15:38:06.816 INFO:teuthology.orchestra.run.smithi183.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.9 MB/s | 169 kB 00:00 2023-10-08T15:38:06.820 INFO:teuthology.orchestra.run.smithi183.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.2 MB/s | 38 kB 00:00 2023-10-08T15:38:06.833 INFO:teuthology.orchestra.run.smithi183.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.0 MB/s | 86 kB 00:00 2023-10-08T15:38:06.836 INFO:teuthology.orchestra.run.smithi183.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.6 MB/s | 58 kB 00:00 2023-10-08T15:38:06.849 INFO:teuthology.orchestra.run.smithi183.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.8 MB/s | 47 kB 00:00 2023-10-08T15:38:06.857 INFO:teuthology.orchestra.run.smithi183.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 26 MB/s | 559 kB 00:00 2023-10-08T15:38:06.872 INFO:teuthology.orchestra.run.smithi183.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 28 MB/s | 639 kB 00:00 2023-10-08T15:38:06.873 INFO:teuthology.orchestra.run.smithi183.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.3 MB/s | 70 kB 00:00 2023-10-08T15:38:06.887 INFO:teuthology.orchestra.run.smithi183.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-08T15:38:06.891 INFO:teuthology.orchestra.run.smithi183.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.4 MB/s | 97 kB 00:00 2023-10-08T15:38:06.908 INFO:teuthology.orchestra.run.smithi183.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 2.5 MB/s | 44 kB 00:00 2023-10-08T15:38:06.925 INFO:teuthology.orchestra.run.smithi183.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2023-10-08T15:38:06.944 INFO:teuthology.orchestra.run.smithi183.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 8.6 MB/s | 161 kB 00:00 2023-10-08T15:38:06.962 INFO:teuthology.orchestra.run.smithi183.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2023-10-08T15:38:06.985 INFO:teuthology.orchestra.run.smithi183.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2023-10-08T15:38:07.143 INFO:teuthology.orchestra.run.smithi183.stdout:(98/120): python3-scipy-1.0.0-20.module+el8.1.0 57 MB/s | 15 MB 00:00 2023-10-08T15:38:07.169 INFO:teuthology.orchestra.run.smithi183.stdout:(99/120): python3-babel-2.5.1-5.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-10-08T15:38:07.169 INFO:teuthology.orchestra.run.smithi183.stdout:(100/120): python3-markupsafe-0.23-19.el8.x86_6 1.4 MB/s | 39 kB 00:00 2023-10-08T15:38:07.189 INFO:teuthology.orchestra.run.smithi183.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2023-10-08T15:38:07.193 INFO:teuthology.orchestra.run.smithi183.stdout:(102/120): bison-3.0.4-10.el8.x86_64.rpm 28 MB/s | 688 kB 00:00 2023-10-08T15:38:07.208 INFO:teuthology.orchestra.run.smithi183.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 12 MB/s | 225 kB 00:00 2023-10-08T15:38:07.210 INFO:teuthology.orchestra.run.smithi183.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.3 MB/s | 126 kB 00:00 2023-10-08T15:38:07.225 INFO:teuthology.orchestra.run.smithi183.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-08T15:38:07.250 INFO:teuthology.orchestra.run.smithi183.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 22 MB/s | 538 kB 00:00 2023-10-08T15:38:07.268 INFO:teuthology.orchestra.run.smithi183.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 63 MB/s | 3.7 MB 00:00 2023-10-08T15:38:07.271 INFO:teuthology.orchestra.run.smithi183.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2023-10-08T15:38:07.286 INFO:teuthology.orchestra.run.smithi183.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 8.8 MB/s | 157 kB 00:00 2023-10-08T15:38:07.289 INFO:teuthology.orchestra.run.smithi183.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.2 MB/s | 110 kB 00:00 2023-10-08T15:38:07.302 INFO:teuthology.orchestra.run.smithi183.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-08T15:38:07.306 INFO:teuthology.orchestra.run.smithi183.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2023-10-08T15:38:07.320 INFO:teuthology.orchestra.run.smithi183.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.8 MB/s | 54 kB 00:00 2023-10-08T15:38:07.327 INFO:teuthology.orchestra.run.smithi183.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 28 MB/s | 709 kB 00:00 2023-10-08T15:38:07.389 INFO:teuthology.orchestra.run.smithi029.stdout:(8/120): ceph-common-17.2.6-1320.g08cac018.el8. 4.5 MB/s | 23 MB 00:05 2023-10-08T15:38:07.398 INFO:teuthology.orchestra.run.smithi183.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 61 MB/s | 4.7 MB 00:00 2023-10-08T15:38:07.410 INFO:teuthology.orchestra.run.smithi029.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 1.1 MB/s | 24 kB 00:00 2023-10-08T15:38:07.413 INFO:teuthology.orchestra.run.smithi183.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 54 MB/s | 4.6 MB 00:00 2023-10-08T15:38:07.420 INFO:teuthology.orchestra.run.smithi183.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 32 MB/s | 713 kB 00:00 2023-10-08T15:38:07.890 INFO:teuthology.orchestra.run.smithi183.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 7.6 MB/s | 3.6 MB 00:00 2023-10-08T15:38:07.912 INFO:teuthology.orchestra.run.smithi183.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 7.0 MB/s | 3.5 MB 00:00 2023-10-08T15:38:07.938 INFO:teuthology.orchestra.run.smithi029.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 7.5 MB/s | 17 MB 00:02 2023-10-08T15:38:07.986 INFO:teuthology.orchestra.run.smithi029.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 5.2 MB/s | 255 kB 00:00 2023-10-08T15:38:08.008 INFO:teuthology.orchestra.run.smithi029.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 1.1 MB/s | 25 kB 00:00 2023-10-08T15:38:08.106 INFO:teuthology.orchestra.run.smithi029.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 7.9 MB/s | 797 kB 00:00 2023-10-08T15:38:08.128 INFO:teuthology.orchestra.run.smithi029.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 7.8 MB/s | 174 kB 00:00 2023-10-08T15:38:08.152 INFO:teuthology.orchestra.run.smithi029.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 5.6 MB/s | 130 kB 00:00 2023-10-08T15:38:08.218 INFO:teuthology.orchestra.run.smithi029.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 7.4 MB/s | 507 kB 00:00 2023-10-08T15:38:08.807 INFO:teuthology.orchestra.run.smithi029.stdout:(17/120): librgw2-17.2.6-1320.g08cac018.el8.x86 9.4 MB/s | 5.6 MB 00:00 2023-10-08T15:38:08.834 INFO:teuthology.orchestra.run.smithi029.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 1.7 MB/s | 45 kB 00:00 2023-10-08T15:38:08.858 INFO:teuthology.orchestra.run.smithi029.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 4.7 MB/s | 115 kB 00:00 2023-10-08T15:38:08.884 INFO:teuthology.orchestra.run.smithi029.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 7.3 MB/s | 190 kB 00:00 2023-10-08T15:38:08.934 INFO:teuthology.orchestra.run.smithi029.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 7.2 MB/s | 371 kB 00:00 2023-10-08T15:38:08.986 INFO:teuthology.orchestra.run.smithi029.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 6.9 MB/s | 358 kB 00:00 2023-10-08T15:38:09.008 INFO:teuthology.orchestra.run.smithi029.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 4.6 MB/s | 107 kB 00:00 2023-10-08T15:38:09.030 INFO:teuthology.orchestra.run.smithi029.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 4.0 MB/s | 90 kB 00:00 2023-10-08T15:38:09.407 INFO:teuthology.orchestra.run.smithi029.stdout:(25/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 9.2 MB/s | 3.5 MB 00:00 2023-10-08T15:38:09.436 INFO:teuthology.orchestra.run.smithi029.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 6.1 MB/s | 173 kB 00:00 2023-10-08T15:38:09.458 INFO:teuthology.orchestra.run.smithi029.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 1.0 MB/s | 23 kB 00:00 2023-10-08T15:38:09.482 INFO:teuthology.orchestra.run.smithi029.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 5.0 MB/s | 121 kB 00:00 2023-10-08T15:38:09.775 INFO:teuthology.orchestra.run.smithi029.stdout:(29/120): ceph-radosgw-17.2.6-1320.g08cac018.el 4.7 MB/s | 17 MB 00:03 2023-10-08T15:38:09.782 INFO:teuthology.orchestra.run.smithi029.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 5.7 MB/s | 1.7 MB 00:00 2023-10-08T15:38:09.813 INFO:teuthology.orchestra.run.smithi029.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 7.9 MB/s | 238 kB 00:00 2023-10-08T15:38:09.835 INFO:teuthology.orchestra.run.smithi029.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 2.1 MB/s | 47 kB 00:00 2023-10-08T15:38:09.856 INFO:teuthology.orchestra.run.smithi029.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 697 kB/s | 14 kB 00:00 2023-10-08T15:38:09.886 INFO:teuthology.orchestra.run.smithi029.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 8.8 MB/s | 267 kB 00:00 2023-10-08T15:38:09.911 INFO:teuthology.orchestra.run.smithi029.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 3.2 MB/s | 80 kB 00:00 2023-10-08T15:38:09.932 INFO:teuthology.orchestra.run.smithi029.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 871 kB/s | 18 kB 00:00 2023-10-08T15:38:10.142 INFO:teuthology.orchestra.run.smithi029.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-10-08T15:38:10.177 INFO:teuthology.orchestra.run.smithi029.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2023-10-08T15:38:10.213 INFO:teuthology.orchestra.run.smithi029.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 2.1 MB/s | 75 kB 00:00 2023-10-08T15:38:10.285 INFO:teuthology.orchestra.run.smithi029.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 6.4 MB/s | 476 kB 00:00 2023-10-08T15:38:10.317 INFO:teuthology.orchestra.run.smithi029.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.4 MB/s | 44 kB 00:00 2023-10-08T15:38:10.353 INFO:teuthology.orchestra.run.smithi029.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 5.0 MB/s | 185 kB 00:00 2023-10-08T15:38:10.385 INFO:teuthology.orchestra.run.smithi029.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.0 MB/s | 33 kB 00:00 2023-10-08T15:38:10.416 INFO:teuthology.orchestra.run.smithi029.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 529 kB/s | 16 kB 00:00 2023-10-08T15:38:10.452 INFO:teuthology.orchestra.run.smithi029.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 4.7 MB/s | 173 kB 00:00 2023-10-08T15:38:10.496 INFO:teuthology.orchestra.run.smithi029.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 8.7 MB/s | 384 kB 00:00 2023-10-08T15:38:10.528 INFO:teuthology.orchestra.run.smithi029.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 2.5 MB/s | 81 kB 00:00 2023-10-08T15:38:10.559 INFO:teuthology.orchestra.run.smithi029.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 360 kB/s | 11 kB 00:00 2023-10-08T15:38:10.591 INFO:teuthology.orchestra.run.smithi029.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 567 kB/s | 18 kB 00:00 2023-10-08T15:38:10.625 INFO:teuthology.orchestra.run.smithi029.stdout:(50/120): ceph-mgr-diskprediction-local-17.2.6- 8.7 MB/s | 7.4 MB 00:00 2023-10-08T15:38:10.662 INFO:teuthology.orchestra.run.smithi029.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 16 MB/s | 1.2 MB 00:00 2023-10-08T15:38:10.693 INFO:teuthology.orchestra.run.smithi029.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.8 MB/s | 59 kB 00:00 2023-10-08T15:38:10.725 INFO:teuthology.orchestra.run.smithi029.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.9 MB/s | 60 kB 00:00 2023-10-08T15:38:10.750 INFO:teuthology.orchestra.run.smithi029.stdout:(54/120): python3-logutils-0.3.5-11.el8.noarch. 383 kB/s | 49 kB 00:00 2023-10-08T15:38:10.759 INFO:teuthology.orchestra.run.smithi029.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 8.1 MB/s | 283 kB 00:00 2023-10-08T15:38:10.786 INFO:teuthology.orchestra.run.smithi029.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 438 kB/s | 16 kB 00:00 2023-10-08T15:38:10.790 INFO:teuthology.orchestra.run.smithi029.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.1 MB/s | 34 kB 00:00 2023-10-08T15:38:10.822 INFO:teuthology.orchestra.run.smithi029.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 2.0 MB/s | 64 kB 00:00 2023-10-08T15:38:10.853 INFO:teuthology.orchestra.run.smithi029.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 606 kB/s | 19 kB 00:00 2023-10-08T15:38:10.884 INFO:teuthology.orchestra.run.smithi029.stdout:(60/120): python3-routes-2.4.1-12.el8.noarch.rp 2.0 MB/s | 196 kB 00:00 2023-10-08T15:38:10.884 INFO:teuthology.orchestra.run.smithi029.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 770 kB/s | 24 kB 00:00 2023-10-08T15:38:10.916 INFO:teuthology.orchestra.run.smithi029.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 893 kB/s | 27 kB 00:00 2023-10-08T15:38:10.918 INFO:teuthology.orchestra.run.smithi029.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 873 kB/s | 29 kB 00:00 2023-10-08T15:38:10.950 INFO:teuthology.orchestra.run.smithi029.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 7.4 MB/s | 255 kB 00:00 2023-10-08T15:38:10.972 INFO:teuthology.orchestra.run.smithi029.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.5 MB/s | 251 kB 00:00 2023-10-08T15:38:10.981 INFO:teuthology.orchestra.run.smithi029.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.9 MB/s | 61 kB 00:00 2023-10-08T15:38:11.008 INFO:teuthology.orchestra.run.smithi029.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 2.3 MB/s | 85 kB 00:00 2023-10-08T15:38:11.012 INFO:teuthology.orchestra.run.smithi029.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 749 kB/s | 23 kB 00:00 2023-10-08T15:38:11.017 INFO:teuthology.orchestra.run.smithi029.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-08T15:38:11.050 INFO:teuthology.orchestra.run.smithi029.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 559 kB/s | 19 kB 00:00 2023-10-08T15:38:11.066 INFO:teuthology.orchestra.run.smithi029.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.6 MB/s | 43 kB 00:00 2023-10-08T15:38:11.082 INFO:teuthology.orchestra.run.smithi029.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 10 MB/s | 155 kB 00:00 2023-10-08T15:38:11.098 INFO:teuthology.orchestra.run.smithi029.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-08T15:38:11.111 INFO:teuthology.orchestra.run.smithi029.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.6 MB/s | 48 kB 00:00 2023-10-08T15:38:11.127 INFO:teuthology.orchestra.run.smithi029.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-10-08T15:38:11.142 INFO:teuthology.orchestra.run.smithi029.stdout:(76/120): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-10-08T15:38:11.144 INFO:teuthology.orchestra.run.smithi029.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.5 MB/s | 43 kB 00:00 2023-10-08T15:38:11.159 INFO:teuthology.orchestra.run.smithi029.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.2 MB/s | 18 kB 00:00 2023-10-08T15:38:11.181 INFO:teuthology.orchestra.run.smithi029.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 27 MB/s | 605 kB 00:00 2023-10-08T15:38:11.195 INFO:teuthology.orchestra.run.smithi029.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 5.7 MB/s | 83 kB 00:00 2023-10-08T15:38:11.206 INFO:teuthology.orchestra.run.smithi029.stdout:(81/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 36 MB/s | 2.3 MB 00:00 2023-10-08T15:38:11.208 INFO:teuthology.orchestra.run.smithi029.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.6 MB/s | 59 kB 00:00 2023-10-08T15:38:11.221 INFO:teuthology.orchestra.run.smithi029.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-10-08T15:38:11.221 INFO:teuthology.orchestra.run.smithi029.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.8 MB/s | 38 kB 00:00 2023-10-08T15:38:11.234 INFO:teuthology.orchestra.run.smithi029.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.3 MB/s | 86 kB 00:00 2023-10-08T15:38:11.238 INFO:teuthology.orchestra.run.smithi029.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.1 MB/s | 58 kB 00:00 2023-10-08T15:38:11.247 INFO:teuthology.orchestra.run.smithi029.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.7 MB/s | 47 kB 00:00 2023-10-08T15:38:11.255 INFO:teuthology.orchestra.run.smithi029.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 28 MB/s | 559 kB 00:00 2023-10-08T15:38:11.269 INFO:teuthology.orchestra.run.smithi029.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 29 MB/s | 639 kB 00:00 2023-10-08T15:38:11.271 INFO:teuthology.orchestra.run.smithi029.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.4 MB/s | 70 kB 00:00 2023-10-08T15:38:11.283 INFO:teuthology.orchestra.run.smithi029.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 14 MB/s | 200 kB 00:00 2023-10-08T15:38:11.285 INFO:teuthology.orchestra.run.smithi029.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.8 MB/s | 97 kB 00:00 2023-10-08T15:38:11.297 INFO:teuthology.orchestra.run.smithi029.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.5 MB/s | 44 kB 00:00 2023-10-08T15:38:11.310 INFO:teuthology.orchestra.run.smithi029.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.1 MB/s | 27 kB 00:00 2023-10-08T15:38:11.324 INFO:teuthology.orchestra.run.smithi029.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-10-08T15:38:11.341 INFO:teuthology.orchestra.run.smithi029.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-08T15:38:11.360 INFO:teuthology.orchestra.run.smithi029.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-10-08T15:38:11.451 INFO:teuthology.orchestra.run.smithi029.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 52 MB/s | 4.8 MB 00:00 2023-10-08T15:38:11.464 INFO:teuthology.orchestra.run.smithi029.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-10-08T15:38:11.487 INFO:teuthology.orchestra.run.smithi029.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 30 MB/s | 688 kB 00:00 2023-10-08T15:38:11.618 INFO:teuthology.orchestra.run.smithi029.stdout:(101/120): python3-scipy-1.0.0-20.module+el8.1. 43 MB/s | 15 MB 00:00 2023-10-08T15:38:11.624 INFO:teuthology.orchestra.run.smithi029.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-10-08T15:38:11.634 INFO:teuthology.orchestra.run.smithi029.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 14 MB/s | 225 kB 00:00 2023-10-08T15:38:11.638 INFO:teuthology.orchestra.run.smithi029.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.6 MB/s | 126 kB 00:00 2023-10-08T15:38:11.655 INFO:teuthology.orchestra.run.smithi029.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-08T15:38:11.735 INFO:teuthology.orchestra.run.smithi029.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 6.6 MB/s | 538 kB 00:00 2023-10-08T15:38:11.753 INFO:teuthology.orchestra.run.smithi029.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 17 MB/s | 302 kB 00:00 2023-10-08T15:38:11.764 INFO:teuthology.orchestra.run.smithi029.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 29 MB/s | 3.7 MB 00:00 2023-10-08T15:38:11.769 INFO:teuthology.orchestra.run.smithi029.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.9 MB/s | 157 kB 00:00 2023-10-08T15:38:11.779 INFO:teuthology.orchestra.run.smithi029.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.3 MB/s | 110 kB 00:00 2023-10-08T15:38:11.787 INFO:teuthology.orchestra.run.smithi029.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 19 MB/s | 353 kB 00:00 2023-10-08T15:38:11.792 INFO:teuthology.orchestra.run.smithi029.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-08T15:38:11.805 INFO:teuthology.orchestra.run.smithi029.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.2 MB/s | 54 kB 00:00 2023-10-08T15:38:11.811 INFO:teuthology.orchestra.run.smithi029.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 30 MB/s | 709 kB 00:00 2023-10-08T15:38:11.895 INFO:teuthology.orchestra.run.smithi029.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 53 MB/s | 4.7 MB 00:00 2023-10-08T15:38:11.912 INFO:teuthology.orchestra.run.smithi029.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 46 MB/s | 4.6 MB 00:00 2023-10-08T15:38:12.590 INFO:teuthology.orchestra.run.smithi029.stdout:(117/120): ceph-test-17.2.6-1320.g08cac018.el8. 10 MB/s | 52 MB 00:05 2023-10-08T15:38:12.605 INFO:teuthology.orchestra.run.smithi029.stdout:(118/120): automake-1.16.1-7.el8.noarch.rpm 1.0 MB/s | 713 kB 00:00 2023-10-08T15:38:13.000 INFO:teuthology.orchestra.run.smithi029.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 3.2 MB/s | 3.5 MB 00:01 2023-10-08T15:38:13.365 INFO:teuthology.orchestra.run.smithi029.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 4.6 MB/s | 3.6 MB 00:00 2023-10-08T15:38:13.369 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-10-08T15:38:13.370 INFO:teuthology.orchestra.run.smithi029.stdout:Total 18 MB/s | 202 MB 00:11 2023-10-08T15:38:13.428 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-10-08T15:38:13.555 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-10-08T15:38:13.555 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-10-08T15:38:16.126 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-10-08T15:38:16.131 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-10-08T15:38:16.330 INFO:teuthology.orchestra.run.smithi183.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 4.0 MB/s | 52 MB 00:12 2023-10-08T15:38:16.402 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-08T15:38:16.402 INFO:teuthology.orchestra.run.smithi183.stdout:Total 14 MB/s | 202 MB 00:14 2023-10-08T15:38:16.402 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-08T15:38:16.506 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-08T15:38:16.507 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-08T15:38:18.210 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-08T15:38:18.214 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-08T15:38:21.127 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-10-08T15:38:21.730 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-08T15:38:21.938 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T15:38:22.133 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T15:38:22.388 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T15:38:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-08T15:38:22.794 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T15:38:23.012 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-08T15:38:23.071 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T15:38:23.191 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T15:38:23.326 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T15:38:23.515 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T15:38:23.550 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T15:38:23.779 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T15:38:23.924 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T15:38:23.930 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T15:38:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T15:38:24.170 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T15:38:24.278 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T15:38:24.502 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T15:38:24.547 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T15:38:24.758 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T15:38:24.840 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-08T15:38:24.889 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T15:38:25.532 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-08T15:38:25.729 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T15:38:25.774 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T15:38:25.885 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T15:38:25.892 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T15:38:26.105 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T15:38:26.126 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-08T15:38:26.340 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-08T15:38:26.416 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-08T15:38:27.086 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-08T15:38:27.180 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T15:38:27.249 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T15:38:27.366 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T15:38:27.620 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-08T15:38:27.798 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-08T15:38:27.987 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T15:38:27.991 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T15:38:28.124 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T15:38:28.162 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T15:38:28.255 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T15:38:28.299 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T15:38:28.378 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T15:38:28.470 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-08T15:38:28.545 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-08T15:38:28.774 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-08T15:38:28.822 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-08T15:38:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-08T15:38:29.059 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-08T15:38:29.195 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-08T15:38:29.244 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-08T15:38:29.324 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T15:38:29.437 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T15:38:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T15:38:29.592 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T15:38:29.649 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T15:38:29.812 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T15:38:30.188 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T15:38:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T15:38:30.390 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T15:38:30.570 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T15:38:30.896 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T15:38:31.107 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T15:38:31.131 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T15:38:31.345 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T15:38:31.824 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T15:38:32.077 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-08T15:38:32.175 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T15:38:32.333 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-08T15:38:32.492 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-08T15:38:32.577 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-08T15:38:32.744 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-08T15:38:32.755 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-08T15:38:32.892 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-08T15:38:32.985 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-08T15:38:33.215 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-08T15:38:33.227 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-08T15:38:33.463 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-08T15:38:33.724 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-08T15:38:33.765 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-08T15:38:33.965 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T15:38:34.030 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-08T15:38:34.342 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-08T15:38:34.627 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-08T15:38:34.836 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T15:38:36.059 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T15:38:36.412 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-08T15:38:37.142 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T15:38:37.463 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-08T15:38:37.566 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-08T15:38:37.824 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-08T15:38:38.067 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-08T15:38:38.319 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-08T15:38:38.530 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-08T15:38:38.698 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-08T15:38:38.761 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-08T15:38:38.945 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-08T15:38:39.100 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-08T15:38:39.191 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-08T15:38:39.391 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-08T15:38:39.423 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-08T15:38:39.604 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-08T15:38:39.685 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-08T15:38:39.815 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-08T15:38:39.923 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-08T15:38:40.018 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-08T15:38:40.115 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-08T15:38:40.197 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T15:38:40.276 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T15:38:40.325 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-08T15:38:40.438 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-08T15:38:40.598 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-08T15:38:40.617 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-08T15:38:40.795 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-08T15:38:40.836 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-08T15:38:40.952 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-08T15:38:41.077 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-08T15:38:41.098 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-08T15:38:41.290 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-08T15:38:41.350 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-08T15:38:41.441 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-08T15:38:41.542 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-08T15:38:41.657 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-08T15:38:41.752 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T15:38:41.824 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-08T15:38:41.841 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T15:38:42.072 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-08T15:38:42.144 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-08T15:38:42.327 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-08T15:38:42.401 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-08T15:38:42.510 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-08T15:38:42.647 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-08T15:38:42.753 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-08T15:38:42.897 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-08T15:38:43.008 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-08T15:38:43.063 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-08T15:38:43.172 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-08T15:38:43.268 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-08T15:38:43.375 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-08T15:38:43.543 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-08T15:38:43.579 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-08T15:38:43.780 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-08T15:38:43.799 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-08T15:38:44.003 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-08T15:38:44.184 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-08T15:38:44.225 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-08T15:38:44.332 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-08T15:38:44.530 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-08T15:38:44.560 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-08T15:38:44.775 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-08T15:38:44.876 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-08T15:38:44.999 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-08T15:38:45.216 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-08T15:38:45.251 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-08T15:38:45.377 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-08T15:38:45.461 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-08T15:38:45.611 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-08T15:38:45.634 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-08T15:38:45.825 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-08T15:38:45.956 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-08T15:38:46.018 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-08T15:38:46.220 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-08T15:38:46.313 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-08T15:38:46.418 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-08T15:38:46.546 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-08T15:38:46.632 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-08T15:38:46.799 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-08T15:38:46.804 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-08T15:38:47.036 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-08T15:38:47.075 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-08T15:38:47.295 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-08T15:38:47.594 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-08T15:38:47.789 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-08T15:38:48.018 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-08T15:38:48.233 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-08T15:38:48.319 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-08T15:38:48.518 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-08T15:38:48.609 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-08T15:38:48.755 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-08T15:38:48.826 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-08T15:38:49.067 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-08T15:38:49.182 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-08T15:38:49.317 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-08T15:38:49.478 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-08T15:38:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-08T15:38:49.739 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-08T15:38:49.864 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-08T15:38:50.054 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-08T15:38:50.094 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-08T15:38:50.270 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-08T15:38:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-08T15:38:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-08T15:38:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-08T15:38:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-08T15:38:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-08T15:38:53.003 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-08T15:38:53.287 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-08T15:38:53.545 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-08T15:38:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-08T15:38:55.354 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T15:38:55.553 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T15:38:56.134 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T15:38:56.437 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T15:38:56.523 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T15:38:56.644 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T15:39:00.462 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T15:39:02.568 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T15:39:03.240 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T15:39:03.573 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T15:39:03.672 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T15:39:03.833 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T15:39:14.309 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T15:39:14.310 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2023-10-08T15:39:14.310 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2023-10-08T15:39:14.310 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /dev 2023-10-08T15:39:14.310 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /run 2023-10-08T15:39:14.310 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2023-10-08T15:39:14.310 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2023-10-08T15:39:14.311 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2023-10-08T15:39:14.311 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2023-10-08T15:39:14.311 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /dev 2023-10-08T15:39:14.311 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:14.666 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T15:39:16.151 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T15:39:16.333 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T15:39:16.556 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T15:39:16.714 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T15:39:17.104 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T15:39:17.257 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T15:39:17.274 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T15:39:20.126 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T15:39:20.303 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T15:39:20.496 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-08T15:39:20.685 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-08T15:39:20.876 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T15:39:21.091 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T15:39:21.265 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T15:39:22.236 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T15:39:22.414 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T15:39:22.514 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T15:39:22.897 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-08T15:39:23.074 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T15:39:23.111 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T15:39:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T15:39:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T15:39:24.282 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T15:39:24.282 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2023-10-08T15:39:24.282 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2023-10-08T15:39:24.282 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2023-10-08T15:39:24.282 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /run 2023-10-08T15:39:24.283 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2023-10-08T15:39:24.283 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2023-10-08T15:39:24.283 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2023-10-08T15:39:24.283 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2023-10-08T15:39:24.283 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2023-10-08T15:39:24.283 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:24.722 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T15:39:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-08T15:39:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T15:39:25.213 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T15:39:25.381 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T15:39:25.424 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T15:39:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T15:39:25.937 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T15:39:26.097 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T15:39:26.319 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T15:39:26.487 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T15:39:26.723 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T15:39:26.982 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T15:39:27.400 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T15:39:27.628 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T15:39:27.628 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T15:39:30.948 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T15:39:31.003 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T15:39:31.098 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T15:39:31.370 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-08T15:39:31.594 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-08T15:39:31.772 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T15:39:31.917 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-08T15:39:32.003 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T15:39:32.203 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T15:39:32.258 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-08T15:39:32.451 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-08T15:39:32.683 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-08T15:39:32.871 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T15:39:32.882 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T15:39:33.050 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-08T15:39:33.239 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T15:39:33.242 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-08T15:39:33.421 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-08T15:39:33.479 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T15:39:33.584 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T15:39:33.587 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-08T15:39:33.832 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-08T15:39:34.029 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T15:39:34.035 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-08T15:39:34.088 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T15:39:34.220 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T15:39:34.258 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T15:39:34.262 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T15:39:34.271 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T15:39:34.414 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-08T15:39:34.415 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T15:39:34.471 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T15:39:34.482 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T15:39:34.623 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T15:39:34.623 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T15:39:35.442 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T15:39:35.442 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-08T15:39:35.442 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-08T15:39:35.442 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-08T15:39:35.442 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T15:39:35.443 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-08T15:39:35.444 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-08T15:39:35.445 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-08T15:39:35.446 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-08T15:39:35.447 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-08T15:39:35.448 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-08T15:39:35.449 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-08T15:39:35.450 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-08T15:39:35.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-08T15:39:35.452 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-08T15:39:35.453 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-08T15:39:36.188 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-08T15:39:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T15:39:36.607 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T15:39:36.804 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T15:39:36.850 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T15:39:37.029 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T15:39:37.402 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T15:39:37.629 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T15:39:37.642 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T15:39:37.642 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:45 ago on Sun 08 Oct 2023 03:37:52 PM UTC. 2023-10-08T15:39:39.846 INFO:teuthology.orchestra.run.smithi183.stdout:Installed products updated. 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.006 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.007 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T15:39:40.008 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: jq-1.5-12.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T15:39:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T15:39:40.010 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T15:39:40.011 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T15:39:40.012 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T15:39:40.013 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.014 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T15:39:40.015 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T15:39:40.015 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-08T15:39:40.015 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T15:39:40.015 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T15:39:40.015 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T15:39:40.015 INFO:teuthology.orchestra.run.smithi183.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T15:39:40.015 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-08T15:39:40.016 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T15:39:40.017 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-08T15:39:40.017 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:40.017 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-08T15:39:40.236 DEBUG:teuthology.parallel:result is None 2023-10-08T15:39:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T15:39:43.966 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-08T15:39:44.393 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-08T15:39:44.610 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-08T15:39:44.925 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-08T15:39:45.153 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T15:39:45.166 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T15:39:45.316 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-08T15:39:45.534 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-08T15:39:45.695 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-08T15:39:45.930 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-08T15:39:46.200 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-08T15:39:46.377 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T15:39:46.452 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T15:39:46.661 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T15:39:46.672 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T15:39:46.839 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-08T15:39:46.839 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T15:39:47.031 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T15:39:47.031 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T15:39:47.980 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-08T15:39:47.981 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-08T15:39:47.982 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-08T15:39:47.983 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-08T15:39:47.984 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-08T15:39:47.985 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-08T15:39:47.986 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-08T15:39:47.987 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-08T15:39:47.988 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-08T15:39:47.989 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-08T15:39:47.990 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-08T15:39:47.990 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-08T15:39:47.990 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-08T15:39:47.990 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-08T15:39:47.990 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-08T15:39:50.414 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T15:39:50.414 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:58 ago on Sun 08 Oct 2023 03:37:52 PM UTC. 2023-10-08T15:39:52.516 INFO:teuthology.orchestra.run.smithi029.stdout:Installed products updated. 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T15:39:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: jq-1.5-12.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-08T15:39:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T15:39:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-08T15:39:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T15:39:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-08T15:39:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T15:39:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T15:39:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-08T15:39:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:52.687 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-10-08T15:39:52.939 DEBUG:teuthology.parallel:result is None 2023-10-08T15:39:52.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:39:53.088 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T15:39:53.109 INFO:teuthology.orchestra.run.smithi029.stdout:17.2.6-1320.g08cac018.el8 2023-10-08T15:39:53.110 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-08T15:39:53.110 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-08T15:39:53.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:39:53.329 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T15:39:53.354 INFO:teuthology.orchestra.run.smithi183.stdout:17.2.6-1320.g08cac018.el8 2023-10-08T15:39:53.355 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-08T15:39:53.355 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-08T15:39:53.355 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T15:39:53.356 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:53.356 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T15:39:53.397 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:39:53.397 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T15:39:53.440 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T15:39:53.440 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:53.441 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T15:39:53.466 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T15:39:53.531 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:39:53.532 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T15:39:53.558 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T15:39:53.623 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T15:39:53.623 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:53.623 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T15:39:53.648 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T15:39:53.713 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:39:53.713 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T15:39:53.739 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T15:39:53.803 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T15:39:53.804 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:53.804 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T15:39:53.828 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T15:39:53.893 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:39:53.893 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T15:39:53.917 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T15:39:53.981 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T15:39:54.057 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T15:39:54.057 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2023-10-08T15:39:54.059 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2023-10-08T15:39:54.083 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T15:39:54.083 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T15:39:54.124 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T15:39:54.147 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T15:39:54.148 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T15:39:54.189 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T15:39:54.220 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T15:39:54.221 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T15:39:54.221 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T15:39:54.221 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:54.221 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T15:39:54.267 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:54.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:54.407 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:39:54.407 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T15:39:54.423 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:54.537 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T15:39:54.586 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T15:39:54.586 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T15:39:54.587 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418275', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7418275', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-08_15:12:05-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 74, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgK6YgZ6UFWtR0PZiZebo/LfTh6SkAS6jSiI+iH6SmorJiiCnxmc+mKGW1rwJNRcxcyAuZ/kEZu7r3aAaX6Plo=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFYvSVvC79OLk4lEruKOocz3g4g+Tp9QwaTmzMXX/mUBkFkNvGUGXn0MMS5UMxFsWbC1O01z0JEM3rXqqntRJvQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-08_15:12:05', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T15:39:54.587 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T15:39:54.590 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T15:39:54.635 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T15:39:54.645 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T15:39:54.700 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:54.700 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T15:39:54.726 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T15:39:54.726 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2023-10-08T15:39:54.782 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T15:39:54.783 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:39:54.783 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 219718 Links: 1 2023-10-08T15:39:54.783 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:39:54.783 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T15:39:54.783 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-08 15:39:47.559932716 +0000 2023-10-08T15:39:54.783 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-08 15:37:09.180320898 +0000 2023-10-08T15:39:54.783 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-08 15:37:09.180320898 +0000 2023-10-08T15:39:54.783 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-08T15:39:54.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T15:39:54.847 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-08T15:39:54.848 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-08T15:39:54.848 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000119354 s, 4.3 MB/s 2023-10-08T15:39:54.849 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T15:39:54.906 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2023-10-08T15:39:54.962 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T15:39:54.962 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:39:54.963 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 225309 Links: 1 2023-10-08T15:39:54.963 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:39:54.963 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T15:39:54.963 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-08 15:39:47.560932700 +0000 2023-10-08T15:39:54.963 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-08 15:37:09.700312577 +0000 2023-10-08T15:39:54.963 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-08 15:37:09.700312577 +0000 2023-10-08T15:39:54.963 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-08T15:39:54.964 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T15:39:55.026 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-08T15:39:55.026 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-08T15:39:55.026 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000116897 s, 4.4 MB/s 2023-10-08T15:39:55.027 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T15:39:55.083 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2023-10-08T15:39:55.138 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T15:39:55.139 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:39:55.139 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 223533 Links: 1 2023-10-08T15:39:55.139 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:39:55.139 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T15:39:55.139 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-08 15:39:47.560932700 +0000 2023-10-08T15:39:55.139 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-08 15:37:10.209304431 +0000 2023-10-08T15:39:55.139 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-08 15:37:10.209304431 +0000 2023-10-08T15:39:55.139 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-08T15:39:55.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T15:39:55.203 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-08T15:39:55.203 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-08T15:39:55.203 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000108616 s, 4.7 MB/s 2023-10-08T15:39:55.205 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T15:39:55.261 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2023-10-08T15:39:55.316 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T15:39:55.317 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:39:55.317 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 219785 Links: 1 2023-10-08T15:39:55.317 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:39:55.317 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T15:39:55.317 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-08 15:39:47.560932700 +0000 2023-10-08T15:39:55.317 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-08 15:37:10.727296143 +0000 2023-10-08T15:39:55.317 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-08 15:37:10.727296143 +0000 2023-10-08T15:39:55.317 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-08T15:39:55.318 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T15:39:55.381 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-08T15:39:55.381 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-08T15:39:55.381 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.0001025 s, 5.0 MB/s 2023-10-08T15:39:55.382 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T15:39:55.438 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:39:55.438 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:39:55.439 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T15:39:55.455 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T15:39:55.455 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2023-10-08T15:39:55.511 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T15:39:55.512 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:39:55.512 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 222265 Links: 1 2023-10-08T15:39:55.512 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:39:55.512 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T15:39:55.512 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-08 15:39:35.054608931 +0000 2023-10-08T15:39:55.512 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-08 15:36:40.824251427 +0000 2023-10-08T15:39:55.512 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-08 15:36:40.824251427 +0000 2023-10-08T15:39:55.512 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-08T15:39:55.512 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T15:39:55.577 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-08T15:39:55.577 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-08T15:39:55.577 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000255245 s, 2.0 MB/s 2023-10-08T15:39:55.578 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T15:39:55.635 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2023-10-08T15:39:55.691 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T15:39:55.691 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:39:55.691 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 211657 Links: 1 2023-10-08T15:39:55.691 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:39:55.691 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T15:39:55.692 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-08 15:39:35.055608904 +0000 2023-10-08T15:39:55.692 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-08 15:36:41.315238474 +0000 2023-10-08T15:39:55.692 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-08 15:36:41.315238474 +0000 2023-10-08T15:39:55.692 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-08T15:39:55.692 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T15:39:55.755 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-08T15:39:55.755 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-08T15:39:55.755 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.00023528 s, 2.2 MB/s 2023-10-08T15:39:55.756 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T15:39:55.813 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2023-10-08T15:39:55.868 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T15:39:55.868 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:39:55.869 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 222387 Links: 1 2023-10-08T15:39:55.869 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:39:55.869 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T15:39:55.869 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-08 15:39:35.055608904 +0000 2023-10-08T15:39:55.869 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-08 15:36:41.808225468 +0000 2023-10-08T15:39:55.869 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-08 15:36:41.808225468 +0000 2023-10-08T15:39:55.869 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-08T15:39:55.869 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T15:39:55.931 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-08T15:39:55.931 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-08T15:39:55.931 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000187317 s, 2.7 MB/s 2023-10-08T15:39:55.932 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T15:39:55.988 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2023-10-08T15:39:56.043 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T15:39:56.043 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T15:39:56.043 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 217993 Links: 1 2023-10-08T15:39:56.043 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T15:39:56.043 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T15:39:56.043 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-08 15:39:35.055608904 +0000 2023-10-08T15:39:56.044 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-08 15:36:42.300212489 +0000 2023-10-08T15:39:56.044 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-08 15:36:42.300212489 +0000 2023-10-08T15:39:56.044 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2023-10-08T15:39:56.044 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T15:39:56.105 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-08T15:39:56.105 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-08T15:39:56.105 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000251824 s, 2.0 MB/s 2023-10-08T15:39:56.106 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T15:39:56.161 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:39:56.161 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T15:39:56.161 INFO:tasks.ceph:Generating config... 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client] debug client = 20 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client] debug ms = 1 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client] pid file = 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-08T15:39:56.163 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-08T15:39:56.164 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-08T15:39:56.164 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T15:39:56.164 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T15:39:56.165 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T15:39:56.165 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T15:39:56.165 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T15:39:56.165 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-08T15:39:56.165 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-08T15:39:56.165 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-08T15:39:56.165 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-08T15:39:56.165 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T15:39:56.165 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T15:39:56.165 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T15:39:56.165 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-08T15:39:56.166 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-08T15:39:56.167 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-08T15:39:56.167 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-08T15:39:56.167 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T15:39:56.167 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T15:39:56.239 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T15:39:56.242 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T15:39:56.285 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:39:56.352 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '172.21.15.183'), ('mon.c', '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]')] 2023-10-08T15:39:56.352 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-08T15:39:56.353 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:56.353 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T15:39:56.408 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --add b 172.21.15.183 --addv c '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:39:56.496 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:39:56.496 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid aa16b01f-3858-4fc7-9751-d7cb76fff138 2023-10-08T15:39:56.496 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = octopus 2023-10-08T15:39:56.496 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2023-10-08T15:39:56.496 INFO:teuthology.orchestra.run.smithi029.stdout:fsid aa16b01f-3858-4fc7-9751-d7cb76fff138 2023-10-08T15:39:56.497 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2023-10-08T15:39:56.496296+0000 2023-10-08T15:39:56.497 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-10-08T15:39:56.496296+0000 2023-10-08T15:39:56.497 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 15 (octopus) 2023-10-08T15:39:56.497 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2023-10-08T15:39:56.497 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2023-10-08T15:39:56.497 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2023-10-08T15:39:56.497 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] mon.c 2023-10-08T15:39:56.497 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T15:39:56.499 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T15:39:56.514 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aa16b01f-3858-4fc7-9751-d7cb76fff138... 2023-10-08T15:39:56.515 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T15:39:56.557 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.599 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.600 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-10-08T15:39:56.601 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.29,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on skipped message = False 2023-10-08T15:39:56.602 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = aa16b01f-3858-4fc7-9751-d7cb76fff138 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.603 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-10-08T15:39:56.604 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: bdev async discard = True 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: bdev enable discard = True 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore allocator = bitmap 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1/20 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1/20 2023-10-08T15:39:56.605 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 4/10 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: memstore device bytes = 200000000 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 1.0 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: osd mon report interval = 5 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = memstore 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.606 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-10-08T15:39:56.607 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.608 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: mon op complaint time = 120 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull ratio = 0.6 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.7 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.6 2023-10-08T15:39:56.609 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: client mount timeout = 600 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = "" 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-10-08T15:39:56.610 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout: debug objectcacher = 20 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout: debug objecter = 20 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout:[client.1] 2023-10-08T15:39:56.611 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: debug objectcacher = 20 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: debug objecter = 20 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout:[mds] 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds = 20 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug frag = True 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug scatterstat = True 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: mds op complaint time = 180 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: mds verify scatter = True 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-10-08T15:39:56.612 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-10-08T15:39:56.614 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-10-08T15:39:56.614 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2023-10-08T15:39:56.614 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T15:39:56.614 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2023-10-08T15:39:56.614 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.614 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2023-10-08T15:39:56.614 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.614 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T15:39:56.615 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T15:39:56.616 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-10-08T15:39:56.617 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on skipped message = False 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = aa16b01f-3858-4fc7-9751-d7cb76fff138 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2023-10-08T15:39:56.618 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.619 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2023-10-08T15:39:56.620 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: memstore device bytes = 200000000 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 1.0 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: osd mon report interval = 5 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = memstore 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-08T15:39:56.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T15:39:56.622 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T15:39:56.623 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull ratio = 0.6 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.7 2023-10-08T15:39:56.624 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.6 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = "" 2023-10-08T15:39:56.625 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout: debug objectcacher = 20 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout: debug objecter = 20 2023-10-08T15:39:56.626 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: debug objectcacher = 20 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: debug objecter = 20 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-08T15:39:56.627 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-08T15:39:56.628 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-08T15:39:56.628 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T15:39:56.628 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T15:39:56.707 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T15:39:56.707 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:56.707 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T15:39:56.722 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:56.722 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T15:39:56.777 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:39:56.777 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:56.777 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T15:39:56.777 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:39:56.853 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:39:56.853 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:39:56.908 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:39:56.909 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:39:56.909 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T15:39:56.909 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T15:39:56.943 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:39:56.943 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:39:56.998 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T15:39:56.998 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T15:39:56.998 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T15:39:57.048 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T15:39:57.050 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T15:39:57.105 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T15:39:57.107 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T15:39:57.108 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T15:39:57.158 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T15:39:57.160 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T15:39:57.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T15:39:57.274 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T15:39:57.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-08T15:39:57.301 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T15:39:57.349 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T15:39:57.351 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T15:39:57.375 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T15:39:57.464 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T15:39:57.466 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-08T15:39:57.489 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T15:39:57.490 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T15:39:57.529 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T15:39:57.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-08T15:39:57.621 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-08T15:39:57.634 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-08T15:39:57.672 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-08T15:39:57.684 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-08T15:39:57.762 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-08T15:39:57.774 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T15:39:57.775 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T15:39:57.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T15:39:57.800 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:39:57.800 INFO:tasks.ceph:role: osd.0 2023-10-08T15:39:57.800 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:39:57.801 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:39:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:39:57.866 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:39:57.887 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-08T15:39:57.889 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-08T15:39:57.889 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T15:39:57.967 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T15:39:58.037 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T15:39:58.103 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:39:58.103 INFO:tasks.ceph:role: osd.1 2023-10-08T15:39:58.103 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:39:58.103 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T15:39:58.167 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:39:58.167 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:39:58.168 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:39:58.168 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-08T15:39:58.168 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:39:58.168 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:39:58.168 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:39:58.168 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:39:58.168 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:39:58.168 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:39:58.190 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-08T15:39:58.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-08T15:39:58.192 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T15:39:58.270 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T15:39:58.339 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T15:39:58.404 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:39:58.405 INFO:tasks.ceph:role: osd.2 2023-10-08T15:39:58.405 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:39:58.405 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:39:58.469 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:39:58.470 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:39:58.491 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-08T15:39:58.493 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-08T15:39:58.493 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T15:39:58.571 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T15:39:58.640 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T15:39:58.705 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T15:39:58.706 INFO:tasks.ceph:role: osd.3 2023-10-08T15:39:58.706 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:39:58.706 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T15:39:58.771 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:39:58.771 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:39:58.771 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:39:58.772 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-08T15:39:58.772 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:39:58.772 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:39:58.772 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:39:58.772 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:39:58.772 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:39:58.773 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:39:58.793 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-08T15:39:58.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-08T15:39:58.795 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T15:39:58.872 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T15:39:58.942 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:39:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.189+0000 7ff6744ed540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T15:39:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.189+0000 7ff6744ed540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T15:39:59.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.189+0000 7ff6744ed540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-08T15:39:59.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T15:39:59.223 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:39:59.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.305+0000 7f3e17f25540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T15:39:59.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.305+0000 7f3e17f25540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T15:39:59.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.305+0000 7f3e17f25540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-08T15:39:59.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T15:39:59.377 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:39:59.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.458+0000 7f31229a3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T15:39:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.458+0000 7f31229a3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T15:39:59.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.458+0000 7f31229a3540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-08T15:39:59.464 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T15:39:59.529 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:39:59.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.611+0000 7fb75dc57540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T15:39:59.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.611+0000 7fb75dc57540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T15:39:59.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:39:59.612+0000 7fb75dc57540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-08T15:39:59.617 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T15:39:59.683 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T15:39:59.710 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:39:59.710 INFO:tasks.ceph:role: osd.4 2023-10-08T15:39:59.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:39:59.710 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T15:39:59.784 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:39:59.784 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:39:59.784 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:39:59.784 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2023-10-08T15:39:59.784 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:39:59.784 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:39:59.785 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:39:59.785 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:39:59.785 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:39:59.785 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:40:00.218 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-08T15:40:00.220 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-08T15:40:00.220 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T15:40:00.397 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T15:40:00.430 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T15:40:00.496 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:40:00.496 INFO:tasks.ceph:role: osd.5 2023-10-08T15:40:00.496 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:40:00.496 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T15:40:00.568 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:40:00.568 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:40:00.568 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:40:00.568 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2023-10-08T15:40:00.569 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:40:00.569 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:40:00.569 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:40:00.569 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:40:00.569 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:40:00.569 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:40:00.989 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-08T15:40:00.991 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-08T15:40:00.991 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T15:40:01.094 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T15:40:01.123 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T15:40:01.187 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:40:01.187 INFO:tasks.ceph:role: osd.6 2023-10-08T15:40:01.188 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:40:01.188 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T15:40:01.259 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:40:01.260 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:40:01.703 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-08T15:40:01.705 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-08T15:40:01.705 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T15:40:01.850 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T15:40:01.881 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T15:40:01.946 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T15:40:01.946 INFO:tasks.ceph:role: osd.7 2023-10-08T15:40:01.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:40:01.947 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T15:40:02.018 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T15:40:02.018 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T15:40:02.018 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T15:40:02.018 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2023-10-08T15:40:02.018 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T15:40:02.018 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-08T15:40:02.018 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T15:40:02.019 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T15:40:02.019 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T15:40:02.019 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T15:40:02.453 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-08T15:40:02.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-08T15:40:02.455 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T15:40:02.639 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T15:40:02.670 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:40:02.844 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:02.843+0000 7f34ebd9f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T15:40:02.844 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:02.843+0000 7f34ebd9f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T15:40:02.845 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:02.843+0000 7f34ebd9f540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-08T15:40:02.854 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T15:40:02.878 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:40:02.959 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:02.957+0000 7f054595a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T15:40:02.959 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:02.957+0000 7f054595a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T15:40:02.959 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:02.958+0000 7f054595a540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-08T15:40:02.965 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T15:40:03.030 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:03.108+0000 7fda1bec5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:03.109+0000 7fda1bec5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T15:40:03.110 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:03.109+0000 7fda1bec5540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-08T15:40:03.119 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T15:40:03.183 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:40:03.263 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:03.262+0000 7faf3a377540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T15:40:03.264 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:03.262+0000 7faf3a377540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T15:40:03.264 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:03.263+0000 7faf3a377540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-08T15:40:03.269 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T15:40:03.334 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T15:40:03.335 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:03.335 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T15:40:03.366 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:03.367 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T15:40:03.435 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:03.435 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-08T15:40:03.502 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:03.502 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T15:40:03.569 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:03.569 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T15:40:03.635 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:03.636 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T15:40:03.701 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:03.701 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T15:40:03.766 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:03.766 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T15:40:03.790 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:03.791 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T15:40:03.854 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:03.854 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-08T15:40:03.918 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:03.918 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T15:40:03.982 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:03.982 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T15:40:04.046 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:04.046 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T15:40:04.111 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:04.111 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T15:40:04.175 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:04.176 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T15:40:04.192 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:04.192 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-08T15:40:04.248 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:04.248 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-08T15:40:04.262 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:04.263 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-08T15:40:04.316 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T15:40:04.316 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T15:40:04.318 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T15:40:04.359 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2023-10-08T15:40:04.359 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJlAiPhAhAAP7NTLjG1tB3zd69Xz9z/Dw== 2023-10-08T15:40:04.359 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-08T15:40:04.359 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJlYRZwCRAAGoAPqAnl5NDkgFSuSAb0dQ== 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJl2PBqEBAAFdiMT6RrjHdj7SRjAbP4sQ== 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBPzSJlbwxYCxAAi9e56N5uN63J7J+CFrotmQ== 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBPzSJlrFhCEhAAkg2cwfL0v9izcWZW8IkKvA== 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBPzSJlb/xdGxAAXhOqn1ZfBDqVNynmIESgsQ== 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBPzSJlmaSCJBAAD0mbJDLpY+XnpBfW+PxKwg== 2023-10-08T15:40:04.360 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJlvI5NBhAAgIljkxa68BKP6MhsV8a5kA== 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJlXJDaFBAAC2AbAwL8n7M+sYYTc2TPsw== 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJlsZmxGxAA36NsIsK3XcPqbAnnT92G0Q== 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBSzSJlostbMhAADG+AgRpi1nAPh9OYWKfmXg== 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBSzSJlEG4vORAA0iGg702OP3gHtLsYax/jeg== 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBTzSJlshaZBhAAe3VfHlxRqfigbN61EJnizg== 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2023-10-08T15:40:04.361 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBTzSJlvFS/DxAAOFmLFOOLsMk+glMEkwb+0A== 2023-10-08T15:40:04.362 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2023-10-08T15:40:04.362 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJl89iQHxAA+CyqKmHWtMkmRiZd82Bm+A== 2023-10-08T15:40:04.362 INFO:teuthology.orchestra.run.smithi029.stdout:[client.2] 2023-10-08T15:40:04.362 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJlyMQQJRAA4Wz0XqtCvc38O4gm+T+Ipw== 2023-10-08T15:40:04.362 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2023-10-08T15:40:04.362 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJlldcVKBAAZKujKb3x/HYn/QzJ0/iUGA== 2023-10-08T15:40:04.362 INFO:teuthology.orchestra.run.smithi029.stdout:[client.3] 2023-10-08T15:40:04.362 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQBNzSJl5494LRAAMVyV+XR9M7FmtYcUMmZNSA== 2023-10-08T15:40:04.379 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.y] 2023-10-08T15:40:04.379 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJlAiPhAhAAP7NTLjG1tB3zd69Xz9z/Dw== 2023-10-08T15:40:04.379 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-10-08T15:40:04.379 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJlYRZwCRAAGoAPqAnl5NDkgFSuSAb0dQ== 2023-10-08T15:40:04.379 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-10-08T15:40:04.379 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJl2PBqEBAAFdiMT6RrjHdj7SRjAbP4sQ== 2023-10-08T15:40:04.379 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBPzSJlbwxYCxAAi9e56N5uN63J7J+CFrotmQ== 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBPzSJlrFhCEhAAkg2cwfL0v9izcWZW8IkKvA== 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBPzSJlb/xdGxAAXhOqn1ZfBDqVNynmIESgsQ== 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.3] 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBPzSJlmaSCJBAAD0mbJDLpY+XnpBfW+PxKwg== 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJlvI5NBhAAgIljkxa68BKP6MhsV8a5kA== 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJlXJDaFBAAC2AbAwL8n7M+sYYTc2TPsw== 2023-10-08T15:40:04.380 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJlsZmxGxAA36NsIsK3XcPqbAnnT92G0Q== 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.4] 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBSzSJlostbMhAADG+AgRpi1nAPh9OYWKfmXg== 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.5] 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBSzSJlEG4vORAA0iGg702OP3gHtLsYax/jeg== 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.6] 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBTzSJlshaZBhAAe3VfHlxRqfigbN61EJnizg== 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.7] 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBTzSJlvFS/DxAAOFmLFOOLsMk+glMEkwb+0A== 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJl89iQHxAA+CyqKmHWtMkmRiZd82Bm+A== 2023-10-08T15:40:04.381 INFO:teuthology.orchestra.run.smithi183.stdout:[client.2] 2023-10-08T15:40:04.382 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJlyMQQJRAA4Wz0XqtCvc38O4gm+T+Ipw== 2023-10-08T15:40:04.382 INFO:teuthology.orchestra.run.smithi183.stdout:[client.1] 2023-10-08T15:40:04.382 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJlldcVKBAAZKujKb3x/HYn/QzJ0/iUGA== 2023-10-08T15:40:04.382 INFO:teuthology.orchestra.run.smithi183.stdout:[client.3] 2023-10-08T15:40:04.382 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBNzSJl5494LRAAMVyV+XR9M7FmtYcUMmZNSA== 2023-10-08T15:40:04.383 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T15:40:04.405 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T15:40:04.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:40:04.472 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:40:04.522 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:40:04.525 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:40:04.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.576 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.624 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.626 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.676 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.723 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.725 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.772 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T15:40:04.774 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T15:40:04.821 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:40:04.823 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:40:04.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:40:04.875 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T15:40:04.925 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.927 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.975 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:04.978 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:05.025 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:05.206 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:05.255 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:05.268 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T15:40:05.316 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:40:05.319 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:40:05.442 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:40:05.444 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:40:05.511 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:40:05.513 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:40:05.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:40:05.691 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T15:40:05.836 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T15:40:05.837 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T15:40:05.862 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T15:40:05.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T15:40:05.979 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T15:40:06.003 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T15:40:06.095 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T15:40:06.118 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T15:40:06.182 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T15:40:06.275 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T15:40:06.300 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:40:06.303 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T15:40:06.354 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T15:40:06.355 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T15:40:06.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T15:40:06.359 INFO:tasks.ceph.mon.a:Started 2023-10-08T15:40:06.360 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T15:40:06.360 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T15:40:06.396 INFO:tasks.ceph.mon.b:Started 2023-10-08T15:40:06.397 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T15:40:06.397 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T15:40:06.399 INFO:tasks.ceph.mon.c:Started 2023-10-08T15:40:06.399 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T15:40:06.399 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T15:40:06.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T15:40:06.401 INFO:tasks.ceph.mgr.y:Started 2023-10-08T15:40:06.401 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T15:40:06.401 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T15:40:06.403 INFO:tasks.ceph.mgr.x:Started 2023-10-08T15:40:06.403 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T15:40:06.403 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T15:40:06.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.528+0000 7f27555c3700 1 Processor -- start 2023-10-08T15:40:06.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.528+0000 7f27555c3700 1 -- start start 2023-10-08T15:40:06.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f27555c3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 0x7f27501577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f27555c3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f27500c9710 0x7f2750157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f27555c3700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2750158220 con 0x7f27500c9340 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f27555c3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27500cb320 con 0x7f275015b960 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f27555c3700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27500b0300 con 0x7f27500c9710 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f274e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 0x7f27501577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f274e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 0x7f27501577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40620/0 (socket says 172.21.15.29:40620) 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f274e7fc700 1 -- 172.21.15.29:0/795600305 learned_addr learned my addr 172.21.15.29:0/795600305 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f274f7fe700 1 --2- 172.21.15.29:0/795600305 >> v2:172.21.15.183:3300/0 conn(0x7f27500c9710 0x7f2750157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f274e7fc700 1 -- 172.21.15.29:0/795600305 >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 msgr2=0x7f27501577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f274e7fc700 1 -- 172.21.15.29:0/795600305 >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 msgr2=0x7f27501577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T15:40:06.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.529+0000 7f274e7fc700 1 --2- 172.21.15.29:0/795600305 >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 0x7f27501577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T15:40:06.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.530+0000 7f274e7fc700 1 --2- 172.21.15.29:0/795600305 >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 0x7f27501577a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T15:40:06.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.530+0000 7f274f7fe700 1 -- 172.21.15.29:0/795600305 >> v2:172.21.15.183:3300/0 conn(0x7f27500c9710 msgr2=0x7f2750157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T15:40:06.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.530+0000 7f274f7fe700 1 -- 172.21.15.29:0/795600305 >> v2:172.21.15.183:3300/0 conn(0x7f27500c9710 msgr2=0x7f2750157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T15:40:06.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.530+0000 7f274f7fe700 1 --2- 172.21.15.29:0/795600305 >> v2:172.21.15.183:3300/0 conn(0x7f27500c9710 0x7f2750157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T15:40:06.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.530+0000 7f274f7fe700 1 --2- 172.21.15.29:0/795600305 >> v2:172.21.15.183:3300/0 conn(0x7f27500c9710 0x7f2750157ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525865356 0 0) 0x7f2750158220 con 0x7f27500c9340 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2738003570 con 0x7f27500c9340 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2776753980 0 0) 0x7f2738003570 con 0x7f27500c9340 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 >> v2:172.21.15.183:3300/0 conn(0x7f27500c9710 msgr2=0x7f2750157ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 --2- 172.21.15.29:0/795600305 >> v2:172.21.15.183:3300/0 conn(0x7f27500c9710 0x7f2750157ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 msgr2=0x7f27501577a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 --2- 172.21.15.29:0/795600305 >> v2:172.21.15.29:3300/0 conn(0x7f275015b960 0x7f27501577a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500b05e0 con 0x7f27500c9340 2023-10-08T15:40:06.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f2740001470 con 0x7f27500c9340 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 >> v1:172.21.15.183:6789/0 conn(0x7f27500c9340 legacy=0x7f27500afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f2738003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2738004810 0x7f2738004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27380051c0 0x7f273800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500cb320 con 0x7f2738003a60 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500b0300 con 0x7f2738004810 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273800c130 con 0x7f27380051c0 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274effd700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f2738003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.712+0000 7f274f7fe700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27380051c0 0x7f273800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274e7fc700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2738004810 0x7f2738004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274effd700 1 -- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27380051c0 msgr2=0x7f273800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274effd700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27380051c0 0x7f273800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274effd700 1 -- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2738004810 msgr2=0x7f2738004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274effd700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2738004810 0x7f2738004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274effd700 1 -- 172.21.15.29:0/795600305 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738003570 con 0x7f2738003a60 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274f7fe700 1 -- 172.21.15.29:0/795600305 reap_dead start 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274e7fc700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2738004810 0x7f2738004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274effd700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f2738003e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f274000c250 tx=0x7f2740007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2359c37d26fc20b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740007b00 con 0x7f2738003a60 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274000cb00 con 0x7f2738003a60 2023-10-08T15:40:06.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.713+0000 7f274dffb700 1 -- 172.21.15.29:0/795600305 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000cea0 con 0x7f2738003a60 2023-10-08T15:40:06.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.714+0000 7f27555c3700 1 -- 172.21.15.29:0/795600305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 msgr2=0x7f2738003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.714+0000 7f27555c3700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f2738003e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f274000c250 tx=0x7f2740007830 comp rx=0 tx=0).stop 2023-10-08T15:40:06.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.714+0000 7f27555c3700 1 -- 172.21.15.29:0/795600305 shutdown_connections 2023-10-08T15:40:06.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.714+0000 7f27555c3700 1 --2- 172.21.15.29:0/795600305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f2738003e70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.714+0000 7f27555c3700 1 -- 172.21.15.29:0/795600305 >> 172.21.15.29:0/795600305 conn(0x7f2750069870 msgr2=0x7f2750069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:06.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.714+0000 7f27555c3700 1 -- 172.21.15.29:0/795600305 shutdown_connections 2023-10-08T15:40:06.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.714+0000 7f27555c3700 1 -- 172.21.15.29:0/795600305 wait complete. 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.716+0000 7f27555c3700 1 Processor -- start 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.716+0000 7f27555c3700 1 -- start start 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f27555c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f27501532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f27555c3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27500c7240 0x7f27500c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f27555c3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f275016f0f0 0x7f2750153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f27555c3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750153830 con 0x7f2738003a60 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f27555c3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500c2c70 con 0x7f27500c7240 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f27555c3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27500c2f50 con 0x7f275016f0f0 2023-10-08T15:40:06.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f27501532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f27501532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40650/0 (socket says 172.21.15.29:40650) 2023-10-08T15:40:06.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 -- 172.21.15.29:0/4241543316 learned_addr learned my addr 172.21.15.29:0/4241543316 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:06.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274f7fe700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f275016f0f0 0x7f2750153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274e7fc700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27500c7240 0x7f27500c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:06.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 -- 172.21.15.29:0/4241543316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f275016f0f0 msgr2=0x7f2750153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f275016f0f0 0x7f2750153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 -- 172.21.15.29:0/4241543316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27500c7240 msgr2=0x7f27500c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27500c7240 0x7f27500c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 -- 172.21.15.29:0/4241543316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500c3230 con 0x7f2738003a60 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.717+0000 7f274effd700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f27501532f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f274000c840 tx=0x7f2740017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.718+0000 7f2736ffd700 1 -- 172.21.15.29:0/4241543316 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740006820 con 0x7f2738003a60 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.718+0000 7f2736ffd700 1 -- 172.21.15.29:0/4241543316 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740021070 con 0x7f2738003a60 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.718+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27500c5c00 con 0x7f2738003a60 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.718+0000 7f2736ffd700 1 -- 172.21.15.29:0/4241543316 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740006bf0 con 0x7f2738003a60 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.718+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27500c3510 con 0x7f2738003a60 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.718+0000 7f2736ffd700 1 -- 172.21.15.29:0/4241543316 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2740023030 con 0x7f2738003a60 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.718+0000 7f2736ffd700 1 -- 172.21.15.29:0/4241543316 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2740007740 con 0x7f2738003a60 2023-10-08T15:40:06.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.719+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27500c5e20 con 0x7f2738003a60 2023-10-08T15:40:06.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.722+0000 7f2736ffd700 1 -- 172.21.15.29:0/4241543316 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2740007250 con 0x7f2738003a60 2023-10-08T15:40:06.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.798+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f275004c3c0 con 0x7f2738003a60 2023-10-08T15:40:06.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.801+0000 7f2736ffd700 1 -- 172.21.15.29:0/4241543316 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2740012680 con 0x7f2738003a60 2023-10-08T15:40:06.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 msgr2=0x7f27501532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:06.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f27501532f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f274000c840 tx=0x7f2740017000 comp rx=0 tx=0).stop 2023-10-08T15:40:06.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 shutdown_connections 2023-10-08T15:40:06.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f275016f0f0 0x7f2750153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2738003a60 0x7f27501532f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 --2- 172.21.15.29:0/4241543316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27500c7240 0x7f27500c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:06.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 >> 172.21.15.29:0/4241543316 conn(0x7f2750069870 msgr2=0x7f2750063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:06.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 shutdown_connections 2023-10-08T15:40:06.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:06.802+0000 7f27555c3700 1 -- 172.21.15.29:0/4241543316 wait complete. 2023-10-08T15:40:06.804 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2023-10-08T15:40:06.814 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T15:40:06.815 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:06.815 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T15:40:06.875 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:06.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T15:40:06.942 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:06.942 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T15:40:07.007 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:40:07.007 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T15:40:07.072 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:07.073 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T15:40:07.097 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:07.098 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T15:40:07.162 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:07.162 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T15:40:07.226 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-08T15:40:07.226 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T15:40:07.290 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-08T15:40:07.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.446+0000 7fc0381a2700 1 Processor -- start 2023-10-08T15:40:07.447 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.447+0000 7fc0381a2700 1 -- start start 2023-10-08T15:40:07.449 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.447+0000 7fc0381a2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc030159c30 0x7fc0300711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.449 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.447+0000 7fc0381a2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc03006ca90 0x7fc03006f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.447+0000 7fc0381a2700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc030070d30 con 0x7fc03006ecc0 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.447+0000 7fc0381a2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc030070700 con 0x7fc03006ca90 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.447+0000 7fc0381a2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03006f710 con 0x7fc030159c30 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc035f3e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc030159c30 0x7fc0300711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc035f3e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc030159c30 0x7fc0300711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50590/0 (socket says 172.21.15.183:50590) 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc035f3e700 1 -- 172.21.15.183:0/3778901412 learned_addr learned my addr 172.21.15.183:0/3778901412 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc03673f700 1 --2- 172.21.15.183:0/3778901412 >> v2:172.21.15.29:3300/0 conn(0x7fc03006ca90 0x7fc03006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc035f3e700 1 -- 172.21.15.183:0/3778901412 >> v2:172.21.15.29:3300/0 conn(0x7fc03006ca90 msgr2=0x7fc03006f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc035f3e700 1 --2- 172.21.15.183:0/3778901412 >> v2:172.21.15.29:3300/0 conn(0x7fc03006ca90 0x7fc03006f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.450 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc035f3e700 1 -- 172.21.15.183:0/3778901412 >> v1:172.21.15.183:6789/0 conn(0x7fc03006ecc0 legacy=0x7fc03006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc035f3e700 1 -- 172.21.15.183:0/3778901412 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03006f9f0 con 0x7fc030159c30 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc035f3e700 1 --2- 172.21.15.183:0/3778901412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc030159c30 0x7fc0300711c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc03006cf50 tx=0x7fc02c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c8070ec9711971 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc034f3c700 1 -- 172.21.15.183:0/3778901412 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00b860 con 0x7fc030159c30 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc034f3c700 1 -- 172.21.15.183:0/3778901412 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c00b9c0 con 0x7fc030159c30 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.448+0000 7fc034f3c700 1 -- 172.21.15.183:0/3778901412 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00bd60 con 0x7fc030159c30 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.449+0000 7fc0381a2700 1 -- 172.21.15.183:0/3778901412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc030159c30 msgr2=0x7fc0300711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.449+0000 7fc0381a2700 1 --2- 172.21.15.183:0/3778901412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc030159c30 0x7fc0300711c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc03006cf50 tx=0x7fc02c009250 comp rx=0 tx=0).stop 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.449+0000 7fc0381a2700 1 -- 172.21.15.183:0/3778901412 shutdown_connections 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.449+0000 7fc0381a2700 1 --2- 172.21.15.183:0/3778901412 >> v2:172.21.15.29:3300/0 conn(0x7fc03006ca90 0x7fc03006f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.449+0000 7fc0381a2700 1 --2- 172.21.15.183:0/3778901412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc030159c30 0x7fc0300711c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.449+0000 7fc0381a2700 1 -- 172.21.15.183:0/3778901412 >> 172.21.15.183:0/3778901412 conn(0x7fc0300cb030 msgr2=0x7fc03006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.449+0000 7fc0381a2700 1 -- 172.21.15.183:0/3778901412 shutdown_connections 2023-10-08T15:40:07.451 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.449+0000 7fc0381a2700 1 -- 172.21.15.183:0/3778901412 wait complete. 2023-10-08T15:40:07.453 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.450+0000 7fc0381a2700 1 Processor -- start 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.450+0000 7fc0381a2700 1 -- start start 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc0381a2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc03006ca90 0x7fc0300c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc0381a2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc03006ecc0 0x7fc0301532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc0381a2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030159c30 0x7fc0300c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc0381a2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300c79c0 con 0x7fc030159c30 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc0381a2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300c4ba0 con 0x7fc03006ca90 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc0381a2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300c4e80 con 0x7fc03006ecc0 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc03006ca90 0x7fc0300c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc03006ca90 0x7fc0300c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50604/0 (socket says 172.21.15.183:50604) 2023-10-08T15:40:07.454 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 -- 172.21.15.183:0/3319645687 learned_addr learned my addr 172.21.15.183:0/3319645687 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc03573d700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc03006ecc0 0x7fc0301532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc03673f700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030159c30 0x7fc0300c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 -- 172.21.15.183:0/3319645687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc03006ecc0 msgr2=0x7fc0301532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc03006ecc0 0x7fc0301532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 -- 172.21.15.183:0/3319645687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030159c30 msgr2=0x7fc0300c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030159c30 0x7fc0300c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 -- 172.21.15.183:0/3319645687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c0094f0 con 0x7fc03006ca90 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc035f3e700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc03006ca90 0x7fc0300c5c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc03006f850 tx=0x7fc02c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc021ffb700 1 -- 172.21.15.183:0/3319645687 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c026450 con 0x7fc03006ca90 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc021ffb700 1 -- 172.21.15.183:0/3319645687 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c0265b0 con 0x7fc03006ca90 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0300c5160 con 0x7fc03006ca90 2023-10-08T15:40:07.455 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.451+0000 7fc021ffb700 1 -- 172.21.15.183:0/3319645687 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c026970 con 0x7fc03006ca90 2023-10-08T15:40:07.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.452+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0300c5720 con 0x7fc03006ca90 2023-10-08T15:40:07.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.452+0000 7fc021ffb700 1 -- 172.21.15.183:0/3319645687 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc02c01a420 con 0x7fc03006ca90 2023-10-08T15:40:07.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.452+0000 7fc021ffb700 1 -- 172.21.15.183:0/3319645687 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc02c030740 con 0x7fc03006ca90 2023-10-08T15:40:07.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.452+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03004c3c0 con 0x7fc03006ca90 2023-10-08T15:40:07.456 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.455+0000 7fc021ffb700 1 -- 172.21.15.183:0/3319645687 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc02c02b020 con 0x7fc03006ca90 2023-10-08T15:40:07.538 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.538+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7fc0300709c0 con 0x7fc03006ca90 2023-10-08T15:40:07.541 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.541+0000 7fc021ffb700 1 -- 172.21.15.183:0/3319645687 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc02c015020 con 0x7fc03006ca90 2023-10-08T15:40:07.541 INFO:teuthology.orchestra.run.smithi183.stdout:0 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc03006ca90 msgr2=0x7fc0300c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc03006ca90 0x7fc0300c5c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc03006f850 tx=0x7fc02c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 shutdown_connections 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc030159c30 0x7fc0300c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc03006ca90 0x7fc0300c5c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 --2- 172.21.15.183:0/3319645687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc03006ecc0 0x7fc0301532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 >> 172.21.15.183:0/3319645687 conn(0x7fc0300cb030 msgr2=0x7fc0301557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 shutdown_connections 2023-10-08T15:40:07.543 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.542+0000 7fc0381a2700 1 -- 172.21.15.183:0/3319645687 wait complete. 2023-10-08T15:40:07.554 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-08T15:40:07.670 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.669+0000 7fd74a412700 1 Processor -- start 2023-10-08T15:40:07.670 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.669+0000 7fd74a412700 1 -- start start 2023-10-08T15:40:07.671 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd74a412700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd74415dcc0 0x7fd74415e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd74a412700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74415e5d0 0x7fd74415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd74a412700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7440cd900 0x7fd7440c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd74a412700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74409af70 con 0x7fd7440cd900 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd74a412700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7440c7830 con 0x7fd74415dcc0 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd74a412700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440c7b10 con 0x7fd74415e5d0 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd7437fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74415e5d0 0x7fd74415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd743fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd74415dcc0 0x7fd74415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd743fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd74415dcc0 0x7fd74415e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50616/0 (socket says 172.21.15.183:50616) 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd743fff700 1 -- 172.21.15.183:0/3838644144 learned_addr learned my addr 172.21.15.183:0/3838644144 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.670+0000 7fd7437fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74415e5d0 0x7fd74415b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37458/0 (socket says 172.21.15.183:37458) 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd7489af700 1 --2- 172.21.15.183:0/3838644144 >> v2:172.21.15.29:3300/0 conn(0x7fd7440cd900 0x7fd7440c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.672 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd7437fe700 1 -- 172.21.15.183:0/3838644144 >> v2:172.21.15.183:3300/0 conn(0x7fd74415dcc0 msgr2=0x7fd74415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd7437fe700 1 --2- 172.21.15.183:0/3838644144 >> v2:172.21.15.183:3300/0 conn(0x7fd74415dcc0 0x7fd74415e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd7437fe700 1 -- 172.21.15.183:0/3838644144 >> v2:172.21.15.29:3300/0 conn(0x7fd7440cd900 msgr2=0x7fd7440c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd7437fe700 1 --2- 172.21.15.183:0/3838644144 >> v2:172.21.15.29:3300/0 conn(0x7fd7440cd900 0x7fd7440c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd7437fe700 1 -- 172.21.15.183:0/3838644144 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7440c7df0 con 0x7fd74415e5d0 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd743fff700 1 --2- 172.21.15.183:0/3838644144 >> v2:172.21.15.183:3300/0 conn(0x7fd74415dcc0 0x7fd74415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd7437fe700 1 --2- 172.21.15.183:0/3838644144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74415e5d0 0x7fd74415b4f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd744068770 tx=0x7fd7340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da2fab467670062c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd742ffd700 1 -- 172.21.15.183:0/3838644144 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734011630 con 0x7fd74415e5d0 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd742ffd700 1 -- 172.21.15.183:0/3838644144 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd734011790 con 0x7fd74415e5d0 2023-10-08T15:40:07.673 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.671+0000 7fd742ffd700 1 -- 172.21.15.183:0/3838644144 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734011b30 con 0x7fd74415e5d0 2023-10-08T15:40:07.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 -- 172.21.15.183:0/3838644144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74415e5d0 msgr2=0x7fd74415b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 --2- 172.21.15.183:0/3838644144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74415e5d0 0x7fd74415b4f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd744068770 tx=0x7fd7340091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 -- 172.21.15.183:0/3838644144 shutdown_connections 2023-10-08T15:40:07.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 --2- 172.21.15.183:0/3838644144 >> v2:172.21.15.29:3300/0 conn(0x7fd7440cd900 0x7fd7440c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.676 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 --2- 172.21.15.183:0/3838644144 >> v2:172.21.15.183:3300/0 conn(0x7fd74415dcc0 0x7fd74415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 --2- 172.21.15.183:0/3838644144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd74415e5d0 0x7fd74415b4f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 -- 172.21.15.183:0/3838644144 >> 172.21.15.183:0/3838644144 conn(0x7fd744068170 msgr2=0x7fd7440cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:07.677 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 -- 172.21.15.183:0/3838644144 shutdown_connections 2023-10-08T15:40:07.679 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.672+0000 7fd74a412700 1 -- 172.21.15.183:0/3838644144 wait complete. 2023-10-08T15:40:07.679 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.673+0000 7fd74a412700 1 Processor -- start 2023-10-08T15:40:07.679 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.673+0000 7fd74a412700 1 -- start start 2023-10-08T15:40:07.679 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd74a412700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7440cd900 0x7fd744156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.679 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd74a412700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74415dcc0 0x7fd744159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.679 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd74a412700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74415e5d0 0x7fd7440affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.679 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd74a412700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74415aff0 con 0x7fd74415dcc0 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd74a412700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440c6570 con 0x7fd74415e5d0 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd74a412700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd744156d60 con 0x7fd7440cd900 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7440cd900 0x7fd744156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7440cd900 0x7fd744156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37474/0 (socket says 172.21.15.183:37474) 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 -- 172.21.15.183:0/2045223830 learned_addr learned my addr 172.21.15.183:0/2045223830 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd7489af700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74415e5d0 0x7fd7440affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd7437fe700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74415dcc0 0x7fd744159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 -- 172.21.15.183:0/2045223830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74415e5d0 msgr2=0x7fd7440affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74415e5d0 0x7fd7440affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 -- 172.21.15.183:0/2045223830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74415dcc0 msgr2=0x7fd744159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74415dcc0 0x7fd744159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 -- 172.21.15.183:0/2045223830 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094f0 con 0x7fd7440cd900 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd743fff700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7440cd900 0x7fd744156820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd73800ec80 tx=0x7fd738009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.674+0000 7fd72bfff700 1 -- 172.21.15.183:0/2045223830 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73800c850 con 0x7fd7440cd900 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.675+0000 7fd72bfff700 1 -- 172.21.15.183:0/2045223830 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73800c9b0 con 0x7fd7440cd900 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.675+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd734009420 con 0x7fd7440cd900 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.675+0000 7fd72bfff700 1 -- 172.21.15.183:0/2045223830 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73800cd50 con 0x7fd7440cd900 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.675+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7440b1fb0 con 0x7fd7440cd900 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.675+0000 7fd72bfff700 1 -- 172.21.15.183:0/2045223830 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd738005c80 con 0x7fd7440cd900 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.675+0000 7fd72bfff700 1 -- 172.21.15.183:0/2045223830 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fd7380063e0 con 0x7fd7440cd900 2023-10-08T15:40:07.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.675+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74404c3c0 con 0x7fd7440cd900 2023-10-08T15:40:07.682 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.679+0000 7fd72bfff700 1 -- 172.21.15.183:0/2045223830 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd738021060 con 0x7fd7440cd900 2023-10-08T15:40:07.762 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.762+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7fd7440c80d0 con 0x7fd7440cd900 2023-10-08T15:40:07.765 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.765+0000 7fd72bfff700 1 -- 172.21.15.183:0/2045223830 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd738017070 con 0x7fd7440cd900 2023-10-08T15:40:07.766 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-10-08T15:40:07.767 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7440cd900 msgr2=0x7fd744156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.767 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7440cd900 0x7fd744156820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd73800ec80 tx=0x7fd738009250 comp rx=0 tx=0).stop 2023-10-08T15:40:07.767 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 shutdown_connections 2023-10-08T15:40:07.767 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd74415e5d0 0x7fd7440affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.767 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7440cd900 0x7fd744156820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.768 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 --2- 172.21.15.183:0/2045223830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74415dcc0 0x7fd744159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.768 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 >> 172.21.15.183:0/2045223830 conn(0x7fd744068170 msgr2=0x7fd7441570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:07.768 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 shutdown_connections 2023-10-08T15:40:07.768 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.766+0000 7fd74a412700 1 -- 172.21.15.183:0/2045223830 wait complete. 2023-10-08T15:40:07.778 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-08T15:40:07.895 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.895+0000 7f5d690be700 1 Processor -- start 2023-10-08T15:40:07.896 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.895+0000 7f5d690be700 1 -- start start 2023-10-08T15:40:07.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d690be700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5d640afeb0 0x7f5d64068840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d690be700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d64068d80 0x7f5d64070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d690be700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640b0280 0x7f5d64070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d690be700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6415b7c0 con 0x7f5d640afeb0 2023-10-08T15:40:07.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d690be700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d64158170 con 0x7f5d64068d80 2023-10-08T15:40:07.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d690be700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6415c5d0 con 0x7f5d640b0280 2023-10-08T15:40:07.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d64068d80 0x7f5d64070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6359e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640b0280 0x7f5d64070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d64068d80 0x7f5d64070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50632/0 (socket says 172.21.15.183:50632) 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 -- 172.21.15.183:0/1744691082 learned_addr learned my addr 172.21.15.183:0/1744691082 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d62d9d700 1 --2- 172.21.15.183:0/1744691082 >> v2:172.21.15.29:3300/0 conn(0x7f5d640afeb0 0x7f5d64068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 -- 172.21.15.183:0/1744691082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640b0280 msgr2=0x7f5d64070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 --2- 172.21.15.183:0/1744691082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640b0280 0x7f5d64070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 -- 172.21.15.183:0/1744691082 >> v2:172.21.15.29:3300/0 conn(0x7f5d640afeb0 msgr2=0x7f5d64068840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 --2- 172.21.15.183:0/1744691082 >> v2:172.21.15.29:3300/0 conn(0x7f5d640afeb0 0x7f5d64068840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 -- 172.21.15.183:0/1744691082 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6415b9c0 con 0x7f5d64068d80 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d62d9d700 1 --2- 172.21.15.183:0/1744691082 >> v2:172.21.15.29:3300/0 conn(0x7f5d640afeb0 0x7f5d64068840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:07.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6359e700 1 --2- 172.21.15.183:0/1744691082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640b0280 0x7f5d64070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.896+0000 7f5d6259c700 1 --2- 172.21.15.183:0/1744691082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d64070700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d640b3af0 tx=0x7f5d54009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d41141fe21de990 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d61d9b700 1 -- 172.21.15.183:0/1744691082 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54009e70 con 0x7f5d64068d80 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d61d9b700 1 -- 172.21.15.183:0/1744691082 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400b860 con 0x7f5d64068d80 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d61d9b700 1 -- 172.21.15.183:0/1744691082 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400bc00 con 0x7f5d64068d80 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 -- 172.21.15.183:0/1744691082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 msgr2=0x7f5d64070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 --2- 172.21.15.183:0/1744691082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d64070700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d640b3af0 tx=0x7f5d54009250 comp rx=0 tx=0).stop 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 -- 172.21.15.183:0/1744691082 shutdown_connections 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 --2- 172.21.15.183:0/1744691082 >> v2:172.21.15.29:3300/0 conn(0x7f5d640afeb0 0x7f5d64068840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 --2- 172.21.15.183:0/1744691082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640b0280 0x7f5d64070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 --2- 172.21.15.183:0/1744691082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d64070700 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 -- 172.21.15.183:0/1744691082 >> 172.21.15.183:0/1744691082 conn(0x7f5d640ca520 msgr2=0x7f5d640ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 -- 172.21.15.183:0/1744691082 shutdown_connections 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.897+0000 7f5d690be700 1 -- 172.21.15.183:0/1744691082 wait complete. 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.898+0000 7f5d690be700 1 Processor -- start 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.898+0000 7f5d690be700 1 -- start start 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d690be700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d641541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d690be700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640afeb0 0x7f5d64156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d690be700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d640b0280 0x7f5d64157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:07.907 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d690be700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640c6860 con 0x7f5d640b0280 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d690be700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640c6b40 con 0x7f5d64068d80 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d690be700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640c6e20 con 0x7f5d640afeb0 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d62d9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d641541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d6259c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640afeb0 0x7f5d64156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d62d9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d641541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50636/0 (socket says 172.21.15.183:50636) 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d6259c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640afeb0 0x7f5d64156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37498/0 (socket says 172.21.15.183:37498) 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d62d9d700 1 -- 172.21.15.183:0/936403975 learned_addr learned my addr 172.21.15.183:0/936403975 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.899+0000 7f5d6359e700 1 --2- 172.21.15.183:0/936403975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d640b0280 0x7f5d64157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d62d9d700 1 -- 172.21.15.183:0/936403975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640afeb0 msgr2=0x7f5d64156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d62d9d700 1 --2- 172.21.15.183:0/936403975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640afeb0 0x7f5d64156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.908 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d62d9d700 1 -- 172.21.15.183:0/936403975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d640b0280 msgr2=0x7f5d64157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d62d9d700 1 --2- 172.21.15.183:0/936403975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d640b0280 0x7f5d64157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d62d9d700 1 -- 172.21.15.183:0/936403975 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c009a20 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d62d9d700 1 --2- 172.21.15.183:0/936403975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d641541e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800e8d0 tx=0x7f5d58008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d4affd700 1 -- 172.21.15.183:0/936403975 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d580093b0 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d4affd700 1 -- 172.21.15.183:0/936403975 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d58013410 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d540094f0 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d4affd700 1 -- 172.21.15.183:0/936403975 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d580137b0 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d640c73e0 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d4affd700 1 -- 172.21.15.183:0/936403975 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5d58013be0 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.900+0000 7f5d4affd700 1 -- 172.21.15.183:0/936403975 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f5d5801bdc0 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.901+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d640c7750 con 0x7f5d64068d80 2023-10-08T15:40:07.909 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.903+0000 7f5d4affd700 1 -- 172.21.15.183:0/936403975 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5d5803a6d0 con 0x7f5d64068d80 2023-10-08T15:40:07.915 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:07.915+0000 7f070a63a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T15:40:07.988 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.988+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f5d6404c3c0 con 0x7f5d64068d80 2023-10-08T15:40:07.991 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.991+0000 7f5d4affd700 1 -- 172.21.15.183:0/936403975 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d58029070 con 0x7f5d64068d80 2023-10-08T15:40:07.992 INFO:teuthology.orchestra.run.smithi183.stdout:2 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 msgr2=0x7f5d641541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 --2- 172.21.15.183:0/936403975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d641541e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800e8d0 tx=0x7f5d58008040 comp rx=0 tx=0).stop 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 shutdown_connections 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 --2- 172.21.15.183:0/936403975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d640b0280 0x7f5d64157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 --2- 172.21.15.183:0/936403975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d64068d80 0x7f5d641541e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 --2- 172.21.15.183:0/936403975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d640afeb0 0x7f5d64156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 >> 172.21.15.183:0/936403975 conn(0x7f5d640ca520 msgr2=0x7f5d641550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 shutdown_connections 2023-10-08T15:40:07.993 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:07.992+0000 7f5d690be700 1 -- 172.21.15.183:0/936403975 wait complete. 2023-10-08T15:40:08.004 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-08T15:40:08.055 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:08.054+0000 7f070a63a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T15:40:08.119 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.119+0000 7fbc198b5700 1 Processor -- start 2023-10-08T15:40:08.120 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.119+0000 7fbc198b5700 1 -- start start 2023-10-08T15:40:08.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc198b5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbc140cce30 0x7fbc1415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc198b5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc140b6580 0x7fbc1406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc198b5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc140b4d70 con 0x7fbc1406a830 2023-10-08T15:40:08.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc198b5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1406ac70 con 0x7fbc140cce30 2023-10-08T15:40:08.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc198b5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140cd8d0 con 0x7fbc140b6580 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc188b3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbc140cce30 0x7fbc1415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc140b6580 0x7fbc1406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc140b6580 0x7fbc1406a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37512/0 (socket says 172.21.15.183:37512) 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc188b3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbc140cce30 0x7fbc1415aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50652/0 (socket says 172.21.15.183:50652) 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc13fff700 1 -- 172.21.15.183:0/1312631487 learned_addr learned my addr 172.21.15.183:0/1312631487 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc188b3700 1 -- 172.21.15.183:0/1312631487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc140b6580 msgr2=0x7fbc1406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc188b3700 1 --2- 172.21.15.183:0/1312631487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc140b6580 0x7fbc1406a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc188b3700 1 -- 172.21.15.183:0/1312631487 >> v1:172.21.15.29:6789/0 conn(0x7fbc1406a830 legacy=0x7fbc1415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc188b3700 1 -- 172.21.15.183:0/1312631487 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc140b4440 con 0x7fbc140cce30 2023-10-08T15:40:08.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc13fff700 1 --2- 172.21.15.183:0/1312631487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc140b6580 0x7fbc1406a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.120+0000 7fbc188b3700 1 --2- 172.21.15.183:0/1312631487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140cce30 0x7fbc1415aca0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc080098e0 tx=0x7fbc080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf7317c9bc740ff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc137fe700 1 -- 172.21.15.183:0/1312631487 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800b640 con 0x7fbc140cce30 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc137fe700 1 -- 172.21.15.183:0/1312631487 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0800b7a0 con 0x7fbc140cce30 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc137fe700 1 -- 172.21.15.183:0/1312631487 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800bb40 con 0x7fbc140cce30 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc198b5700 1 -- 172.21.15.183:0/1312631487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140cce30 msgr2=0x7fbc1415aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc198b5700 1 --2- 172.21.15.183:0/1312631487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140cce30 0x7fbc1415aca0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc080098e0 tx=0x7fbc080091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc198b5700 1 -- 172.21.15.183:0/1312631487 shutdown_connections 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc198b5700 1 --2- 172.21.15.183:0/1312631487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140cce30 0x7fbc1415aca0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc198b5700 1 --2- 172.21.15.183:0/1312631487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc140b6580 0x7fbc1406a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc198b5700 1 -- 172.21.15.183:0/1312631487 >> 172.21.15.183:0/1312631487 conn(0x7fbc14068cb0 msgr2=0x7fbc140690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.124 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc198b5700 1 -- 172.21.15.183:0/1312631487 shutdown_connections 2023-10-08T15:40:08.125 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.121+0000 7fbc198b5700 1 -- 172.21.15.183:0/1312631487 wait complete. 2023-10-08T15:40:08.127 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.122+0000 7fbc198b5700 1 Processor -- start 2023-10-08T15:40:08.127 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc198b5700 1 -- start start 2023-10-08T15:40:08.127 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc198b5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1406a830 0x7fbc1414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc198b5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140b6580 0x7fbc14158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc198b5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc140cce30 0x7fbc14153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc198b5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc141500b0 con 0x7fbc140cce30 2023-10-08T15:40:08.128 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc198b5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1416a140 con 0x7fbc140b6580 2023-10-08T15:40:08.129 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc198b5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1416a410 con 0x7fbc1406a830 2023-10-08T15:40:08.129 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140b6580 0x7fbc14158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.129 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc13fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140b6580 0x7fbc14158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50658/0 (socket says 172.21.15.183:50658) 2023-10-08T15:40:08.129 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc188b3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1406a830 0x7fbc1414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc13fff700 1 -- 172.21.15.183:0/4037170397 learned_addr learned my addr 172.21.15.183:0/4037170397 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.123+0000 7fbc190b4700 1 --2- 172.21.15.183:0/4037170397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc140cce30 0x7fbc14153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc188b3700 1 -- 172.21.15.183:0/4037170397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140b6580 msgr2=0x7fbc14158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc188b3700 1 --2- 172.21.15.183:0/4037170397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140b6580 0x7fbc14158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc188b3700 1 -- 172.21.15.183:0/4037170397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc140cce30 msgr2=0x7fbc14153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc188b3700 1 --2- 172.21.15.183:0/4037170397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc140cce30 0x7fbc14153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc188b3700 1 -- 172.21.15.183:0/4037170397 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000094f0 con 0x7fbc1406a830 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc188b3700 1 --2- 172.21.15.183:0/4037170397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1406a830 0x7fbc1414fb70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbc1415a280 tx=0x7fbc08017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.130 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc10ff9700 1 -- 172.21.15.183:0/4037170397 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0801bbe0 con 0x7fbc1406a830 2023-10-08T15:40:08.131 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc10ff9700 1 -- 172.21.15.183:0/4037170397 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0801bd40 con 0x7fbc1406a830 2023-10-08T15:40:08.131 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc08009420 con 0x7fbc1406a830 2023-10-08T15:40:08.131 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc10ff9700 1 -- 172.21.15.183:0/4037170397 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08011670 con 0x7fbc1406a830 2023-10-08T15:40:08.131 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc14158cd0 con 0x7fbc1406a830 2023-10-08T15:40:08.131 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc10ff9700 1 -- 172.21.15.183:0/4037170397 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbc08011ca0 con 0x7fbc1406a830 2023-10-08T15:40:08.131 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.124+0000 7fbc10ff9700 1 -- 172.21.15.183:0/4037170397 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fbc08023890 con 0x7fbc1406a830 2023-10-08T15:40:08.131 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.125+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc14089550 con 0x7fbc1406a830 2023-10-08T15:40:08.131 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.127+0000 7fbc10ff9700 1 -- 172.21.15.183:0/4037170397 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbc08015020 con 0x7fbc1406a830 2023-10-08T15:40:08.133 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:08.133+0000 7f070a63a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T15:40:08.210 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.210+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7fbc140b4720 con 0x7fbc1406a830 2023-10-08T15:40:08.213 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.213+0000 7fbc10ff9700 1 -- 172.21.15.183:0/4037170397 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbc080233f0 con 0x7fbc1406a830 2023-10-08T15:40:08.214 INFO:teuthology.orchestra.run.smithi183.stdout:3 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1406a830 msgr2=0x7fbc1414fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 --2- 172.21.15.183:0/4037170397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1406a830 0x7fbc1414fb70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbc1415a280 tx=0x7fbc08017000 comp rx=0 tx=0).stop 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 shutdown_connections 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 --2- 172.21.15.183:0/4037170397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc140cce30 0x7fbc14153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 --2- 172.21.15.183:0/4037170397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1406a830 0x7fbc1414fb70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 --2- 172.21.15.183:0/4037170397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc140b6580 0x7fbc14158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 >> 172.21.15.183:0/4037170397 conn(0x7fbc14068cb0 msgr2=0x7fbc140d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 shutdown_connections 2023-10-08T15:40:08.215 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.214+0000 7fbc198b5700 1 -- 172.21.15.183:0/4037170397 wait complete. 2023-10-08T15:40:08.226 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-08T15:40:08.329 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:08.328+0000 7f070a63a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T15:40:08.343 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.343+0000 7f7f740ef700 1 Processor -- start 2023-10-08T15:40:08.343 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.343+0000 7f7f740ef700 1 -- start start 2023-10-08T15:40:08.345 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f740ef700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c15a230 0x7f7f6c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.345 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f740ef700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c15ea90 con 0x7f7f6c159e60 2023-10-08T15:40:08.345 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f740ef700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c0b3100 con 0x7f7f6c0697c0 2023-10-08T15:40:08.345 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f740ef700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0d1cf0 con 0x7f7f6c15a230 2023-10-08T15:40:08.345 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f7268c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c15a230 0x7f7f6c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.345 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f7168a700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f7f6c0697c0 0x7f7f6c0af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:46898/0 (socket says 172.21.15.183:46898) 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f7268c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c15a230 0x7f7f6c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37534/0 (socket says 172.21.15.183:37534) 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f7168a700 1 -- 172.21.15.183:0/2161353902 learned_addr learned my addr 172.21.15.183:0/2161353902 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f7268c700 1 -- 172.21.15.183:0/2161353902 >> v1:172.21.15.183:6789/0 conn(0x7f7f6c0697c0 legacy=0x7f7f6c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f70e89700 1 -- 172.21.15.183:0/2161353902 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842053935 0 0) 0x7f7f6c0b3100 con 0x7f7f6c0697c0 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f7268c700 1 -- 172.21.15.183:0/2161353902 >> v1:172.21.15.29:6789/0 conn(0x7f7f6c159e60 legacy=0x7f7f6c0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f7268c700 1 -- 172.21.15.183:0/2161353902 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0d10e0 con 0x7f7f6c15a230 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.344+0000 7f7f7268c700 1 --2- 172.21.15.183:0/2161353902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c15a230 0x7f7f6c15e550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009e90 tx=0x7f7f64009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c843667a60efacd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f70e89700 1 -- 172.21.15.183:0/2161353902 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400e070 con 0x7f7f6c15a230 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f70e89700 1 -- 172.21.15.183:0/2161353902 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6400bc30 con 0x7f7f6c15a230 2023-10-08T15:40:08.346 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f70e89700 1 -- 172.21.15.183:0/2161353902 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64012430 con 0x7f7f6c15a230 2023-10-08T15:40:08.349 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f740ef700 1 -- 172.21.15.183:0/2161353902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c15a230 msgr2=0x7f7f6c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.349 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f740ef700 1 --2- 172.21.15.183:0/2161353902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c15a230 0x7f7f6c15e550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009e90 tx=0x7f7f64009780 comp rx=0 tx=0).stop 2023-10-08T15:40:08.349 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f740ef700 1 -- 172.21.15.183:0/2161353902 shutdown_connections 2023-10-08T15:40:08.349 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f740ef700 1 --2- 172.21.15.183:0/2161353902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c15a230 0x7f7f6c15e550 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.349 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f740ef700 1 -- 172.21.15.183:0/2161353902 >> 172.21.15.183:0/2161353902 conn(0x7f7f6c070700 msgr2=0x7f7f6c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f740ef700 1 -- 172.21.15.183:0/2161353902 shutdown_connections 2023-10-08T15:40:08.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.345+0000 7f7f740ef700 1 -- 172.21.15.183:0/2161353902 wait complete. 2023-10-08T15:40:08.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.346+0000 7f7f740ef700 1 Processor -- start 2023-10-08T15:40:08.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.346+0000 7f7f740ef700 1 -- start start 2023-10-08T15:40:08.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f740ef700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c0697c0 0x7f7f6c0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f740ef700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c159e60 0x7f7f6c15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f740ef700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f6c15a230 0x7f7f6c0b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.350 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f740ef700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c5150 con 0x7f7f6c15a230 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f740ef700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c4890 con 0x7f7f6c0697c0 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f740ef700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c7850 con 0x7f7f6c159e60 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f7168a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c159e60 0x7f7f6c15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f71e8b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c0697c0 0x7f7f6c0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f71e8b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c0697c0 0x7f7f6c0c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50672/0 (socket says 172.21.15.183:50672) 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f71e8b700 1 -- 172.21.15.183:0/400599616 learned_addr learned my addr 172.21.15.183:0/400599616 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f7168a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c159e60 0x7f7f6c15cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37542/0 (socket says 172.21.15.183:37542) 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.347+0000 7f7f7268c700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f6c15a230 0x7f7f6c0b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f71e8b700 1 -- 172.21.15.183:0/400599616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c159e60 msgr2=0x7f7f6c15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f71e8b700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c159e60 0x7f7f6c15cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.351 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f71e8b700 1 -- 172.21.15.183:0/400599616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f6c15a230 msgr2=0x7f7f6c0b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f71e8b700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f6c15a230 0x7f7f6c0b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f71e8b700 1 -- 172.21.15.183:0/400599616 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64009a20 con 0x7f7f6c0697c0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f7168a700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c159e60 0x7f7f6c15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f71e8b700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c0697c0 0x7f7f6c0c7310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800c5c0 tx=0x7f7f6800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f61ffb700 1 -- 172.21.15.183:0/400599616 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68011590 con 0x7f7f6c0697c0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f61ffb700 1 -- 172.21.15.183:0/400599616 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68011710 con 0x7f7f6c0697c0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c0c4b00 con 0x7f7f6c0697c0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f61ffb700 1 -- 172.21.15.183:0/400599616 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68011ad0 con 0x7f7f6c0697c0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f61ffb700 1 -- 172.21.15.183:0/400599616 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7f680126a0 con 0x7f7f6c0697c0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c15d840 con 0x7f7f6c0697c0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.348+0000 7f7f61ffb700 1 -- 172.21.15.183:0/400599616 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f7f68011e40 con 0x7f7f6c0697c0 2023-10-08T15:40:08.352 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.349+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c04c3c0 con 0x7f7f6c0697c0 2023-10-08T15:40:08.353 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.351+0000 7f7f61ffb700 1 -- 172.21.15.183:0/400599616 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7f68017070 con 0x7f7f6c0697c0 2023-10-08T15:40:08.434 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.433+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f7f6c0cb590 con 0x7f7f6c0697c0 2023-10-08T15:40:08.437 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.436+0000 7f7f61ffb700 1 -- 172.21.15.183:0/400599616 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7f68012b80 con 0x7f7f6c0697c0 2023-10-08T15:40:08.437 INFO:teuthology.orchestra.run.smithi183.stdout:4 2023-10-08T15:40:08.438 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c0697c0 msgr2=0x7f7f6c0c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.438 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c0697c0 0x7f7f6c0c7310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800c5c0 tx=0x7f7f6800c8d0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.438 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 shutdown_connections 2023-10-08T15:40:08.438 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f6c15a230 0x7f7f6c0b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.439 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c0697c0 0x7f7f6c0c7310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.439 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 --2- 172.21.15.183:0/400599616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f6c159e60 0x7f7f6c15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.439 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 >> 172.21.15.183:0/400599616 conn(0x7f7f6c070700 msgr2=0x7f7f6c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.439 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 shutdown_connections 2023-10-08T15:40:08.439 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.437+0000 7f7f740ef700 1 -- 172.21.15.183:0/400599616 wait complete. 2023-10-08T15:40:08.450 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-08T15:40:08.510 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:08.509+0000 7f070a63a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T15:40:08.566 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.566+0000 7fe90dbe9700 1 Processor -- start 2023-10-08T15:40:08.567 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.566+0000 7fe90dbe9700 1 -- start start 2023-10-08T15:40:08.569 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.566+0000 7fe90dbe9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe9080c9340 0x7fe9080afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.569 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.566+0000 7fe90dbe9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe908157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.569 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.566+0000 7fe90dbe9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080b0300 con 0x7fe90815b960 2023-10-08T15:40:08.569 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.566+0000 7fe90dbe9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080cb320 con 0x7fe9080c9340 2023-10-08T15:40:08.569 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe90dbe9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b05e0 con 0x7fe9080c9710 2023-10-08T15:40:08.569 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe9077fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe9080c9340 0x7fe9080afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe907fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe908157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe9077fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe9080c9340 0x7fe9080afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50674/0 (socket says 172.21.15.183:50674) 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe9077fe700 1 -- 172.21.15.183:0/3256069796 learned_addr learned my addr 172.21.15.183:0/3256069796 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe9077fe700 1 -- 172.21.15.183:0/3256069796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 msgr2=0x7fe908157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe9077fe700 1 --2- 172.21.15.183:0/3256069796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe908157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe9077fe700 1 -- 172.21.15.183:0/3256069796 >> v1:172.21.15.183:6789/0 conn(0x7fe90815b960 legacy=0x7fe9081577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe9077fe700 1 -- 172.21.15.183:0/3256069796 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080b08c0 con 0x7fe9080c9340 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe907fff700 1 --2- 172.21.15.183:0/3256069796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe908157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe9077fe700 1 --2- 172.21.15.183:0/3256069796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe9080afa60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80099b0 tx=0x7fe8f8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb9e6156e7cf59d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe906ffd700 1 -- 172.21.15.183:0/3256069796 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8009ea0 con 0x7fe9080c9340 2023-10-08T15:40:08.570 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe906ffd700 1 -- 172.21.15.183:0/3256069796 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f800b860 con 0x7fe9080c9340 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.567+0000 7fe906ffd700 1 -- 172.21.15.183:0/3256069796 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f800bc00 con 0x7fe9080c9340 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.568+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3256069796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 msgr2=0x7fe9080afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.568+0000 7fe90dbe9700 1 --2- 172.21.15.183:0/3256069796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe9080afa60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80099b0 tx=0x7fe8f8009250 comp rx=0 tx=0).stop 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.568+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3256069796 shutdown_connections 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.568+0000 7fe90dbe9700 1 --2- 172.21.15.183:0/3256069796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe908157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.568+0000 7fe90dbe9700 1 --2- 172.21.15.183:0/3256069796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe9080afa60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.568+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3256069796 >> 172.21.15.183:0/3256069796 conn(0x7fe908069870 msgr2=0x7fe908069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.568+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3256069796 shutdown_connections 2023-10-08T15:40:08.571 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.568+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3256069796 wait complete. 2023-10-08T15:40:08.574 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.570+0000 7fe90dbe9700 1 Processor -- start 2023-10-08T15:40:08.574 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.570+0000 7fe90dbe9700 1 -- start start 2023-10-08T15:40:08.574 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe90dbe9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe908152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.574 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe90dbe9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe90816b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.574 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe90dbe9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe90815b960 0x7fe9080b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.574 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe90dbe9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b1cd0 con 0x7fe90815b960 2023-10-08T15:40:08.574 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe90dbe9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b19a0 con 0x7fe9080c9340 2023-10-08T15:40:08.574 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe90dbe9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90816bf10 con 0x7fe9080c9710 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe9077fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe908152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe8fffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe90816b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe9077fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe908152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50680/0 (socket says 172.21.15.183:50680) 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe9077fe700 1 -- 172.21.15.183:0/3833012365 learned_addr learned my addr 172.21.15.183:0/3833012365 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe907fff700 1 --2- 172.21.15.183:0/3833012365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe90815b960 0x7fe9080b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe9077fe700 1 -- 172.21.15.183:0/3833012365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 msgr2=0x7fe90816b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe9077fe700 1 --2- 172.21.15.183:0/3833012365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe90816b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe9077fe700 1 -- 172.21.15.183:0/3833012365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe90815b960 msgr2=0x7fe9080b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe9077fe700 1 --2- 172.21.15.183:0/3833012365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe90815b960 0x7fe9080b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.571+0000 7fe9077fe700 1 -- 172.21.15.183:0/3833012365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009a20 con 0x7fe9080c9340 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.572+0000 7fe9077fe700 1 --2- 172.21.15.183:0/3833012365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe908152120 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe90806dd20 tx=0x7fe8f8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.575 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.572+0000 7fe8ff7fe700 1 -- 172.21.15.183:0/3833012365 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f800bbe0 con 0x7fe9080c9340 2023-10-08T15:40:08.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.572+0000 7fe8ff7fe700 1 -- 172.21.15.183:0/3833012365 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f8011420 con 0x7fe9080c9340 2023-10-08T15:40:08.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.572+0000 7fe8ff7fe700 1 -- 172.21.15.183:0/3833012365 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80117c0 con 0x7fe9080c9340 2023-10-08T15:40:08.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.572+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f80094f0 con 0x7fe9080c9340 2023-10-08T15:40:08.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.572+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90816c4d0 con 0x7fe9080c9340 2023-10-08T15:40:08.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.572+0000 7fe8ff7fe700 1 -- 172.21.15.183:0/3833012365 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe8f802e3f0 con 0x7fe9080c9340 2023-10-08T15:40:08.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.572+0000 7fe8ff7fe700 1 -- 172.21.15.183:0/3833012365 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fe8f8025970 con 0x7fe9080c9340 2023-10-08T15:40:08.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.573+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90804c3c0 con 0x7fe9080c9340 2023-10-08T15:40:08.576 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.575+0000 7fe8ff7fe700 1 -- 172.21.15.183:0/3833012365 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe8f8033060 con 0x7fe9080c9340 2023-10-08T15:40:08.592 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:08.592+0000 7f070a63a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T15:40:08.657 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.657+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7fe9080aeac0 con 0x7fe9080c9340 2023-10-08T15:40:08.660 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.660+0000 7fe8ff7fe700 1 -- 172.21.15.183:0/3833012365 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe8f8015020 con 0x7fe9080c9340 2023-10-08T15:40:08.660 INFO:teuthology.orchestra.run.smithi183.stdout:5 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 msgr2=0x7fe908152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 --2- 172.21.15.183:0/3833012365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe908152120 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe90806dd20 tx=0x7fe8f8017000 comp rx=0 tx=0).stop 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 shutdown_connections 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 --2- 172.21.15.183:0/3833012365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe90815b960 0x7fe9080b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 --2- 172.21.15.183:0/3833012365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9080c9340 0x7fe908152120 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 --2- 172.21.15.183:0/3833012365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9080c9710 0x7fe90816b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 >> 172.21.15.183:0/3833012365 conn(0x7fe908069870 msgr2=0x7fe9081567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 shutdown_connections 2023-10-08T15:40:08.662 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.661+0000 7fe90dbe9700 1 -- 172.21.15.183:0/3833012365 wait complete. 2023-10-08T15:40:08.673 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-08T15:40:08.724 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:08.724+0000 7f2c0615f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T15:40:08.736 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:08.736+0000 7f070a63a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T15:40:08.791 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.790+0000 7fa15eff4700 1 Processor -- start 2023-10-08T15:40:08.791 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.790+0000 7fa15eff4700 1 -- start start 2023-10-08T15:40:08.793 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa15eff4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa15806ca90 0x7fa158158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.793 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa15eff4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa15815c450 0x7fa158158780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.793 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa15eff4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa158159210 con 0x7fa158155700 2023-10-08T15:40:08.793 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa15eff4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa158158cc0 con 0x7fa15815c450 2023-10-08T15:40:08.793 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa15eff4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa158158f30 con 0x7fa15806ca90 2023-10-08T15:40:08.793 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa157fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa15806ca90 0x7fa158158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.793 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa157fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa15806ca90 0x7fa158158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37566/0 (socket says 172.21.15.183:37566) 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa157fff700 1 -- 172.21.15.183:0/602428210 learned_addr learned my addr 172.21.15.183:0/602428210 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa15d591700 1 --2- 172.21.15.183:0/602428210 >> v2:172.21.15.29:3300/0 conn(0x7fa15815c450 0x7fa158158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa157fff700 1 -- 172.21.15.183:0/602428210 >> v2:172.21.15.29:3300/0 conn(0x7fa15815c450 msgr2=0x7fa158158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa157fff700 1 --2- 172.21.15.183:0/602428210 >> v2:172.21.15.29:3300/0 conn(0x7fa15815c450 0x7fa158158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa157fff700 1 -- 172.21.15.183:0/602428210 >> v1:172.21.15.29:6789/0 conn(0x7fa158155700 legacy=0x7fa15806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.791+0000 7fa157fff700 1 -- 172.21.15.183:0/602428210 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15815b970 con 0x7fa15806ca90 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa157fff700 1 --2- 172.21.15.183:0/602428210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa15806ca90 0x7fa158158240 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa148009f20 tx=0x7fa148009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=571cd6b27034c70d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa1577fe700 1 -- 172.21.15.183:0/602428210 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14800e070 con 0x7fa15806ca90 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa1577fe700 1 -- 172.21.15.183:0/602428210 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14800b9d0 con 0x7fa15806ca90 2023-10-08T15:40:08.794 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa1577fe700 1 -- 172.21.15.183:0/602428210 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480092e0 con 0x7fa15806ca90 2023-10-08T15:40:08.795 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa15eff4700 1 -- 172.21.15.183:0/602428210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa15806ca90 msgr2=0x7fa158158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.795 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa15eff4700 1 --2- 172.21.15.183:0/602428210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa15806ca90 0x7fa158158240 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa148009f20 tx=0x7fa148009840 comp rx=0 tx=0).stop 2023-10-08T15:40:08.795 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa15eff4700 1 -- 172.21.15.183:0/602428210 shutdown_connections 2023-10-08T15:40:08.795 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa15eff4700 1 --2- 172.21.15.183:0/602428210 >> v2:172.21.15.29:3300/0 conn(0x7fa15815c450 0x7fa158158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.795 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa15eff4700 1 --2- 172.21.15.183:0/602428210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa15806ca90 0x7fa158158240 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.795 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa15eff4700 1 -- 172.21.15.183:0/602428210 >> 172.21.15.183:0/602428210 conn(0x7fa1580cb030 msgr2=0x7fa15806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.795 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa15eff4700 1 -- 172.21.15.183:0/602428210 shutdown_connections 2023-10-08T15:40:08.795 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.792+0000 7fa15eff4700 1 -- 172.21.15.183:0/602428210 wait complete. 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.793+0000 7fa15eff4700 1 Processor -- start 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15eff4700 1 -- start start 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15eff4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15806ca90 0x7fa158168690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15eff4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158155700 0x7fa1581578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15eff4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa15815c450 0x7fa158151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15eff4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158169970 con 0x7fa15806ca90 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15eff4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158168bd0 con 0x7fa15815c450 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15eff4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa158157e30 con 0x7fa158155700 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15d591700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa15815c450 0x7fa158151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.798 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa157fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158155700 0x7fa1581578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15d591700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa15815c450 0x7fa158151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:50690/0 (socket says 172.21.15.183:50690) 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15d591700 1 -- 172.21.15.183:0/440699077 learned_addr learned my addr 172.21.15.183:0/440699077 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa157fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158155700 0x7fa1581578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37572/0 (socket says 172.21.15.183:37572) 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.794+0000 7fa15cd90700 1 --2- 172.21.15.183:0/440699077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15806ca90 0x7fa158168690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa15d591700 1 -- 172.21.15.183:0/440699077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158155700 msgr2=0x7fa1581578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa15d591700 1 --2- 172.21.15.183:0/440699077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158155700 0x7fa1581578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa15d591700 1 -- 172.21.15.183:0/440699077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15806ca90 msgr2=0x7fa158168690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa15d591700 1 --2- 172.21.15.183:0/440699077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15806ca90 0x7fa158168690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.799 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa15d591700 1 -- 172.21.15.183:0/440699077 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148009ae0 con 0x7fa15815c450 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa15d591700 1 --2- 172.21.15.183:0/440699077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa15815c450 0x7fa158151a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa14000ea80 tx=0x7fa1400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa154ff9700 1 -- 172.21.15.183:0/440699077 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000eec0 con 0x7fa15815c450 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa154ff9700 1 -- 172.21.15.183:0/440699077 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000c7f0 con 0x7fa15815c450 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa158168df0 con 0x7fa15815c450 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa154ff9700 1 -- 172.21.15.183:0/440699077 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000cbb0 con 0x7fa15815c450 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa158169690 con 0x7fa15815c450 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa154ff9700 1 -- 172.21.15.183:0/440699077 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa140005c80 con 0x7fa15815c450 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.795+0000 7fa154ff9700 1 -- 172.21.15.183:0/440699077 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fa140006660 con 0x7fa15815c450 2023-10-08T15:40:08.800 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.796+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1581691f0 con 0x7fa15815c450 2023-10-08T15:40:08.801 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.800+0000 7fa154ff9700 1 -- 172.21.15.183:0/440699077 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa140021060 con 0x7fa15815c450 2023-10-08T15:40:08.837 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:08.837+0000 7f070a63a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T15:40:08.861 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:08.861+0000 7f2c0615f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T15:40:08.883 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.883+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7fa158158020 con 0x7fa15815c450 2023-10-08T15:40:08.887 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.887+0000 7fa154ff9700 1 -- 172.21.15.183:0/440699077 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa14002a0b0 con 0x7fa15815c450 2023-10-08T15:40:08.888 INFO:teuthology.orchestra.run.smithi183.stdout:6 2023-10-08T15:40:08.889 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa15815c450 msgr2=0x7fa158151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:08.889 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 --2- 172.21.15.183:0/440699077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa15815c450 0x7fa158151a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa14000ea80 tx=0x7fa1400091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.889 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 shutdown_connections 2023-10-08T15:40:08.889 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 --2- 172.21.15.183:0/440699077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa15815c450 0x7fa158151a80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.889 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 --2- 172.21.15.183:0/440699077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa15806ca90 0x7fa158168690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.889 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 --2- 172.21.15.183:0/440699077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158155700 0x7fa1581578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:08.890 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 >> 172.21.15.183:0/440699077 conn(0x7fa1580cb030 msgr2=0x7fa158154630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:08.890 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 shutdown_connections 2023-10-08T15:40:08.890 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:08.888+0000 7fa15eff4700 1 -- 172.21.15.183:0/440699077 wait complete. 2023-10-08T15:40:08.900 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-08T15:40:08.940 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:08.939+0000 7f2c0615f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T15:40:09.015 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.014+0000 7f17919f2700 1 Processor -- start 2023-10-08T15:40:09.053 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.015+0000 7f17919f2700 1 -- start start 2023-10-08T15:40:09.058 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.015+0000 7f17919f2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f178c15b960 0x7f178c1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.015+0000 7f17919f2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.015+0000 7f17919f2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c158220 con 0x7f178c0c9340 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.015+0000 7f17919f2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0cb320 con 0x7f178c15b960 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.015+0000 7f17919f2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0b0300 con 0x7f178c0c9710 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178b7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178b7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37588/0 (socket says 172.21.15.183:37588) 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178b7fe700 1 -- 172.21.15.183:0/1453230449 learned_addr learned my addr 172.21.15.183:0/1453230449 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f1783fff700 1 --2- 172.21.15.183:0/1453230449 >> v2:172.21.15.29:3300/0 conn(0x7f178c15b960 0x7f178c1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.059 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178b7fe700 1 -- 172.21.15.183:0/1453230449 >> v2:172.21.15.29:3300/0 conn(0x7f178c15b960 msgr2=0x7f178c1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:09.060 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178b7fe700 1 --2- 172.21.15.183:0/1453230449 >> v2:172.21.15.29:3300/0 conn(0x7f178c15b960 0x7f178c1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.060 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178b7fe700 1 -- 172.21.15.183:0/1453230449 >> v1:172.21.15.29:6789/0 conn(0x7f178c0c9340 legacy=0x7f178c0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.060 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178b7fe700 1 -- 172.21.15.183:0/1453230449 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0b05e0 con 0x7f178c0c9710 2023-10-08T15:40:09.060 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178b7fe700 1 --2- 172.21.15.183:0/1453230449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c157ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1784009f20 tx=0x7f1784009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65c893210f80d4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:09.060 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178a7fc700 1 -- 172.21.15.183:0/1453230449 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400e070 con 0x7f178c0c9710 2023-10-08T15:40:09.060 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178a7fc700 1 -- 172.21.15.183:0/1453230449 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178400b9d0 con 0x7f178c0c9710 2023-10-08T15:40:09.060 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.016+0000 7f178a7fc700 1 -- 172.21.15.183:0/1453230449 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17840092e0 con 0x7f178c0c9710 2023-10-08T15:40:09.060 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.017+0000 7f17919f2700 1 -- 172.21.15.183:0/1453230449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 msgr2=0x7f178c157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.017+0000 7f17919f2700 1 --2- 172.21.15.183:0/1453230449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c157ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1784009f20 tx=0x7f1784009840 comp rx=0 tx=0).stop 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.017+0000 7f17919f2700 1 -- 172.21.15.183:0/1453230449 shutdown_connections 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.017+0000 7f17919f2700 1 --2- 172.21.15.183:0/1453230449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c157ce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.017+0000 7f17919f2700 1 --2- 172.21.15.183:0/1453230449 >> v2:172.21.15.29:3300/0 conn(0x7f178c15b960 0x7f178c1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.017+0000 7f17919f2700 1 -- 172.21.15.183:0/1453230449 >> 172.21.15.183:0/1453230449 conn(0x7f178c069870 msgr2=0x7f178c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.017+0000 7f17919f2700 1 -- 172.21.15.183:0/1453230449 shutdown_connections 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.017+0000 7f17919f2700 1 -- 172.21.15.183:0/1453230449 wait complete. 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.018+0000 7f17919f2700 1 Processor -- start 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.018+0000 7f17919f2700 1 -- start start 2023-10-08T15:40:09.061 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f17919f2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f178c0c9340 0x7f178c0c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.062 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f17919f2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.062 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f17919f2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f178c15b960 0x7f178c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.062 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f17919f2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0c6e70 con 0x7f178c0c9340 2023-10-08T15:40:09.062 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f17919f2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0c7150 con 0x7f178c15b960 2023-10-08T15:40:09.062 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f17919f2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0c7430 con 0x7f178c0c9710 2023-10-08T15:40:09.062 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.062 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:37604/0 (socket says 172.21.15.183:37604) 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f178b7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f178c15b960 0x7f178c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 -- 172.21.15.183:0/992443806 learned_addr learned my addr 172.21.15.183:0/992443806 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f178affd700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f178c0c9340 0x7f178c0c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 -- 172.21.15.183:0/992443806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f178c15b960 msgr2=0x7f178c153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f178c15b960 0x7f178c153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 -- 172.21.15.183:0/992443806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f178c0c9340 msgr2=0x7f178c0c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f178c0c9340 0x7f178c0c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 -- 172.21.15.183:0/992443806 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784009ae0 con 0x7f178c0c9710 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f178b7fe700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f178c15b960 0x7f178c153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1783fff700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c156c70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f177400e930 tx=0x7f17740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1782ffd700 1 -- 172.21.15.183:0/992443806 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774013680 con 0x7f178c0c9710 2023-10-08T15:40:09.063 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1782ffd700 1 -- 172.21.15.183:0/992443806 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17740137e0 con 0x7f178c0c9710 2023-10-08T15:40:09.064 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0c7710 con 0x7f178c0c9710 2023-10-08T15:40:09.064 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1782ffd700 1 -- 172.21.15.183:0/992443806 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774013b80 con 0x7f178c0c9710 2023-10-08T15:40:09.064 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c0c6ab0 con 0x7f178c0c9710 2023-10-08T15:40:09.064 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.019+0000 7f1782ffd700 1 -- 172.21.15.183:0/992443806 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1774005c80 con 0x7f178c0c9710 2023-10-08T15:40:09.064 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.020+0000 7f1782ffd700 1 -- 172.21.15.183:0/992443806 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f17740065c0 con 0x7f178c0c9710 2023-10-08T15:40:09.064 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.020+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c0b1d30 con 0x7f178c0c9710 2023-10-08T15:40:09.064 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.022+0000 7f1782ffd700 1 -- 172.21.15.183:0/992443806 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1774021060 con 0x7f178c0c9710 2023-10-08T15:40:09.116 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.116+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f178c04c3c0 con 0x7f178c0c9710 2023-10-08T15:40:09.121 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.120+0000 7f1782ffd700 1 -- 172.21.15.183:0/992443806 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1774017070 con 0x7f178c0c9710 2023-10-08T15:40:09.121 INFO:teuthology.orchestra.run.smithi183.stdout:7 2023-10-08T15:40:09.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 msgr2=0x7f178c156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c156c70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f177400e930 tx=0x7f17740091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 shutdown_connections 2023-10-08T15:40:09.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f178c15b960 0x7f178c153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f178c0c9340 0x7f178c0c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 --2- 172.21.15.183:0/992443806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f178c0c9710 0x7f178c156c70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 >> 172.21.15.183:0/992443806 conn(0x7f178c069870 msgr2=0x7f178c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:09.122 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 shutdown_connections 2023-10-08T15:40:09.123 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-08T15:40:09.121+0000 7f17919f2700 1 -- 172.21.15.183:0/992443806 wait complete. 2023-10-08T15:40:09.132 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:09.132+0000 7f2c0615f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T15:40:09.138 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T15:40:09.138 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T15:40:09.142 INFO:tasks.ceph.osd.0:Started 2023-10-08T15:40:09.142 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T15:40:09.142 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T15:40:09.146 INFO:tasks.ceph.osd.1:Started 2023-10-08T15:40:09.146 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T15:40:09.146 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T15:40:09.149 INFO:tasks.ceph.osd.2:Started 2023-10-08T15:40:09.150 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T15:40:09.150 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T15:40:09.154 INFO:tasks.ceph.osd.3:Started 2023-10-08T15:40:09.154 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T15:40:09.154 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T15:40:09.158 INFO:tasks.ceph.osd.4:Started 2023-10-08T15:40:09.159 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T15:40:09.159 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T15:40:09.164 INFO:tasks.ceph.osd.5:Started 2023-10-08T15:40:09.165 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T15:40:09.165 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T15:40:09.167 INFO:tasks.ceph.osd.6:Started 2023-10-08T15:40:09.167 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T15:40:09.168 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T15:40:09.172 INFO:tasks.ceph.osd.7:Started 2023-10-08T15:40:09.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:09.232 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-08T15:40:09.232+0000 7f7e70ff6540 -1 Falling back to public interface 2023-10-08T15:40:09.236 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-08T15:40:09.235+0000 7fcbfc066540 -1 Falling back to public interface 2023-10-08T15:40:09.244 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-08T15:40:09.243+0000 7f5cb9925540 -1 Falling back to public interface 2023-10-08T15:40:09.246 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-08T15:40:09.246+0000 7f7e70ff6540 -1 osd.0 0 log_to_monitors true 2023-10-08T15:40:09.251 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-08T15:40:09.251+0000 7fdc0175f540 -1 Falling back to public interface 2023-10-08T15:40:09.252 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-08T15:40:09.251+0000 7ff8419d4540 -1 Falling back to public interface 2023-10-08T15:40:09.253 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-08T15:40:09.253+0000 7fcbfc066540 -1 osd.1 0 log_to_monitors true 2023-10-08T15:40:09.256 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-08T15:40:09.256+0000 7f935993b540 -1 Falling back to public interface 2023-10-08T15:40:09.257 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-08T15:40:09.256+0000 7f5cb9925540 -1 osd.6 0 log_to_monitors true 2023-10-08T15:40:09.262 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-08T15:40:09.262+0000 7fb552e0a540 -1 Falling back to public interface 2023-10-08T15:40:09.263 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-08T15:40:09.263+0000 7f10cdd44540 -1 Falling back to public interface 2023-10-08T15:40:09.263 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-08T15:40:09.263+0000 7f10c816d700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6818/0: (98) Address already in use 2023-10-08T15:40:09.264 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-08T15:40:09.264+0000 7fb54d233700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6823/0: (98) Address already in use 2023-10-08T15:40:09.265 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-08T15:40:09.265+0000 7fdc0175f540 -1 osd.7 0 log_to_monitors true 2023-10-08T15:40:09.269 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-08T15:40:09.269+0000 7ff8419d4540 -1 osd.2 0 log_to_monitors true 2023-10-08T15:40:09.273 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-08T15:40:09.273+0000 7f935993b540 -1 osd.3 0 log_to_monitors true 2023-10-08T15:40:09.276 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-08T15:40:09.276+0000 7fb552e0a540 -1 osd.5 0 log_to_monitors true 2023-10-08T15:40:09.278 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-08T15:40:09.278+0000 7f10cdd44540 -1 osd.4 0 log_to_monitors true 2023-10-08T15:40:09.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.326+0000 7f03811a1700 1 Processor -- start 2023-10-08T15:40:09.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.326+0000 7f03811a1700 1 -- start start 2023-10-08T15:40:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.326+0000 7f03811a1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f037c0a7a20 0x7f037c0af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f03811a1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f037c0a7df0 0x7f037c0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f03811a1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 0x7f037c157700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f03811a1700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c0ae760 con 0x7f037c0a7df0 2023-10-08T15:40:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f03811a1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c0aea40 con 0x7f037c0a7a20 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f03811a1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0aed20 con 0x7f037c1572a0 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f037c0a7df0 0x7f037c0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f037c0a7df0 0x7f037c0b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52916/0 (socket says 172.21.15.29:52916) 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 -- 172.21.15.29:0/2517114439 learned_addr learned my addr 172.21.15.29:0/2517114439 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037b59e700 1 --2- 172.21.15.29:0/2517114439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 0x7f037c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037ad9d700 1 --2- 172.21.15.29:0/2517114439 >> v2:172.21.15.183:3300/0 conn(0x7f037c0a7a20 0x7f037c0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 -- 172.21.15.29:0/2517114439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 msgr2=0x7f037c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 --2- 172.21.15.29:0/2517114439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 0x7f037c157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 -- 172.21.15.29:0/2517114439 >> v2:172.21.15.183:3300/0 conn(0x7f037c0a7a20 msgr2=0x7f037c0af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 --2- 172.21.15.29:0/2517114439 >> v2:172.21.15.183:3300/0 conn(0x7f037c0a7a20 0x7f037c0af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 -- 172.21.15.29:0/2517114439 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0af000 con 0x7f037c0a7df0 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f037a59c700 1 --2- 172.21.15.29:0/2517114439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7df0 0x7f037c0b29c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f037c06fce0 tx=0x7f037000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465daad3c57eea69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f0379d9b700 1 -- 172.21.15.29:0/2517114439 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000dbd0 con 0x7f037c0a7df0 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f0379d9b700 1 -- 172.21.15.29:0/2517114439 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037000dd30 con 0x7f037c0a7df0 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.327+0000 7f0379d9b700 1 -- 172.21.15.29:0/2517114439 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000dea0 con 0x7f037c0a7df0 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 -- 172.21.15.29:0/2517114439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7df0 msgr2=0x7f037c0b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 --2- 172.21.15.29:0/2517114439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7df0 0x7f037c0b29c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f037c06fce0 tx=0x7f037000b4f0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 -- 172.21.15.29:0/2517114439 shutdown_connections 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 --2- 172.21.15.29:0/2517114439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 0x7f037c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 --2- 172.21.15.29:0/2517114439 >> v2:172.21.15.183:3300/0 conn(0x7f037c0a7a20 0x7f037c0af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 --2- 172.21.15.29:0/2517114439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7df0 0x7f037c0b29c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 -- 172.21.15.29:0/2517114439 >> 172.21.15.29:0/2517114439 conn(0x7f037c0cd1e0 msgr2=0x7f037c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:09.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 -- 172.21.15.29:0/2517114439 shutdown_connections 2023-10-08T15:40:09.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.328+0000 7f03811a1700 1 -- 172.21.15.29:0/2517114439 wait complete. 2023-10-08T15:40:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.329+0000 7f03811a1700 1 Processor -- start 2023-10-08T15:40:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.329+0000 7f03811a1700 1 -- start start 2023-10-08T15:40:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f03811a1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7a20 0x7f037c152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f03811a1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f037c0a7df0 0x7f037c099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f03811a1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 0x7f037c06e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:09.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f03811a1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0cbfc0 con 0x7f037c0a7a20 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f03811a1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c158780 con 0x7f037c0a7df0 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f03811a1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c157b70 con 0x7f037c1572a0 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f037ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7a20 0x7f037c152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f037ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7a20 0x7f037c152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52924/0 (socket says 172.21.15.29:52924) 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f037ad9d700 1 -- 172.21.15.29:0/3039869070 learned_addr learned my addr 172.21.15.29:0/3039869070 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f037a59c700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f037c0a7df0 0x7f037c099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f037b59e700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 0x7f037c06e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.330+0000 7f037ad9d700 1 -- 172.21.15.29:0/3039869070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 msgr2=0x7f037c06e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f037ad9d700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 0x7f037c06e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f037ad9d700 1 -- 172.21.15.29:0/3039869070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f037c0a7df0 msgr2=0x7f037c099a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f037ad9d700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f037c0a7df0 0x7f037c099a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f037ad9d700 1 -- 172.21.15.29:0/3039869070 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037000b790 con 0x7f037c0a7a20 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f037ad9d700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7a20 0x7f037c152270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f036c00ec80 tx=0x7f036c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f0362ffd700 1 -- 172.21.15.29:0/3039869070 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00c850 con 0x7f037c0a7a20 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f0362ffd700 1 -- 172.21.15.29:0/3039869070 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00c9b0 con 0x7f037c0a7a20 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c157e50 con 0x7f037c0a7a20 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f0362ffd700 1 -- 172.21.15.29:0/3039869070 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00cd50 con 0x7f037c0a7a20 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c158410 con 0x7f037c0a7a20 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f0362ffd700 1 -- 172.21.15.29:0/3039869070 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f036c005c80 con 0x7f037c0a7a20 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.331+0000 7f0362ffd700 1 -- 172.21.15.29:0/3039869070 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f036c006700 con 0x7f037c0a7a20 2023-10-08T15:40:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.332+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c158a60 con 0x7f037c0a7a20 2023-10-08T15:40:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.334+0000 7f0362ffd700 1 -- 172.21.15.29:0/3039869070 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f036c021060 con 0x7f037c0a7a20 2023-10-08T15:40:09.356 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:09.356+0000 7f2c0615f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T15:40:09.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.404+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f037c04c3c0 con 0x7f037c0a7a20 2023-10-08T15:40:09.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.404+0000 7f0362ffd700 1 -- 172.21.15.29:0/3039869070 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f036c017070 con 0x7f037c0a7a20 2023-10-08T15:40:09.405 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:09.405 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:09.117651+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7a20 msgr2=0x7f037c152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7a20 0x7f037c152270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f036c00ec80 tx=0x7f036c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 shutdown_connections 2023-10-08T15:40:09.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f037c1572a0 0x7f037c06e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f037c0a7a20 0x7f037c152270 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 --2- 172.21.15.29:0/3039869070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f037c0a7df0 0x7f037c099a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:09.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 >> 172.21.15.29:0/3039869070 conn(0x7f037c0cd1e0 msgr2=0x7f037c153ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:09.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 shutdown_connections 2023-10-08T15:40:09.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:09.405+0000 7f03811a1700 1 -- 172.21.15.29:0/3039869070 wait complete. 2023-10-08T15:40:09.420 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T15:40:09.420 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T15:40:09.422 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:09.422+0000 7f070a63a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T15:40:09.438 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:09.437+0000 7f2c0615f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T15:40:09.499 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:09.498+0000 7f070a63a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T15:40:09.577 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:09.577+0000 7f070a63a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T15:40:09.578 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:09.577+0000 7f2c0615f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T15:40:09.677 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:09.676+0000 7f2c0615f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T15:40:10.150 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:10.149+0000 7f070a63a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T15:40:10.226 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:10.287 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:10.287+0000 7f070a63a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T15:40:10.345 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.345+0000 7f10dad45700 1 Processor -- start 2023-10-08T15:40:10.345 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.345+0000 7f10dad45700 1 -- start start 2023-10-08T15:40:10.348 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10dad45700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f10d406f1a0 0x7f10d40c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.348 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10dad45700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f10d40b0160 0x7f10d4070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.348 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10dad45700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d40ca270 con 0x7f10d40afd90 2023-10-08T15:40:10.349 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10dad45700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d40c87c0 con 0x7f10d40b0160 2023-10-08T15:40:10.349 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10dad45700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d406e3e0 con 0x7f10d406f1a0 2023-10-08T15:40:10.349 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d8ae1700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f10d40afd90 0x7f10d415b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47840/0 (socket says 172.21.15.29:47840) 2023-10-08T15:40:10.349 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d92e2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f10d40b0160 0x7f10d4070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.349 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d8ae1700 1 -- 172.21.15.29:0/2498567079 learned_addr learned my addr 172.21.15.29:0/2498567079 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:10.349 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d3fff700 1 --2- 172.21.15.29:0/2498567079 >> v2:172.21.15.183:3300/0 conn(0x7f10d406f1a0 0x7f10d40c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.349 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d37fe700 1 -- 172.21.15.29:0/2498567079 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819204658 0 0) 0x7f10d40ca270 con 0x7f10d40afd90 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d37fe700 1 -- 172.21.15.29:0/2498567079 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c0003570 con 0x7f10d40afd90 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d92e2700 1 -- 172.21.15.29:0/2498567079 >> v2:172.21.15.183:3300/0 conn(0x7f10d406f1a0 msgr2=0x7f10d40c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d92e2700 1 --2- 172.21.15.29:0/2498567079 >> v2:172.21.15.183:3300/0 conn(0x7f10d406f1a0 0x7f10d40c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d92e2700 1 -- 172.21.15.29:0/2498567079 >> v1:172.21.15.29:6789/0 conn(0x7f10d40afd90 legacy=0x7f10d415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d92e2700 1 -- 172.21.15.29:0/2498567079 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d406e6c0 con 0x7f10d40b0160 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d92e2700 1 --2- 172.21.15.29:0/2498567079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d40b0160 0x7f10d4070700 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f10d406d3f0 tx=0x7f10cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3252331a1be9ca6e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d37fe700 1 -- 172.21.15.29:0/2498567079 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc011630 con 0x7f10d40b0160 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.346+0000 7f10d37fe700 1 -- 172.21.15.29:0/2498567079 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc0117b0 con 0x7f10d40b0160 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10d37fe700 1 -- 172.21.15.29:0/2498567079 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc011b70 con 0x7f10d40b0160 2023-10-08T15:40:10.350 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10dad45700 1 -- 172.21.15.29:0/2498567079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d40b0160 msgr2=0x7f10d4070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.351 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10dad45700 1 --2- 172.21.15.29:0/2498567079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d40b0160 0x7f10d4070700 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f10d406d3f0 tx=0x7f10cc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.351 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10dad45700 1 -- 172.21.15.29:0/2498567079 shutdown_connections 2023-10-08T15:40:10.351 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10dad45700 1 --2- 172.21.15.29:0/2498567079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d40b0160 0x7f10d4070700 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.351 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10dad45700 1 --2- 172.21.15.29:0/2498567079 >> v2:172.21.15.183:3300/0 conn(0x7f10d406f1a0 0x7f10d40c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.351 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10dad45700 1 -- 172.21.15.29:0/2498567079 >> 172.21.15.29:0/2498567079 conn(0x7f10d40ca4f0 msgr2=0x7f10d40ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:10.351 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10dad45700 1 -- 172.21.15.29:0/2498567079 shutdown_connections 2023-10-08T15:40:10.351 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.347+0000 7f10dad45700 1 -- 172.21.15.29:0/2498567079 wait complete. 2023-10-08T15:40:10.354 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.348+0000 7f10dad45700 1 Processor -- start 2023-10-08T15:40:10.354 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.348+0000 7f10dad45700 1 -- start start 2023-10-08T15:40:10.354 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10dad45700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d406f1a0 0x7f10d4155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.354 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10dad45700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d40afd90 0x7f10d40c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.354 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10dad45700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d40b0160 0x7f10d4151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:10.354 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10dad45700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40c4290 con 0x7f10d406f1a0 2023-10-08T15:40:10.357 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10dad45700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d416a590 con 0x7f10d40b0160 2023-10-08T15:40:10.357 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10dad45700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4155ee0 con 0x7f10d40afd90 2023-10-08T15:40:10.357 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10d8ae1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d406f1a0 0x7f10d4155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.357 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10d8ae1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d406f1a0 0x7f10d4155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52936/0 (socket says 172.21.15.29:52936) 2023-10-08T15:40:10.357 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10d8ae1700 1 -- 172.21.15.29:0/2523773316 learned_addr learned my addr 172.21.15.29:0/2523773316 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10d3fff700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d40afd90 0x7f10d40c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.349+0000 7f10d92e2700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d40b0160 0x7f10d4151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d8ae1700 1 -- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d40afd90 msgr2=0x7f10d40c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d8ae1700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d40afd90 0x7f10d40c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d8ae1700 1 -- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d40b0160 msgr2=0x7f10d4151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d8ae1700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d40b0160 0x7f10d4151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d8ae1700 1 -- 172.21.15.29:0/2523773316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009420 con 0x7f10d406f1a0 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d3fff700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d40afd90 0x7f10d40c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:10.358 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d92e2700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d40b0160 0x7f10d4151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d8ae1700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d406f1a0 0x7f10d4155800 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f10c400cd30 tx=0x7f10c4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d0ff9700 1 -- 172.21.15.29:0/2523773316 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400ac00 con 0x7f10d406f1a0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d0ff9700 1 -- 172.21.15.29:0/2523773316 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c400ad80 con 0x7f10d406f1a0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d41561c0 con 0x7f10d406f1a0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d0ff9700 1 -- 172.21.15.29:0/2523773316 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4007340 con 0x7f10d406f1a0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d4156780 con 0x7f10d406f1a0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d0ff9700 1 -- 172.21.15.29:0/2523773316 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f10c4007730 con 0x7f10d406f1a0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.350+0000 7f10d0ff9700 1 -- 172.21.15.29:0/2523773316 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7f10c401be00 con 0x7f10d406f1a0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.351+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d404c3c0 con 0x7f10d406f1a0 2023-10-08T15:40:10.359 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.353+0000 7f10d0ff9700 1 -- 172.21.15.29:0/2523773316 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f10c401b630 con 0x7f10d406f1a0 2023-10-08T15:40:10.378 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:10.377+0000 7f070a63a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T15:40:10.424 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.424+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10d406b620 con 0x7f10d406f1a0 2023-10-08T15:40:10.425 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.425+0000 7f10d0ff9700 1 -- 172.21.15.29:0/2523773316 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f10c401b7d0 con 0x7f10d406f1a0 2023-10-08T15:40:10.425 INFO:teuthology.misc.health.smithi029.stdout: 2023-10-08T15:40:10.425 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":11,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:10.118660+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:10.426 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.425+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d406f1a0 msgr2=0x7f10d4155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:10.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.425+0000 7f10dad45700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d406f1a0 0x7f10d4155800 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f10c400cd30 tx=0x7f10c4001b10 comp rx=0 tx=0).stop 2023-10-08T15:40:10.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.425+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 shutdown_connections 2023-10-08T15:40:10.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.426+0000 7f10dad45700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d40b0160 0x7f10d4151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.426+0000 7f10dad45700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10d406f1a0 0x7f10d4155800 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.426+0000 7f10dad45700 1 --2- 172.21.15.29:0/2523773316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d40afd90 0x7f10d40c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:10.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.426+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 >> 172.21.15.29:0/2523773316 conn(0x7f10d40ca4f0 msgr2=0x7f10d40cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:10.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.426+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 shutdown_connections 2023-10-08T15:40:10.427 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:10.426+0000 7f10dad45700 1 -- 172.21.15.29:0/2523773316 wait complete. 2023-10-08T15:40:10.436 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T15:40:10.625 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:10.624+0000 7f070a63a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T15:40:10.701 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:10.701+0000 7f070a63a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T15:40:11.139 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-08T15:40:11.138+0000 7fb54a22d700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T15:40:11.139 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-08T15:40:11.138+0000 7f5cb1549700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T15:40:11.140 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-08T15:40:11.140+0000 7fb544026700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:40:11.140 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-08T15:40:11.140+0000 7f5caab41700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:40:11.141 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-08T15:40:11.141+0000 7fcbf3489700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T15:40:11.142 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-08T15:40:11.141+0000 7f9350d5e700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T15:40:11.143 INFO:tasks.ceph.osd.1.smithi029.stderr:2023-10-08T15:40:11.143+0000 7fcbed282700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:40:11.143 INFO:tasks.ceph.osd.3.smithi029.stderr:2023-10-08T15:40:11.143+0000 7f934ab57700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:40:11.146 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-08T15:40:11.146+0000 7fdbf9383700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T15:40:11.146 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-08T15:40:11.146+0000 7f10c5167700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T15:40:11.147 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-08T15:40:11.147+0000 7fdbf297b700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:40:11.148 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-08T15:40:11.147+0000 7f10bef60700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:40:11.151 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-08T15:40:11.151+0000 7ff838df7700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T15:40:11.151 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-08T15:40:11.151+0000 7f7e68419700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T15:40:11.153 INFO:tasks.ceph.osd.2.smithi029.stderr:2023-10-08T15:40:11.152+0000 7ff832bf0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:40:11.153 INFO:tasks.ceph.osd.0.smithi029.stderr:2023-10-08T15:40:11.153+0000 7f7e62212700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T15:40:11.531 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:11.531+0000 7f070a63a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T15:40:11.604 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:11.604+0000 7f070a63a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T15:40:11.679 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:11.678+0000 7f070a63a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T15:40:11.810 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:11.810+0000 7f070a63a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T15:40:11.881 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:11.880+0000 7f2c0615f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T15:40:11.895 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:11.895+0000 7f070a63a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T15:40:11.961 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:11.961+0000 7f2c0615f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T15:40:12.043 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:12.042+0000 7f2c0615f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T15:40:12.047 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:12.047+0000 7f070a63a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T15:40:12.125 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:12.124+0000 7f070a63a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T15:40:12.206 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:12.206+0000 7f070a63a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T15:40:12.281 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:12.280+0000 7f070a63a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T15:40:12.800 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:12.800+0000 7f2c0615f180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T15:40:12.944 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:12.943+0000 7f2c0615f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T15:40:13.042 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:13.041+0000 7f2c0615f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T15:40:13.303 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:13.302+0000 7f2c0615f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T15:40:13.311 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:13.310+0000 7f06c3a3e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T15:40:13.311 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-08T15:40:13.311+0000 7f06c3a3e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T15:40:13.385 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:13.384+0000 7f2c0615f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T15:40:14.260 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:14.259+0000 7f2c0615f180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T15:40:14.337 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:14.336+0000 7f2c0615f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T15:40:14.415 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:14.415+0000 7f2c0615f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T15:40:14.554 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:14.554+0000 7f2c0615f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T15:40:14.661 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:14.660+0000 7f2c0615f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T15:40:14.817 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:14.817+0000 7f2c0615f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T15:40:14.896 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:14.895+0000 7f2c0615f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T15:40:14.973 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:14.973+0000 7f2c0615f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T15:40:15.051 INFO:tasks.ceph.mgr.y.smithi029.stderr:2023-10-08T15:40:15.050+0000 7f2c0615f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T15:40:17.243 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:17.365 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.365+0000 7f9becddc700 1 Processor -- start 2023-10-08T15:40:17.365 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.365+0000 7f9becddc700 1 -- start start 2023-10-08T15:40:17.367 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9becddc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9be80d1c30 0x7f9be80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.367 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9becddc700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be80c5d80 con 0x7f9be815a2b0 2023-10-08T15:40:17.367 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9becddc700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be80c6060 con 0x7f9be815a680 2023-10-08T15:40:17.367 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9becddc700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be8068470 con 0x7f9be80d1c30 2023-10-08T15:40:17.367 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9bdffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9be80d1c30 0x7f9be80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.367 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9be659c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9be815a2b0 0x7f9be80b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47846/0 (socket says 172.21.15.29:47846) 2023-10-08T15:40:17.367 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9be659c700 1 -- 172.21.15.29:0/1172914764 learned_addr learned my addr 172.21.15.29:0/1172914764 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:17.368 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9bdffff700 1 -- 172.21.15.29:0/1172914764 >> v1:172.21.15.183:6789/0 conn(0x7f9be815a680 legacy=0x7f9be80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.368 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9bdffff700 1 -- 172.21.15.29:0/1172914764 >> v1:172.21.15.29:6789/0 conn(0x7f9be815a2b0 legacy=0x7f9be80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.368 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9be5d9b700 1 -- 172.21.15.29:0/1172914764 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126273658 0 0) 0x7f9be80c5d80 con 0x7f9be815a2b0 2023-10-08T15:40:17.368 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9bdffff700 1 -- 172.21.15.29:0/1172914764 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be80c6340 con 0x7f9be80d1c30 2023-10-08T15:40:17.368 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.366+0000 7f9bdffff700 1 --2- 172.21.15.29:0/1172914764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be80ccdd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00098e0 tx=0x7f9bd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdad98722933785a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.368 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9be5d9b700 1 -- 172.21.15.29:0/1172914764 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0009e80 con 0x7f9be80d1c30 2023-10-08T15:40:17.368 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9be5d9b700 1 -- 172.21.15.29:0/1172914764 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd000b860 con 0x7f9be80d1c30 2023-10-08T15:40:17.368 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9be5d9b700 1 -- 172.21.15.29:0/1172914764 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000bbe0 con 0x7f9be80d1c30 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9becddc700 1 -- 172.21.15.29:0/1172914764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 msgr2=0x7f9be80ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9becddc700 1 --2- 172.21.15.29:0/1172914764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be80ccdd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00098e0 tx=0x7f9bd00091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9becddc700 1 -- 172.21.15.29:0/1172914764 shutdown_connections 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9becddc700 1 --2- 172.21.15.29:0/1172914764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be80ccdd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9becddc700 1 -- 172.21.15.29:0/1172914764 >> 172.21.15.29:0/1172914764 conn(0x7f9be8067e40 msgr2=0x7f9be80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9becddc700 1 -- 172.21.15.29:0/1172914764 shutdown_connections 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.367+0000 7f9becddc700 1 -- 172.21.15.29:0/1172914764 wait complete. 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.368+0000 7f9becddc700 1 Processor -- start 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.368+0000 7f9becddc700 1 -- start start 2023-10-08T15:40:17.371 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9becddc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be815bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9becddc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be815a2b0 0x7f9be815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9becddc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9be815a680 0x7f9be8157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9becddc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be80c9120 con 0x7f9be80d1c30 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9becddc700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be815d920 con 0x7f9be815a2b0 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9becddc700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be815c320 con 0x7f9be815a680 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9be659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be815bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9be659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be815bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52954/0 (socket says 172.21.15.29:52954) 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9be659c700 1 -- 172.21.15.29:0/3395293740 learned_addr learned my addr 172.21.15.29:0/3395293740 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9bdffff700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be815a2b0 0x7f9be815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.369+0000 7f9be6d9d700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9be815a680 0x7f9be8157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9be659c700 1 -- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9be815a680 msgr2=0x7f9be8157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.372 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9be659c700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9be815a680 0x7f9be8157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9be659c700 1 -- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be815a2b0 msgr2=0x7f9be815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9be659c700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be815a2b0 0x7f9be815d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9be659c700 1 -- 172.21.15.29:0/3395293740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0009420 con 0x7f9be80d1c30 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9be659c700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be815bd20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800c560 tx=0x7f9bd8007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9bde7fc700 1 -- 172.21.15.29:0/3395293740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd80072e0 con 0x7f9be80d1c30 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9bde7fc700 1 -- 172.21.15.29:0/3395293740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd8007460 con 0x7f9be80d1c30 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be815c600 con 0x7f9be80d1c30 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9bde7fc700 1 -- 172.21.15.29:0/3395293740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd80057f0 con 0x7f9be80d1c30 2023-10-08T15:40:17.373 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.370+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be815cbc0 con 0x7f9be80d1c30 2023-10-08T15:40:17.374 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.371+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be804c3c0 con 0x7f9be80d1c30 2023-10-08T15:40:17.374 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.371+0000 7f9bde7fc700 1 -- 172.21.15.29:0/3395293740 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9bd8005be0 con 0x7f9be80d1c30 2023-10-08T15:40:17.374 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.372+0000 7f9bde7fc700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9bc8066f30 0x7f9bc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:17.374 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.372+0000 7f9bde7fc700 1 -- 172.21.15.29:0/3395293740 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9bd8083520 con 0x7f9be80d1c30 2023-10-08T15:40:17.374 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.372+0000 7f9bdffff700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9bc8066f30 0x7f9bc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:17.375 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.372+0000 7f9bdffff700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9bc8066f30 0x7f9bc80693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9be80d2000 tx=0x7f9bd0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:17.377 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.376+0000 7f9bde7fc700 1 -- 172.21.15.29:0/3395293740 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bd8050ae0 con 0x7f9be80d1c30 2023-10-08T15:40:17.572 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.572+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9be80c7920 con 0x7f9be80d1c30 2023-10-08T15:40:17.573 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.573+0000 7f9bde7fc700 1 -- 172.21.15.29:0/3395293740 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f9bd8017020 con 0x7f9be80d1c30 2023-10-08T15:40:17.573 INFO:teuthology.misc.health.smithi029.stdout: 2023-10-08T15:40:17.573 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":16,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:15.139465+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:17.575 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9bc8066f30 msgr2=0x7f9bc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.575 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9bc8066f30 0x7f9bc80693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9be80d2000 tx=0x7f9bd0017000 comp rx=0 tx=0).stop 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 msgr2=0x7f9be815bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be815bd20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800c560 tx=0x7f9bd8007e30 comp rx=0 tx=0).stop 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 shutdown_connections 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9bc8066f30 0x7f9bc80693e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9be815a680 0x7f9be8157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9be80d1c30 0x7f9be815bd20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 --2- 172.21.15.29:0/3395293740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be815a2b0 0x7f9be815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 >> 172.21.15.29:0/3395293740 conn(0x7f9be8067e40 msgr2=0x7f9be806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 shutdown_connections 2023-10-08T15:40:17.576 INFO:teuthology.misc.health.smithi029.stderr:2023-10-08T15:40:17.575+0000 7f9becddc700 1 -- 172.21.15.29:0/3395293740 wait complete. 2023-10-08T15:40:17.586 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T15:40:17.586 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T15:40:17.586 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:40:17.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:40:17.588 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:40:17.589 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T15:40:17.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T15:40:17.590 INFO:tasks.ceph.mds.c:Started 2023-10-08T15:40:17.591 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:40:17.591 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:40:17.594 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:40:17.594 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T15:40:17.594 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T15:40:17.596 INFO:tasks.ceph.mds.d:Started 2023-10-08T15:40:17.596 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T15:40:17.596 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:17.664 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-08T15:40:17.664 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-08T15:40:17.678 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-10-08T15:40:17.678 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-10-08T15:40:17.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.720+0000 7f9e5ba71700 1 Processor -- start 2023-10-08T15:40:18.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.721+0000 7f9e5ba71700 1 -- start start 2023-10-08T15:40:18.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5ba71700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157870 0x7f9e5415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5ba71700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5415cbb0 con 0x7f9e5415a620 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5ba71700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5415bfa0 con 0x7f9e54157c40 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5ba71700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5415c280 con 0x7f9e54157870 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5900c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9e5415a620 0x7f9e5415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47862/0 (socket says 172.21.15.29:47862) 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5900c700 1 -- 172.21.15.29:0/3462179351 learned_addr learned my addr 172.21.15.29:0/3462179351 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5980d700 1 --2- 172.21.15.29:0/3462179351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157870 0x7f9e5415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5880b700 1 -- 172.21.15.29:0/3462179351 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508536238 0 0) 0x7f9e5415cbb0 con 0x7f9e5415a620 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5880b700 1 -- 172.21.15.29:0/3462179351 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e40003570 con 0x7f9e5415a620 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5880b700 1 -- 172.21.15.29:0/3462179351 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042544389 0 0) 0x7f9e5415bfa0 con 0x7f9e54157c40 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5880b700 1 -- 172.21.15.29:0/3462179351 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e5415cbb0 con 0x7f9e54157c40 2023-10-08T15:40:18.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5980d700 1 -- 172.21.15.29:0/3462179351 >> v1:172.21.15.183:6789/0 conn(0x7f9e54157c40 legacy=0x7f9e54158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5980d700 1 -- 172.21.15.29:0/3462179351 >> v1:172.21.15.29:6789/0 conn(0x7f9e5415a620 legacy=0x7f9e5415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5980d700 1 -- 172.21.15.29:0/3462179351 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5415c560 con 0x7f9e54157870 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.722+0000 7f9e5980d700 1 --2- 172.21.15.29:0/3462179351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157870 0x7f9e5415b6a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009910 tx=0x7f9e500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f166a77b4f6465f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5880b700 1 -- 172.21.15.29:0/3462179351 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50011630 con 0x7f9e54157870 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5880b700 1 -- 172.21.15.29:0/3462179351 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e50011790 con 0x7f9e54157870 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5880b700 1 -- 172.21.15.29:0/3462179351 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50011b30 con 0x7f9e54157870 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3462179351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157870 msgr2=0x7f9e5415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5ba71700 1 --2- 172.21.15.29:0/3462179351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157870 0x7f9e5415b6a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009910 tx=0x7f9e500091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3462179351 shutdown_connections 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5ba71700 1 --2- 172.21.15.29:0/3462179351 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157870 0x7f9e5415b6a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3462179351 >> 172.21.15.29:0/3462179351 conn(0x7f9e54068ce0 msgr2=0x7f9e540690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3462179351 shutdown_connections 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.723+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3462179351 wait complete. 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.724+0000 7f9e5ba71700 1 Processor -- start 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.724+0000 7f9e5ba71700 1 -- start start 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5ba71700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e54157870 0x7f9e5414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5ba71700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157c40 0x7f9e54153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5ba71700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e5415a620 0x7f9e54150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5ba71700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540b2a00 con 0x7f9e5415a620 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5ba71700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540b2ce0 con 0x7f9e54157870 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5ba71700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540b2fc0 con 0x7f9e54157c40 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5a00e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e5415a620 0x7f9e54150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5a00e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e5415a620 0x7f9e54150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53012/0 (socket says 172.21.15.29:53012) 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5a00e700 1 -- 172.21.15.29:0/3693905476 learned_addr learned my addr 172.21.15.29:0/3693905476 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:18.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5980d700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e54157870 0x7f9e5414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.725+0000 7f9e5900c700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157c40 0x7f9e54153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5a00e700 1 -- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157c40 msgr2=0x7f9e54153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5a00e700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157c40 0x7f9e54153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5a00e700 1 -- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e54157870 msgr2=0x7f9e5414e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5a00e700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e54157870 0x7f9e5414e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5a00e700 1 -- 172.21.15.29:0/3693905476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e50009420 con 0x7f9e5415a620 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5980d700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e54157870 0x7f9e5414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5a00e700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e5415a620 0x7f9e54150050 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c910 tx=0x7f9e4c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e49ffb700 1 -- 172.21.15.29:0/3693905476 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c00a7e0 con 0x7f9e5415a620 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e49ffb700 1 -- 172.21.15.29:0/3693905476 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c00a960 con 0x7f9e5415a620 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e49ffb700 1 -- 172.21.15.29:0/3693905476 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c00ad20 con 0x7f9e5415a620 2023-10-08T15:40:18.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e540b32a0 con 0x7f9e5415a620 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.726+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e54154260 con 0x7f9e5415a620 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.727+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5404c3c0 con 0x7f9e5415a620 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.727+0000 7f9e49ffb700 1 -- 172.21.15.29:0/3693905476 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e4c012630 con 0x7f9e5415a620 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.728+0000 7f9e49ffb700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.728+0000 7f9e49ffb700 1 -- 172.21.15.29:0/3693905476 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9e4c0846a0 con 0x7f9e5415a620 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.728+0000 7f9e5980d700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.728+0000 7f9e5980d700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e38066f30 0x7f9e380693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009860 tx=0x7f9e50017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.732+0000 7f9e49ffb700 1 -- 172.21.15.29:0/3693905476 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e4c051d10 con 0x7f9e5415a620 2023-10-08T15:40:18.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.926+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e5415c840 con 0x7f9e5415a620 2023-10-08T15:40:18.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.927+0000 7f9e49ffb700 1 -- 172.21.15.29:0/3693905476 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f9e4c055330 con 0x7f9e5415a620 2023-10-08T15:40:18.469 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:18.469 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:15.139465+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:18.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e38066f30 msgr2=0x7f9e380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e38066f30 0x7f9e380693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009860 tx=0x7f9e50017000 comp rx=0 tx=0).stop 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e5415a620 msgr2=0x7f9e54150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e5415a620 0x7f9e54150050 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c910 tx=0x7f9e4c0027a0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 shutdown_connections 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e5415a620 0x7f9e54150050 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e54157870 0x7f9e5414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 --2- 172.21.15.29:0/3693905476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e54157c40 0x7f9e54153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 >> 172.21.15.29:0/3693905476 conn(0x7f9e54068ce0 msgr2=0x7f9e540690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 shutdown_connections 2023-10-08T15:40:18.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:17.929+0000 7f9e5ba71700 1 -- 172.21.15.29:0/3693905476 wait complete. 2023-10-08T15:40:18.497 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:40:18.497 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.627+0000 7f1633573700 1 Processor -- start 2023-10-08T15:40:18.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.627+0000 7f1633573700 1 -- start start 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1633573700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 0x7f162c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1633573700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f162c15a290 0x7f162c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1633573700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0b0790 con 0x7f162c06a5a0 2023-10-08T15:40:18.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1633573700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c0ce1f0 con 0x7f162c15a290 2023-10-08T15:40:18.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1633573700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0b0b20 con 0x7f162c159ec0 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1630b0e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f162c15a290 0x7f162c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f163130f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 0x7f162c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1630b0e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f162c15a290 0x7f162c0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:48450/0 (socket says 172.21.15.29:48450) 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1630b0e700 1 -- 172.21.15.29:0/3407704243 learned_addr learned my addr 172.21.15.29:0/3407704243 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:18.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1631b10700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f162c06a5a0 0x7f162c15db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:42236/0 (socket says 172.21.15.29:42236) 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1630b0e700 1 -- 172.21.15.29:0/3407704243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 msgr2=0x7f162c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1630b0e700 1 --2- 172.21.15.29:0/3407704243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 0x7f162c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1630b0e700 1 -- 172.21.15.29:0/3407704243 >> v1:172.21.15.183:6789/0 conn(0x7f162c06a5a0 legacy=0x7f162c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.628+0000 7f1630b0e700 1 -- 172.21.15.29:0/3407704243 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0b04b0 con 0x7f162c15a290 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f1630b0e700 1 --2- 172.21.15.29:0/3407704243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c15a290 0x7f162c0afe80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16200099b0 tx=0x7f1620009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4051359a2612a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f162bfff700 1 -- 172.21.15.29:0/3407704243 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620009ea0 con 0x7f162c15a290 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f162bfff700 1 -- 172.21.15.29:0/3407704243 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162000b860 con 0x7f162c15a290 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f162bfff700 1 -- 172.21.15.29:0/3407704243 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000bc00 con 0x7f162c15a290 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f1633573700 1 -- 172.21.15.29:0/3407704243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c15a290 msgr2=0x7f162c0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f1633573700 1 --2- 172.21.15.29:0/3407704243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c15a290 0x7f162c0afe80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16200099b0 tx=0x7f1620009250 comp rx=0 tx=0).stop 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f1633573700 1 -- 172.21.15.29:0/3407704243 shutdown_connections 2023-10-08T15:40:18.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f1633573700 1 --2- 172.21.15.29:0/3407704243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 0x7f162c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f1633573700 1 --2- 172.21.15.29:0/3407704243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c15a290 0x7f162c0afe80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f1633573700 1 -- 172.21.15.29:0/3407704243 >> 172.21.15.29:0/3407704243 conn(0x7f162c0d1880 msgr2=0x7f162c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.629+0000 7f1633573700 1 -- 172.21.15.29:0/3407704243 shutdown_connections 2023-10-08T15:40:18.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.630+0000 7f1633573700 1 -- 172.21.15.29:0/3407704243 wait complete. 2023-10-08T15:40:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.631+0000 7f1633573700 1 Processor -- start 2023-10-08T15:40:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.631+0000 7f1633573700 1 -- start start 2023-10-08T15:40:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.631+0000 7f1633573700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c06a5a0 0x7f162c15e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.631+0000 7f1633573700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 0x7f162c15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.631+0000 7f1633573700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f162c15a290 0x7f162c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.631+0000 7f1633573700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c15ec10 con 0x7f162c15a290 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.631+0000 7f1633573700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c15eef0 con 0x7f162c06a5a0 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.631+0000 7f1633573700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c15f1d0 con 0x7f162c159ec0 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f1631b10700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f162c15a290 0x7f162c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f163130f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c06a5a0 0x7f162c15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f1631b10700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f162c15a290 0x7f162c156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57550/0 (socket says 172.21.15.29:57550) 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f163130f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c06a5a0 0x7f162c15e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:48454/0 (socket says 172.21.15.29:48454) 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f1631b10700 1 -- 172.21.15.29:0/452218902 learned_addr learned my addr 172.21.15.29:0/452218902 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f1630b0e700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 0x7f162c15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f163130f700 1 -- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 msgr2=0x7f162c15ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f163130f700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 0x7f162c15ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f163130f700 1 -- 172.21.15.29:0/452218902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f162c15a290 msgr2=0x7f162c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f163130f700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f162c15a290 0x7f162c156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f163130f700 1 -- 172.21.15.29:0/452218902 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200094f0 con 0x7f162c06a5a0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f163130f700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c06a5a0 0x7f162c15e330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f161c009ef0 tx=0x7f161c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f16297fa700 1 -- 172.21.15.29:0/452218902 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00cb70 con 0x7f162c06a5a0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f16297fa700 1 -- 172.21.15.29:0/452218902 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c00f040 con 0x7f162c06a5a0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c15f4b0 con 0x7f162c06a5a0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f16297fa700 1 -- 172.21.15.29:0/452218902 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c014480 con 0x7f162c06a5a0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.632+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c15e870 con 0x7f162c06a5a0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.633+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c0c8ff0 con 0x7f162c06a5a0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.634+0000 7f16297fa700 1 -- 172.21.15.29:0/452218902 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f161c014830 con 0x7f162c06a5a0 2023-10-08T15:40:18.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.634+0000 7f16297fa700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1618066f30 0x7f16180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.634+0000 7f16297fa700 1 -- 172.21.15.29:0/452218902 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f161c084e80 con 0x7f162c06a5a0 2023-10-08T15:40:18.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.634+0000 7f1630b0e700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1618066f30 0x7f16180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.635+0000 7f1630b0e700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1618066f30 0x7f16180693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f16200099b0 tx=0x7f1620017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.639+0000 7f16297fa700 1 -- 172.21.15.29:0/452218902 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f161c052440 con 0x7f162c06a5a0 2023-10-08T15:40:18.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.831+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f162c04c3c0 con 0x7f162c06a5a0 2023-10-08T15:40:18.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.832+0000 7f16297fa700 1 -- 172.21.15.29:0/452218902 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f161c055a60 con 0x7f162c06a5a0 2023-10-08T15:40:18.832 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:18.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.833+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1618066f30 msgr2=0x7f16180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1618066f30 0x7f16180693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f16200099b0 tx=0x7f1620017000 comp rx=0 tx=0).stop 2023-10-08T15:40:18.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c06a5a0 msgr2=0x7f162c15e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c06a5a0 0x7f162c15e330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f161c009ef0 tx=0x7f161c00b040 comp rx=0 tx=0).stop 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 shutdown_connections 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1618066f30 0x7f16180693e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f162c15a290 0x7f162c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f162c06a5a0 0x7f162c15e330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 --2- 172.21.15.29:0/452218902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f162c159ec0 0x7f162c15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 >> 172.21.15.29:0/452218902 conn(0x7f162c0d1880 msgr2=0x7f162c0b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 shutdown_connections 2023-10-08T15:40:18.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.834+0000 7f1633573700 1 -- 172.21.15.29:0/452218902 wait complete. 2023-10-08T15:40:18.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:18.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.967+0000 7ff2095e0700 1 Processor -- start 2023-10-08T15:40:18.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.967+0000 7ff2095e0700 1 -- start start 2023-10-08T15:40:18.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff2095e0700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff2040cd6e0 0x7ff2040cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff2095e0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff20415cbd0 0x7ff20415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff2095e0700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040cb7c0 con 0x7ff2040cdab0 2023-10-08T15:40:18.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff2095e0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20415e850 con 0x7ff20415cbd0 2023-10-08T15:40:18.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff2095e0700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2040cd030 con 0x7ff2040cd6e0 2023-10-08T15:40:18.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff208ddf700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff20415cbd0 0x7ff20415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff2037fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff2040cdab0 0x7ff20415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57480/0 (socket says 172.21.15.29:57480) 2023-10-08T15:40:18.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff208ddf700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff20415cbd0 0x7ff20415d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57558/0 (socket says 172.21.15.29:57558) 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff2037fe700 1 -- 172.21.15.29:0/1850905955 learned_addr learned my addr 172.21.15.29:0/1850905955 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff203fff700 1 --2- 172.21.15.29:0/1850905955 >> v2:172.21.15.183:3300/0 conn(0x7ff2040cd6e0 0x7ff2040cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff208ddf700 1 -- 172.21.15.29:0/1850905955 >> v2:172.21.15.183:3300/0 conn(0x7ff2040cd6e0 msgr2=0x7ff2040cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff208ddf700 1 --2- 172.21.15.29:0/1850905955 >> v2:172.21.15.183:3300/0 conn(0x7ff2040cd6e0 0x7ff2040cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff208ddf700 1 -- 172.21.15.29:0/1850905955 >> v1:172.21.15.29:6789/0 conn(0x7ff2040cdab0 legacy=0x7ff20415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff208ddf700 1 -- 172.21.15.29:0/1850905955 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20415e290 con 0x7ff20415cbd0 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff202ffd700 1 -- 172.21.15.29:0/1850905955 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979408161 0 0) 0x7ff2040cb7c0 con 0x7ff2040cdab0 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff203fff700 1 --2- 172.21.15.29:0/1850905955 >> v2:172.21.15.183:3300/0 conn(0x7ff2040cd6e0 0x7ff2040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.968+0000 7ff208ddf700 1 --2- 172.21.15.29:0/1850905955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff20415cbd0 0x7ff20415d050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff20406b730 tx=0x7ff1fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53c7bec16e9016f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff202ffd700 1 -- 172.21.15.29:0/1850905955 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00e070 con 0x7ff20415cbd0 2023-10-08T15:40:18.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff202ffd700 1 -- 172.21.15.29:0/1850905955 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00bc30 con 0x7ff20415cbd0 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff202ffd700 1 -- 172.21.15.29:0/1850905955 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc012430 con 0x7ff20415cbd0 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff2095e0700 1 -- 172.21.15.29:0/1850905955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff20415cbd0 msgr2=0x7ff20415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff2095e0700 1 --2- 172.21.15.29:0/1850905955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff20415cbd0 0x7ff20415d050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff20406b730 tx=0x7ff1fc009780 comp rx=0 tx=0).stop 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff2095e0700 1 -- 172.21.15.29:0/1850905955 shutdown_connections 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff2095e0700 1 --2- 172.21.15.29:0/1850905955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff20415cbd0 0x7ff20415d050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff2095e0700 1 --2- 172.21.15.29:0/1850905955 >> v2:172.21.15.183:3300/0 conn(0x7ff2040cd6e0 0x7ff2040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff2095e0700 1 -- 172.21.15.29:0/1850905955 >> 172.21.15.29:0/1850905955 conn(0x7ff204067660 msgr2=0x7ff204067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff2095e0700 1 -- 172.21.15.29:0/1850905955 shutdown_connections 2023-10-08T15:40:18.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.969+0000 7ff2095e0700 1 -- 172.21.15.29:0/1850905955 wait complete. 2023-10-08T15:40:18.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.970+0000 7ff2095e0700 1 Processor -- start 2023-10-08T15:40:18.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.970+0000 7ff2095e0700 1 -- start start 2023-10-08T15:40:18.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2095e0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2040cd6e0 0x7ff20414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2095e0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2040cdab0 0x7ff2040c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2095e0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff20415cbd0 0x7ff2040b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2095e0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040c87e0 con 0x7ff2040cdab0 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2095e0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040c8ac0 con 0x7ff20415cbd0 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2095e0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040c8da0 con 0x7ff2040cd6e0 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2037fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2040cdab0 0x7ff2040c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2037fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2040cdab0 0x7ff2040c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57562/0 (socket says 172.21.15.29:57562) 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.971+0000 7ff2037fe700 1 -- 172.21.15.29:0/58863454 learned_addr learned my addr 172.21.15.29:0/58863454 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff208ddf700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff20415cbd0 0x7ff2040b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff203fff700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2040cd6e0 0x7ff20414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff2037fe700 1 -- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2040cd6e0 msgr2=0x7ff20414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff2037fe700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2040cd6e0 0x7ff20414c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff2037fe700 1 -- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff20415cbd0 msgr2=0x7ff2040b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff2037fe700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff20415cbd0 0x7ff2040b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff2037fe700 1 -- 172.21.15.29:0/58863454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc009a20 con 0x7ff2040cdab0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff208ddf700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff20415cbd0 0x7ff2040b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff2037fe700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2040cdab0 0x7ff2040c7d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c7e0 tx=0x7ff1f8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff1ebfff700 1 -- 172.21.15.29:0/58863454 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8005b30 con 0x7ff2040cdab0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff1ebfff700 1 -- 172.21.15.29:0/58863454 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8005c90 con 0x7ff2040cdab0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2040c9080 con 0x7ff2040cdab0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff1ebfff700 1 -- 172.21.15.29:0/58863454 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8007300 con 0x7ff2040cdab0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.972+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20414cc20 con 0x7ff2040cdab0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.973+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff204089280 con 0x7ff2040cdab0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.974+0000 7ff1ebfff700 1 -- 172.21.15.29:0/58863454 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1f801b400 con 0x7ff2040cdab0 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.974+0000 7ff1ebfff700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.974+0000 7ff1ebfff700 1 -- 172.21.15.29:0/58863454 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff1f8083cf0 con 0x7ff2040cdab0 2023-10-08T15:40:18.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.974+0000 7ff203fff700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:18.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.975+0000 7ff203fff700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff1f0066f30 0x7ff1f00693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4006f00 tx=0x7ff1f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:18.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:18.978+0000 7ff1ebfff700 1 -- 172.21.15.29:0/58863454 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1f8088070 con 0x7ff2040cdab0 2023-10-08T15:40:19.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.215+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff20415e570 con 0x7ff2040cdab0 2023-10-08T15:40:19.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.215+0000 7ff1ebfff700 1 -- 172.21.15.29:0/58863454 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7ff1f8054dc0 con 0x7ff2040cdab0 2023-10-08T15:40:19.244 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:19.244 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-08T15:40:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.217+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff1f0066f30 msgr2=0x7ff1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.217+0000 7ff2095e0700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff1f0066f30 0x7ff1f00693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4006f00 tx=0x7ff1f4008040 comp rx=0 tx=0).stop 2023-10-08T15:40:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.217+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2040cdab0 msgr2=0x7ff2040c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.217+0000 7ff2095e0700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2040cdab0 0x7ff2040c7d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800c7e0 tx=0x7ff1f8007df0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.218+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 shutdown_connections 2023-10-08T15:40:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.218+0000 7ff2095e0700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.218+0000 7ff2095e0700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff20415cbd0 0x7ff2040b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.218+0000 7ff2095e0700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2040cd6e0 0x7ff20414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.218+0000 7ff2095e0700 1 --2- 172.21.15.29:0/58863454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2040cdab0 0x7ff2040c7d20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.218+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 >> 172.21.15.29:0/58863454 conn(0x7ff204067660 msgr2=0x7ff20415ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.218+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 shutdown_connections 2023-10-08T15:40:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.218+0000 7ff2095e0700 1 -- 172.21.15.29:0/58863454 wait complete. 2023-10-08T15:40:19.246 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 3 2023-10-08T15:40:19.247 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:19.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.364+0000 7fe727d21700 1 Processor -- start 2023-10-08T15:40:19.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.364+0000 7fe727d21700 1 -- start start 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.365+0000 7fe727d21700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe720158e50 0x7fe7200cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.365+0000 7fe727d21700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72006c010 con 0x7fe7201523e0 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.365+0000 7fe727d21700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72006bd10 con 0x7fe720152010 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.365+0000 7fe727d21700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72015c060 con 0x7fe720158e50 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.365+0000 7fe7262be700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe720158e50 0x7fe7200cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.365+0000 7fe7252bc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe7201523e0 0x7fe72006c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57488/0 (socket says 172.21.15.29:57488) 2023-10-08T15:40:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.365+0000 7fe7262be700 1 --2- 172.21.15.29:0/3513740158 >> v2:172.21.15.29:3300/0 conn(0x7fe720158e50 0x7fe7200cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57566/0 (socket says 172.21.15.29:57566) 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.365+0000 7fe7252bc700 1 -- 172.21.15.29:0/3513740158 learned_addr learned my addr 172.21.15.29:0/3513740158 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe7262be700 1 -- 172.21.15.29:0/3513740158 >> v1:172.21.15.183:6789/0 conn(0x7fe720152010 legacy=0x7fe72015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe7262be700 1 -- 172.21.15.29:0/3513740158 >> v1:172.21.15.29:6789/0 conn(0x7fe7201523e0 legacy=0x7fe72006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe7262be700 1 -- 172.21.15.29:0/3513740158 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72015c340 con 0x7fe720158e50 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe724abb700 1 -- 172.21.15.29:0/3513740158 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973813919 0 0) 0x7fe72006c010 con 0x7fe7201523e0 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe7262be700 1 --2- 172.21.15.29:0/3513740158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720158e50 0x7fe7200cb750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7100098e0 tx=0x7fe7100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3589b42870ff876c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe724abb700 1 -- 172.21.15.29:0/3513740158 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710009e80 con 0x7fe720158e50 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe724abb700 1 -- 172.21.15.29:0/3513740158 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71000b860 con 0x7fe720158e50 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe724abb700 1 -- 172.21.15.29:0/3513740158 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000bbe0 con 0x7fe720158e50 2023-10-08T15:40:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe727d21700 1 -- 172.21.15.29:0/3513740158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720158e50 msgr2=0x7fe7200cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe727d21700 1 --2- 172.21.15.29:0/3513740158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720158e50 0x7fe7200cb750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7100098e0 tx=0x7fe7100091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe727d21700 1 -- 172.21.15.29:0/3513740158 shutdown_connections 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.366+0000 7fe727d21700 1 --2- 172.21.15.29:0/3513740158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720158e50 0x7fe7200cb750 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.367+0000 7fe727d21700 1 -- 172.21.15.29:0/3513740158 >> 172.21.15.29:0/3513740158 conn(0x7fe720069870 msgr2=0x7fe720069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.367+0000 7fe727d21700 1 -- 172.21.15.29:0/3513740158 shutdown_connections 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.367+0000 7fe727d21700 1 -- 172.21.15.29:0/3513740158 wait complete. 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.368+0000 7fe727d21700 1 Processor -- start 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.368+0000 7fe727d21700 1 -- start start 2023-10-08T15:40:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.368+0000 7fe727d21700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720152010 0x7fe7200cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.368+0000 7fe727d21700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7201523e0 0x7fe7200b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.368+0000 7fe727d21700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe720158e50 0x7fe72014c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.368+0000 7fe727d21700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72014d1d0 con 0x7fe720152010 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.368+0000 7fe727d21700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72014d4b0 con 0x7fe720158e50 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.368+0000 7fe727d21700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72014d790 con 0x7fe7201523e0 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720152010 0x7fe7200cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720152010 0x7fe7200cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57580/0 (socket says 172.21.15.29:57580) 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 -- 172.21.15.29:0/226627831 learned_addr learned my addr 172.21.15.29:0/226627831 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe7262be700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe720158e50 0x7fe72014c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe7252bc700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7201523e0 0x7fe7200b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 -- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7201523e0 msgr2=0x7fe7200b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7201523e0 0x7fe7200b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 -- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe720158e50 msgr2=0x7fe72014c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe720158e50 0x7fe72014c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 -- 172.21.15.29:0/226627831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710009420 con 0x7fe720152010 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe725abd700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720152010 0x7fe7200cc940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe71800cb10 tx=0x7fe7180017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe71dffb700 1 -- 172.21.15.29:0/226627831 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800ce20 con 0x7fe720152010 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe71dffb700 1 -- 172.21.15.29:0/226627831 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71800a7e0 con 0x7fe720152010 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72014da70 con 0x7fe720152010 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe71dffb700 1 -- 172.21.15.29:0/226627831 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800aba0 con 0x7fe720152010 2023-10-08T15:40:19.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.369+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7200b3330 con 0x7fe720152010 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.370+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72014df90 con 0x7fe720152010 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.371+0000 7fe71dffb700 1 -- 172.21.15.29:0/226627831 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe718003030 con 0x7fe720152010 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.371+0000 7fe71dffb700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe70c066f30 0x7fe70c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.371+0000 7fe71dffb700 1 -- 172.21.15.29:0/226627831 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe718084170 con 0x7fe720152010 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.371+0000 7fe7252bc700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe70c066f30 0x7fe70c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.372+0000 7fe7252bc700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe70c066f30 0x7fe70c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe72006d890 tx=0x7fe714007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.375+0000 7fe71dffb700 1 -- 172.21.15.29:0/226627831 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe72014df90 con 0x7fe720152010 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.566+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe72014df90 con 0x7fe720152010 2023-10-08T15:40:19.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.567+0000 7fe71dffb700 1 -- 172.21.15.29:0/226627831 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fe72014df90 con 0x7fe720152010 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:19.800 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:15.139465+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:19.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe70c066f30 msgr2=0x7fe70c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe70c066f30 0x7fe70c0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe72006d890 tx=0x7fe714007d10 comp rx=0 tx=0).stop 2023-10-08T15:40:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720152010 msgr2=0x7fe7200cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720152010 0x7fe7200cc940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe71800cb10 tx=0x7fe7180017b0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 shutdown_connections 2023-10-08T15:40:19.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe70c066f30 0x7fe70c0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe720158e50 0x7fe72014c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe720152010 0x7fe7200cc940 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 --2- 172.21.15.29:0/226627831 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7201523e0 0x7fe7200b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:19.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 >> 172.21.15.29:0/226627831 conn(0x7fe720069870 msgr2=0x7fe7200caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:19.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 shutdown_connections 2023-10-08T15:40:19.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.569+0000 7fe727d21700 1 -- 172.21.15.29:0/226627831 wait complete. 2023-10-08T15:40:19.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:40:19.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:19.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.930+0000 7f26c129a700 1 Processor -- start 2023-10-08T15:40:20.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.930+0000 7f26c129a700 1 -- start start 2023-10-08T15:40:20.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26c129a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26bc15a290 0x7f26bc06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26c129a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc06aae0 0x7f26bc0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26c129a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc0b0790 con 0x7f26bc159ec0 2023-10-08T15:40:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26c129a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc06af60 con 0x7f26bc15a290 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26c129a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0ce1f0 con 0x7f26bc06aae0 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26ba7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f26bc15a290 0x7f26bc06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26baffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f26bc159ec0 0x7f26bc0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57502/0 (socket says 172.21.15.29:57502) 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26baffd700 1 -- 172.21.15.29:0/2078604567 learned_addr learned my addr 172.21.15.29:0/2078604567 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26bb7fe700 1 --2- 172.21.15.29:0/2078604567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc06aae0 0x7f26bc0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26ba7fc700 1 -- 172.21.15.29:0/2078604567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc06aae0 msgr2=0x7f26bc0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26ba7fc700 1 --2- 172.21.15.29:0/2078604567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc06aae0 0x7f26bc0cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26ba7fc700 1 -- 172.21.15.29:0/2078604567 >> v1:172.21.15.29:6789/0 conn(0x7f26bc159ec0 legacy=0x7f26bc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26ba7fc700 1 -- 172.21.15.29:0/2078604567 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0b0b20 con 0x7f26bc15a290 2023-10-08T15:40:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26b9ffb700 1 -- 172.21.15.29:0/2078604567 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394603875 0 0) 0x7f26bc0b0790 con 0x7f26bc159ec0 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26ba7fc700 1 --2- 172.21.15.29:0/2078604567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc15a290 0x7f26bc06a5a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f26b00098e0 tx=0x7f26b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b625a94fec92e48 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26b9ffb700 1 -- 172.21.15.29:0/2078604567 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0009e80 con 0x7f26bc15a290 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26b9ffb700 1 -- 172.21.15.29:0/2078604567 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b000b860 con 0x7f26bc15a290 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.931+0000 7f26b9ffb700 1 -- 172.21.15.29:0/2078604567 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000bbe0 con 0x7f26bc15a290 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.932+0000 7f26c129a700 1 -- 172.21.15.29:0/2078604567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc15a290 msgr2=0x7f26bc06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.932+0000 7f26c129a700 1 --2- 172.21.15.29:0/2078604567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc15a290 0x7f26bc06a5a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f26b00098e0 tx=0x7f26b00091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.932+0000 7f26c129a700 1 -- 172.21.15.29:0/2078604567 shutdown_connections 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.932+0000 7f26c129a700 1 --2- 172.21.15.29:0/2078604567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc06aae0 0x7f26bc0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.932+0000 7f26c129a700 1 --2- 172.21.15.29:0/2078604567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc15a290 0x7f26bc06a5a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.932+0000 7f26c129a700 1 -- 172.21.15.29:0/2078604567 >> 172.21.15.29:0/2078604567 conn(0x7f26bc0d1880 msgr2=0x7f26bc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.932+0000 7f26c129a700 1 -- 172.21.15.29:0/2078604567 shutdown_connections 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.932+0000 7f26c129a700 1 -- 172.21.15.29:0/2078604567 wait complete. 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.933+0000 7f26c129a700 1 Processor -- start 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.933+0000 7f26c129a700 1 -- start start 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26c129a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc06aae0 0x7f26bc0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26c129a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc159ec0 0x7f26bc0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26c129a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26bc15a290 0x7f26bc0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26c129a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0b4090 con 0x7f26bc06aae0 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26c129a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0b2680 con 0x7f26bc15a290 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26c129a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0b42c0 con 0x7f26bc159ec0 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc06aae0 0x7f26bc0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc06aae0 0x7f26bc0b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57606/0 (socket says 172.21.15.29:57606) 2023-10-08T15:40:20.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 -- 172.21.15.29:0/542119343 learned_addr learned my addr 172.21.15.29:0/542119343 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26ba7fc700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc159ec0 0x7f26bc0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 -- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc159ec0 msgr2=0x7f26bc0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc159ec0 0x7f26bc0b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26bb7fe700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26bc15a290 0x7f26bc0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 -- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26bc15a290 msgr2=0x7f26bc0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26bc15a290 0x7f26bc0b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 -- 172.21.15.29:0/542119343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b0009420 con 0x7f26bc06aae0 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.934+0000 7f26baffd700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc06aae0 0x7f26bc0b2b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c7e0 tx=0x7f26ac007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.935+0000 7f26a2ffd700 1 -- 172.21.15.29:0/542119343 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac005b30 con 0x7f26bc06aae0 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.935+0000 7f26a2ffd700 1 -- 172.21.15.29:0/542119343 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac005c90 con 0x7f26bc06aae0 2023-10-08T15:40:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.935+0000 7f26a2ffd700 1 -- 172.21.15.29:0/542119343 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac007300 con 0x7f26bc06aae0 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.935+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc0b1d50 con 0x7f26bc06aae0 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.935+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc0b2310 con 0x7f26bc06aae0 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.936+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc0b6a20 con 0x7f26bc06aae0 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.936+0000 7f26a2ffd700 1 -- 172.21.15.29:0/542119343 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26ac0076b0 con 0x7f26bc06aae0 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.936+0000 7f26a2ffd700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f26a8066f30 0x7f26a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.937+0000 7f26a2ffd700 1 -- 172.21.15.29:0/542119343 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f26ac083c80 con 0x7f26bc06aae0 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.937+0000 7f26ba7fc700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f26a8066f30 0x7f26a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.937+0000 7f26ba7fc700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f26a8066f30 0x7f26a80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0c5d70 tx=0x7f26b0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:19.941+0000 7f26a2ffd700 1 -- 172.21.15.29:0/542119343 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26ac0512c0 con 0x7f26bc06aae0 2023-10-08T15:40:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.130+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26bc04c3c0 con 0x7f26bc06aae0 2023-10-08T15:40:20.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.131+0000 7f26a2ffd700 1 -- 172.21.15.29:0/542119343 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26ac0548e0 con 0x7f26bc06aae0 2023-10-08T15:40:20.259 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:20.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f26a8066f30 msgr2=0x7f26a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f26a8066f30 0x7f26a80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0c5d70 tx=0x7f26b0017000 comp rx=0 tx=0).stop 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc06aae0 msgr2=0x7f26bc0b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc06aae0 0x7f26bc0b2b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c7e0 tx=0x7f26ac007df0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 shutdown_connections 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f26a8066f30 0x7f26a80693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26bc15a290 0x7f26bc0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26bc06aae0 0x7f26bc0b2b10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 --2- 172.21.15.29:0/542119343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26bc159ec0 0x7f26bc0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 >> 172.21.15.29:0/542119343 conn(0x7f26bc0d1880 msgr2=0x7f26bc1562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 shutdown_connections 2023-10-08T15:40:20.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.133+0000 7f26c129a700 1 -- 172.21.15.29:0/542119343 wait complete. 2023-10-08T15:40:20.262 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:40:20.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.380+0000 7f369ad76700 1 Processor -- start 2023-10-08T15:40:20.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.380+0000 7f369ad76700 1 -- start start 2023-10-08T15:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.381+0000 7f369ad76700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36940b0cd0 0x7f36940cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.381+0000 7f369ad76700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f369415b820 0x7f36940ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.381+0000 7f369ad76700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36940c9450 con 0x7f36940b10a0 2023-10-08T15:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.381+0000 7f369ad76700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940ce960 con 0x7f36940b0cd0 2023-10-08T15:40:20.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.381+0000 7f369ad76700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940cc520 con 0x7f369415b820 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.381+0000 7f3698b12700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36940b0cd0 0x7f36940cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.381+0000 7f3698b12700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36940b0cd0 0x7f36940cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57620/0 (socket says 172.21.15.29:57620) 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.381+0000 7f3698b12700 1 -- 172.21.15.29:0/2891992255 learned_addr learned my addr 172.21.15.29:0/2891992255 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f3698b12700 1 -- 172.21.15.29:0/2891992255 >> v2:172.21.15.183:3300/0 conn(0x7f369415b820 msgr2=0x7f36940ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f3698b12700 1 --2- 172.21.15.29:0/2891992255 >> v2:172.21.15.183:3300/0 conn(0x7f369415b820 0x7f36940ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f3698b12700 1 -- 172.21.15.29:0/2891992255 >> v1:172.21.15.183:6789/0 conn(0x7f36940b10a0 legacy=0x7f36940ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f3698b12700 1 -- 172.21.15.29:0/2891992255 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940cc910 con 0x7f36940b0cd0 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f3698b12700 1 --2- 172.21.15.29:0/2891992255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b0cd0 0x7f36940cb580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f369406f130 tx=0x7f367c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1050e74c215b06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f36937fe700 1 -- 172.21.15.29:0/2891992255 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c00b820 con 0x7f36940b0cd0 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f36937fe700 1 -- 172.21.15.29:0/2891992255 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c00b980 con 0x7f36940b0cd0 2023-10-08T15:40:20.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f36937fe700 1 -- 172.21.15.29:0/2891992255 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c00bd20 con 0x7f36940b0cd0 2023-10-08T15:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f369ad76700 1 -- 172.21.15.29:0/2891992255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b0cd0 msgr2=0x7f36940cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f369ad76700 1 --2- 172.21.15.29:0/2891992255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b0cd0 0x7f36940cb580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f369406f130 tx=0x7f367c009250 comp rx=0 tx=0).stop 2023-10-08T15:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f369ad76700 1 -- 172.21.15.29:0/2891992255 shutdown_connections 2023-10-08T15:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f369ad76700 1 --2- 172.21.15.29:0/2891992255 >> v2:172.21.15.183:3300/0 conn(0x7f369415b820 0x7f36940ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f369ad76700 1 --2- 172.21.15.29:0/2891992255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b0cd0 0x7f36940cb580 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f369ad76700 1 -- 172.21.15.29:0/2891992255 >> 172.21.15.29:0/2891992255 conn(0x7f369406fdc0 msgr2=0x7f369406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f369ad76700 1 -- 172.21.15.29:0/2891992255 shutdown_connections 2023-10-08T15:40:20.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.382+0000 7f369ad76700 1 -- 172.21.15.29:0/2891992255 wait complete. 2023-10-08T15:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.383+0000 7f369ad76700 1 Processor -- start 2023-10-08T15:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.384+0000 7f369ad76700 1 -- start start 2023-10-08T15:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.384+0000 7f369ad76700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36940b0cd0 0x7f36941573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.384+0000 7f369ad76700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b10a0 0x7f36940b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.384+0000 7f369ad76700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f369415b820 0x7f36940c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.384+0000 7f369ad76700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940c8010 con 0x7f36940b10a0 2023-10-08T15:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.384+0000 7f369ad76700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940c5cd0 con 0x7f36940b0cd0 2023-10-08T15:40:20.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.384+0000 7f369ad76700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3694169060 con 0x7f369415b820 2023-10-08T15:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.384+0000 7f3693fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b10a0 0x7f36940b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3693fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b10a0 0x7f36940b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57626/0 (socket says 172.21.15.29:57626) 2023-10-08T15:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3693fff700 1 -- 172.21.15.29:0/672499862 learned_addr learned my addr 172.21.15.29:0/672499862 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3698b12700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36940b0cd0 0x7f36941573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3699313700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f369415b820 0x7f36940c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3693fff700 1 -- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f369415b820 msgr2=0x7f36940c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3693fff700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f369415b820 0x7f36940c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3693fff700 1 -- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36940b0cd0 msgr2=0x7f36941573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3693fff700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36940b0cd0 0x7f36941573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3693fff700 1 -- 172.21.15.29:0/672499862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0094f0 con 0x7f36940b10a0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3693fff700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b10a0 0x7f36940b2fa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f368400bb80 tx=0x7f3684009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3690ff9700 1 -- 172.21.15.29:0/672499862 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400c8c0 con 0x7f36940b10a0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3690ff9700 1 -- 172.21.15.29:0/672499862 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400ca20 con 0x7f36940b10a0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f3690ff9700 1 -- 172.21.15.29:0/672499862 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400cdc0 con 0x7f36940b10a0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36940c6250 con 0x7f36940b10a0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.385+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3694157920 con 0x7f36940b10a0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.386+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3694157b40 con 0x7f36940b10a0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.387+0000 7f3690ff9700 1 -- 172.21.15.29:0/672499862 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3684014620 con 0x7f36940b10a0 2023-10-08T15:40:20.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.387+0000 7f3690ff9700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3674066f30 0x7f36740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.387+0000 7f3690ff9700 1 -- 172.21.15.29:0/672499862 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3684084260 con 0x7f36940b10a0 2023-10-08T15:40:20.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.387+0000 7f3698b12700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3674066f30 0x7f36740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.388+0000 7f3698b12700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3674066f30 0x7f36740693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f369406f130 tx=0x7f367c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.391+0000 7f3690ff9700 1 -- 172.21.15.29:0/672499862 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f368404c5a0 con 0x7f36940b10a0 2023-10-08T15:40:20.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.586+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f36940c6440 con 0x7f36940b10a0 2023-10-08T15:40:20.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.586+0000 7f3690ff9700 1 -- 172.21.15.29:0/672499862 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3684051820 con 0x7f36940b10a0 2023-10-08T15:40:20.587 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:20.587 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-08T15:40:20.587 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:40:20.587 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-08T15:40:20.588 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-08T15:40:20.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:40:20.588 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-08T15:40:20.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.588+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3674066f30 msgr2=0x7f36740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.588+0000 7f369ad76700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3674066f30 0x7f36740693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f369406f130 tx=0x7f367c016000 comp rx=0 tx=0).stop 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b10a0 msgr2=0x7f36940b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b10a0 0x7f36940b2fa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f368400bb80 tx=0x7f3684009810 comp rx=0 tx=0).stop 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 shutdown_connections 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3674066f30 0x7f36740693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f369415b820 0x7f36940c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36940b0cd0 0x7f36941573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 --2- 172.21.15.29:0/672499862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36940b10a0 0x7f36940b2fa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 >> 172.21.15.29:0/672499862 conn(0x7f369406fdc0 msgr2=0x7f36940cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 shutdown_connections 2023-10-08T15:40:20.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.589+0000 7f369ad76700 1 -- 172.21.15.29:0/672499862 wait complete. 2023-10-08T15:40:20.601 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:40:20.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:40:20.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.724+0000 7f7aafa6d700 1 Processor -- start 2023-10-08T15:40:20.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.724+0000 7f7aafa6d700 1 -- start start 2023-10-08T15:40:20.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aafa6d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8159ef0 0x7f7aa815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aafa6d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7aa80b6a10 0x7f7aa80b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aafa6d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7aa80b15e0 0x7f7aa80b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aafa6d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa80b1a60 con 0x7f7aa80b15e0 2023-10-08T15:40:20.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aafa6d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa80b1d40 con 0x7f7aa80b6a10 2023-10-08T15:40:20.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aafa6d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa80b2020 con 0x7f7aa8159ef0 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7aa80b15e0 0x7f7aa80b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7aa80b15e0 0x7f7aa80b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57640/0 (socket says 172.21.15.29:57640) 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 -- 172.21.15.29:0/2048042121 learned_addr learned my addr 172.21.15.29:0/2048042121 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aad008700 1 --2- 172.21.15.29:0/2048042121 >> v2:172.21.15.183:3300/0 conn(0x7f7aa80b6a10 0x7f7aa80b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aad809700 1 --2- 172.21.15.29:0/2048042121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8159ef0 0x7f7aa815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 -- 172.21.15.29:0/2048042121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8159ef0 msgr2=0x7f7aa815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 --2- 172.21.15.29:0/2048042121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8159ef0 0x7f7aa815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 -- 172.21.15.29:0/2048042121 >> v2:172.21.15.183:3300/0 conn(0x7f7aa80b6a10 msgr2=0x7f7aa80b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 --2- 172.21.15.29:0/2048042121 >> v2:172.21.15.183:3300/0 conn(0x7f7aa80b6a10 0x7f7aa80b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 -- 172.21.15.29:0/2048042121 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa80b2300 con 0x7f7aa80b15e0 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aad008700 1 --2- 172.21.15.29:0/2048042121 >> v2:172.21.15.183:3300/0 conn(0x7f7aa80b6a10 0x7f7aa80b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aae00a700 1 --2- 172.21.15.29:0/2048042121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa80b15e0 0x7f7aa80b46f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80894b0 tx=0x7f7aa0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859bdb17602c6e3d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aac807700 1 -- 172.21.15.29:0/2048042121 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000b860 con 0x7f7aa80b15e0 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aac807700 1 -- 172.21.15.29:0/2048042121 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa000b9c0 con 0x7f7aa80b15e0 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.725+0000 7f7aac807700 1 -- 172.21.15.29:0/2048042121 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000bd60 con 0x7f7aa80b15e0 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 -- 172.21.15.29:0/2048042121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa80b15e0 msgr2=0x7f7aa80b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/2048042121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa80b15e0 0x7f7aa80b46f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80894b0 tx=0x7f7aa0009250 comp rx=0 tx=0).stop 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 -- 172.21.15.29:0/2048042121 shutdown_connections 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/2048042121 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa80b15e0 0x7f7aa80b46f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/2048042121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa8159ef0 0x7f7aa815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/2048042121 >> v2:172.21.15.183:3300/0 conn(0x7f7aa80b6a10 0x7f7aa80b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 -- 172.21.15.29:0/2048042121 >> 172.21.15.29:0/2048042121 conn(0x7f7aa809a0a0 msgr2=0x7f7aa8067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 -- 172.21.15.29:0/2048042121 shutdown_connections 2023-10-08T15:40:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.726+0000 7f7aafa6d700 1 -- 172.21.15.29:0/2048042121 wait complete. 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.727+0000 7f7aafa6d700 1 Processor -- start 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.727+0000 7f7aafa6d700 1 -- start start 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aafa6d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa80b6a10 0x7f7aa814a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aafa6d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa8159ef0 0x7f7aa809efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aafa6d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa80ad640 0x7f7aa809daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aafa6d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa816c0c0 con 0x7f7aa8159ef0 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aafa6d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa816b1d0 con 0x7f7aa80ad640 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aafa6d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa816b4b0 con 0x7f7aa80b6a10 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa8159ef0 0x7f7aa809efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa8159ef0 0x7f7aa809efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57644/0 (socket says 172.21.15.29:57644) 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 -- 172.21.15.29:0/3114255623 learned_addr learned my addr 172.21.15.29:0/3114255623 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aae00a700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa80ad640 0x7f7aa809daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad809700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa80b6a10 0x7f7aa814a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 -- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa80b6a10 msgr2=0x7f7aa814a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa80b6a10 0x7f7aa814a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 -- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa80ad640 msgr2=0x7f7aa809daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa80ad640 0x7f7aa809daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 -- 172.21.15.29:0/3114255623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa00094f0 con 0x7f7aa8159ef0 2023-10-08T15:40:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aae00a700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa80ad640 0x7f7aa809daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aad008700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa8159ef0 0x7f7aa809efa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00e8d0 tx=0x7f7a9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.728+0000 7f7aa5ffb700 1 -- 172.21.15.29:0/3114255623 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00ee70 con 0x7f7aa8159ef0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.729+0000 7f7aa5ffb700 1 -- 172.21.15.29:0/3114255623 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c00c5e0 con 0x7f7aa8159ef0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.729+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa816b790 con 0x7f7aa8159ef0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.729+0000 7f7aa5ffb700 1 -- 172.21.15.29:0/3114255623 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00c980 con 0x7f7aa8159ef0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.729+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa816bd50 con 0x7f7aa8159ef0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.730+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa804c3c0 con 0x7f7aa8159ef0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.730+0000 7f7aa5ffb700 1 -- 172.21.15.29:0/3114255623 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a9c013410 con 0x7f7aa8159ef0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.730+0000 7f7aa5ffb700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7a94066f30 0x7f7a940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.730+0000 7f7aa5ffb700 1 -- 172.21.15.29:0/3114255623 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7a9c084040 con 0x7f7aa8159ef0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.731+0000 7f7aad809700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7a94066f30 0x7f7a940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.731+0000 7f7aad809700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7a94066f30 0x7f7a940693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80ad160 tx=0x7f7a9800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:20.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.734+0000 7f7aa5ffb700 1 -- 172.21.15.29:0/3114255623 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a9c051600 con 0x7f7aa8159ef0 2023-10-08T15:40:20.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:20.926+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7aa816c200 con 0x7f7aa8159ef0 2023-10-08T15:40:21.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.682+0000 7f7aa5ffb700 1 -- 172.21.15.29:0/3114255623 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7a9c054c20 con 0x7f7aa8159ef0 2023-10-08T15:40:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7a94066f30 msgr2=0x7f7a940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7a94066f30 0x7f7a940693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80ad160 tx=0x7f7a9800b040 comp rx=0 tx=0).stop 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa8159ef0 msgr2=0x7f7aa809efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa8159ef0 0x7f7aa809efa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00e8d0 tx=0x7f7a9c008040 comp rx=0 tx=0).stop 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 shutdown_connections 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7a94066f30 0x7f7a940693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa80ad640 0x7f7aa809daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aa80b6a10 0x7f7aa814a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 --2- 172.21.15.29:0/3114255623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa8159ef0 0x7f7aa809efa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 >> 172.21.15.29:0/3114255623 conn(0x7f7aa809a0a0 msgr2=0x7f7aa80b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 shutdown_connections 2023-10-08T15:40:21.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.686+0000 7f7aafa6d700 1 -- 172.21.15.29:0/3114255623 wait complete. 2023-10-08T15:40:21.688 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-08T15:40:21.702 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:40:21.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.847+0000 7f01c74ed700 1 Processor -- start 2023-10-08T15:40:21.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.848+0000 7f01c74ed700 1 -- start start 2023-10-08T15:40:21.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.848+0000 7f01c74ed700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f01c0156160 0x7f01c0156530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:21.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.848+0000 7f01c74ed700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c00cc440 con 0x7f01c00cb280 2023-10-08T15:40:21.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.848+0000 7f01c74ed700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c00cb830 con 0x7f01c00c71d0 2023-10-08T15:40:21.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.848+0000 7f01c74ed700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c00c31a0 con 0x7f01c0156160 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01c4a88700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f01c00cb280 0x7f01c00c2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57510/0 (socket says 172.21.15.29:57510) 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01c4a88700 1 -- 172.21.15.29:0/2360860815 learned_addr learned my addr 172.21.15.29:0/2360860815 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01c5289700 1 --2- 172.21.15.29:0/2360860815 >> v2:172.21.15.183:3300/0 conn(0x7f01c0156160 0x7f01c0156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975361981 0 0) 0x7f01c00cc440 con 0x7f01c00cb280 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a8003570 con 0x7f01c00cb280 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059995045 0 0) 0x7f01c00cb830 con 0x7f01c00c71d0 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c00cc440 con 0x7f01c00c71d0 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1778927005 0 0) 0x7f01a8003570 con 0x7f01c00cb280 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 >> v2:172.21.15.183:3300/0 conn(0x7f01c0156160 msgr2=0x7f01c0156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 --2- 172.21.15.29:0/2360860815 >> v2:172.21.15.183:3300/0 conn(0x7f01c0156160 0x7f01c0156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 >> v1:172.21.15.183:6789/0 conn(0x7f01c00c71d0 legacy=0x7f01c006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:21.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c00cbb10 con 0x7f01c00cb280 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f01b4001470 con 0x7f01c00cb280 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 >> v1:172.21.15.29:6789/0 conn(0x7f01c00cb280 legacy=0x7f01c00c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8003c40 0x7f01a8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01a8004810 0x7f01a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8005210 0x7f01a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c00c31a0 con 0x7f01a8004810 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a800c1b0 con 0x7f01a8005210 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a800e580 con 0x7f01a8003c40 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01c4a88700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01a8004810 0x7f01a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01c5289700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8003c40 0x7f01a8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:21.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.849+0000 7f01c5a8a700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8005210 0x7f01a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c4a88700 1 -- 172.21.15.29:0/2360860815 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8003c40 msgr2=0x7f01a8004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c4a88700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8003c40 0x7f01a8004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c4a88700 1 -- 172.21.15.29:0/2360860815 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8005210 msgr2=0x7f01a800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c4a88700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8005210 0x7f01a800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c5a8a700 1 -- 172.21.15.29:0/2360860815 reap_dead start 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c4a88700 1 -- 172.21.15.29:0/2360860815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8003570 con 0x7f01a8004810 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c4a88700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01a8004810 0x7f01a8004c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f01b4007fd0 tx=0x7f01b4001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7edac5449f1205 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b400ca80 con 0x7f01a8004810 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b400cbe0 con 0x7f01a8004810 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01bffff700 1 -- 172.21.15.29:0/2360860815 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4005920 con 0x7f01a8004810 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c74ed700 1 -- 172.21.15.29:0/2360860815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01a8004810 msgr2=0x7f01a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c74ed700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01a8004810 0x7f01a8004c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f01b4007fd0 tx=0x7f01b4001d40 comp rx=0 tx=0).stop 2023-10-08T15:40:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c74ed700 1 -- 172.21.15.29:0/2360860815 shutdown_connections 2023-10-08T15:40:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c74ed700 1 --2- 172.21.15.29:0/2360860815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01a8004810 0x7f01a8004c80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.850+0000 7f01c74ed700 1 -- 172.21.15.29:0/2360860815 >> 172.21.15.29:0/2360860815 conn(0x7f01c0067660 msgr2=0x7f01c0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.851+0000 7f01c74ed700 1 -- 172.21.15.29:0/2360860815 shutdown_connections 2023-10-08T15:40:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.851+0000 7f01c74ed700 1 -- 172.21.15.29:0/2360860815 wait complete. 2023-10-08T15:40:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.852+0000 7f01c74ed700 1 Processor -- start 2023-10-08T15:40:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.852+0000 7f01c74ed700 1 -- start start 2023-10-08T15:40:21.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.852+0000 7f01c74ed700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8004810 0x7f01c00b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.852+0000 7f01c74ed700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0164320 0x7f01c006a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c74ed700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01c006a780 0x7f01c00c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c74ed700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c006ac00 con 0x7f01c006a780 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c74ed700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c016b330 con 0x7f01a8004810 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c74ed700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c016a7b0 con 0x7f01c0164320 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01c006a780 0x7f01c00c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01c006a780 0x7f01c00c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57662/0 (socket says 172.21.15.29:57662) 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 -- 172.21.15.29:0/1044678808 learned_addr learned my addr 172.21.15.29:0/1044678808 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c4a88700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0164320 0x7f01c006a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5289700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8004810 0x7f01c00b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 -- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0164320 msgr2=0x7f01c006a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:21.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0164320 0x7f01c006a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 -- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8004810 msgr2=0x7f01c00b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8004810 0x7f01c00b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 -- 172.21.15.29:0/1044678808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c016aa90 con 0x7f01c006a780 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c5a8a700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01c006a780 0x7f01c00c4a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01c00c9350 tx=0x7f01b8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01bd7fa700 1 -- 172.21.15.29:0/1044678808 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8006820 con 0x7f01c006a780 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01bd7fa700 1 -- 172.21.15.29:0/1044678808 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b8006980 con 0x7f01c006a780 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c016ad70 con 0x7f01c006a780 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01bd7fa700 1 -- 172.21.15.29:0/1044678808 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8006d20 con 0x7f01c006a780 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.853+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c0164790 con 0x7f01c006a780 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.854+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c00b1350 con 0x7f01c006a780 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.855+0000 7f01bd7fa700 1 -- 172.21.15.29:0/1044678808 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01b8007240 con 0x7f01c006a780 2023-10-08T15:40:21.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.855+0000 7f01bd7fa700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f01ac066f30 0x7f01ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:21.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.855+0000 7f01bd7fa700 1 -- 172.21.15.29:0/1044678808 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f01b8083880 con 0x7f01c006a780 2023-10-08T15:40:21.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.855+0000 7f01c5289700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f01ac066f30 0x7f01ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:21.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.856+0000 7f01c5289700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f01ac066f30 0x7f01ac0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f01c006afb0 tx=0x7f01b000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:21.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:21.860+0000 7f01bd7fa700 1 -- 172.21.15.29:0/1044678808 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01c00b1350 con 0x7f01c006a780 2023-10-08T15:40:22.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.051+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f01c00b1350 con 0x7f01c006a780 2023-10-08T15:40:22.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.688+0000 7f01bd7fa700 1 -- 172.21.15.29:0/1044678808 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f01c00b1350 con 0x7f01c006a780 2023-10-08T15:40:22.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.698+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f01ac066f30 msgr2=0x7f01ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:22.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.698+0000 7f01c74ed700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f01ac066f30 0x7f01ac0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f01c006afb0 tx=0x7f01b000b040 comp rx=0 tx=0).stop 2023-10-08T15:40:22.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.698+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01c006a780 msgr2=0x7f01c00c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:22.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.698+0000 7f01c74ed700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01c006a780 0x7f01c00c4a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01c00c9350 tx=0x7f01b8009040 comp rx=0 tx=0).stop 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.699+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 shutdown_connections 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.699+0000 7f01c74ed700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f01ac066f30 0x7f01ac0693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.699+0000 7f01c74ed700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01c006a780 0x7f01c00c4a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.699+0000 7f01c74ed700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a8004810 0x7f01c00b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.699+0000 7f01c74ed700 1 --2- 172.21.15.29:0/1044678808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0164320 0x7f01c006a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.699+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 >> 172.21.15.29:0/1044678808 conn(0x7f01c0067660 msgr2=0x7f01c0069170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.699+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 shutdown_connections 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.699+0000 7f01c74ed700 1 -- 172.21.15.29:0/1044678808 wait complete. 2023-10-08T15:40:22.700 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-08T15:40:22.713 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:40:22.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.835+0000 7fcb6a6d7700 1 Processor -- start 2023-10-08T15:40:22.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.836+0000 7fcb6a6d7700 1 -- start start 2023-10-08T15:40:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.836+0000 7fcb6a6d7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb640711c0 0x7fcb6406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.836+0000 7fcb6a6d7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcb6406c8c0 0x7fcb6415a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.836+0000 7fcb6a6d7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb64070d30 con 0x7fcb64159c30 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.836+0000 7fcb6a6d7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6406cd40 con 0x7fcb640711c0 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.836+0000 7fcb6a6d7700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb64070700 con 0x7fcb6406c8c0 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.836+0000 7fcb637fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb640711c0 0x7fcb6406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.836+0000 7fcb63fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcb64159c30 0x7fcb6406ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57518/0 (socket says 172.21.15.29:57518) 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb63fff700 1 -- 172.21.15.29:0/2780176551 learned_addr learned my addr 172.21.15.29:0/2780176551 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb637fe700 1 -- 172.21.15.29:0/2780176551 >> v2:172.21.15.183:3300/0 conn(0x7fcb6406c8c0 msgr2=0x7fcb6415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb68c74700 1 --2- 172.21.15.29:0/2780176551 >> v2:172.21.15.183:3300/0 conn(0x7fcb6406c8c0 0x7fcb6415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb62ffd700 1 -- 172.21.15.29:0/2780176551 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675427110 0 0) 0x7fcb64070d30 con 0x7fcb64159c30 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb637fe700 1 --2- 172.21.15.29:0/2780176551 >> v2:172.21.15.183:3300/0 conn(0x7fcb6406c8c0 0x7fcb6415a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb637fe700 1 -- 172.21.15.29:0/2780176551 >> v1:172.21.15.29:6789/0 conn(0x7fcb64159c30 legacy=0x7fcb6406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb637fe700 1 -- 172.21.15.29:0/2780176551 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6406f710 con 0x7fcb640711c0 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb68c74700 1 --2- 172.21.15.29:0/2780176551 >> v2:172.21.15.183:3300/0 conn(0x7fcb6406c8c0 0x7fcb6415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb637fe700 1 --2- 172.21.15.29:0/2780176551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb6406c380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb64070ca0 tx=0x7fcb540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc72b543cbf2319 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb62ffd700 1 -- 172.21.15.29:0/2780176551 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400b6b0 con 0x7fcb640711c0 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb62ffd700 1 -- 172.21.15.29:0/2780176551 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5400b810 con 0x7fcb640711c0 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.837+0000 7fcb62ffd700 1 -- 172.21.15.29:0/2780176551 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400bbb0 con 0x7fcb640711c0 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.838+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/2780176551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 msgr2=0x7fcb6406c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.838+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/2780176551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb6406c380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb64070ca0 tx=0x7fcb540091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.838+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/2780176551 shutdown_connections 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.838+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/2780176551 >> v2:172.21.15.183:3300/0 conn(0x7fcb6406c8c0 0x7fcb6415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.838+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/2780176551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb6406c380 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.838+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/2780176551 >> 172.21.15.29:0/2780176551 conn(0x7fcb640cb030 msgr2=0x7fcb6406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.838+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/2780176551 shutdown_connections 2023-10-08T15:40:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.838+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/2780176551 wait complete. 2023-10-08T15:40:22.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.839+0000 7fcb6a6d7700 1 Processor -- start 2023-10-08T15:40:22.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.839+0000 7fcb6a6d7700 1 -- start start 2023-10-08T15:40:22.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb6a6d7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb6406c8c0 0x7fcb64149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:22.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb6a6d7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb640ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:22.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb6a6d7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb64159c30 0x7fcb640b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb6a6d7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640ad7d0 con 0x7fcb640711c0 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb6a6d7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640ad1c0 con 0x7fcb6406c8c0 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb6a6d7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640af3e0 con 0x7fcb64159c30 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb640ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb640ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57682/0 (socket says 172.21.15.29:57682) 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 -- 172.21.15.29:0/667041198 learned_addr learned my addr 172.21.15.29:0/667041198 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb63fff700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb6406c8c0 0x7fcb64149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb68c74700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb64159c30 0x7fcb640b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 -- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb64159c30 msgr2=0x7fcb640b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:22.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb64159c30 0x7fcb640b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 -- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb6406c8c0 msgr2=0x7fcb64149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb6406c8c0 0x7fcb64149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 -- 172.21.15.29:0/667041198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54009420 con 0x7fcb640711c0 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb68c74700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb64159c30 0x7fcb640b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb637fe700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb640ae990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcb64072020 tx=0x7fcb54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb5bfff700 1 -- 172.21.15.29:0/667041198 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400bb90 con 0x7fcb640711c0 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb5bfff700 1 -- 172.21.15.29:0/667041198 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb54011420 con 0x7fcb640711c0 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb640ad460 con 0x7fcb640711c0 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.840+0000 7fcb5bfff700 1 -- 172.21.15.29:0/667041198 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb540117a0 con 0x7fcb640711c0 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.841+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb64156700 con 0x7fcb640711c0 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.841+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6404c3c0 con 0x7fcb640711c0 2023-10-08T15:40:22.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.842+0000 7fcb5bfff700 1 -- 172.21.15.29:0/667041198 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb54011b90 con 0x7fcb640711c0 2023-10-08T15:40:22.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.842+0000 7fcb5bfff700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcb44066f30 0x7fcb440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:22.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.842+0000 7fcb5bfff700 1 -- 172.21.15.29:0/667041198 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fcb540860e0 con 0x7fcb640711c0 2023-10-08T15:40:22.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.843+0000 7fcb63fff700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcb44066f30 0x7fcb440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:22.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.843+0000 7fcb63fff700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcb44066f30 0x7fcb440693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c007160 tx=0x7fcb4c007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:22.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:22.847+0000 7fcb5bfff700 1 -- 172.21.15.29:0/667041198 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb54053390 con 0x7fcb640711c0 2023-10-08T15:40:23.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.083+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcb640ad910 con 0x7fcb640711c0 2023-10-08T15:40:23.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.689+0000 7fcb5bfff700 1 -- 172.21.15.29:0/667041198 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcb540569b0 con 0x7fcb640711c0 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcb44066f30 msgr2=0x7fcb440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcb44066f30 0x7fcb440693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c007160 tx=0x7fcb4c007f50 comp rx=0 tx=0).stop 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 msgr2=0x7fcb640ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb640ae990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcb64072020 tx=0x7fcb54017000 comp rx=0 tx=0).stop 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 shutdown_connections 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcb44066f30 0x7fcb440693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb64159c30 0x7fcb640b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb6406c8c0 0x7fcb64149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 --2- 172.21.15.29:0/667041198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb640711c0 0x7fcb640ae990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.694+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 >> 172.21.15.29:0/667041198 conn(0x7fcb640cb030 msgr2=0x7fcb640ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:23.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.695+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 shutdown_connections 2023-10-08T15:40:23.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.695+0000 7fcb6a6d7700 1 -- 172.21.15.29:0/667041198 wait complete. 2023-10-08T15:40:23.700 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T15:40:23.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.893+0000 7ff47496a700 1 Processor -- start 2023-10-08T15:40:23.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.893+0000 7ff47496a700 1 -- start start 2023-10-08T15:40:23.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.894+0000 7ff47496a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff470157870 0x7ff47015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.894+0000 7ff47496a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff47015a620 0x7ff47015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.894+0000 7ff47496a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47015cbb0 con 0x7ff47015d580 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.894+0000 7ff47496a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47015bfa0 con 0x7ff470157870 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.894+0000 7ff47496a700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47015c280 con 0x7ff47015a620 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.894+0000 7ff46e59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff470157870 0x7ff47015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.894+0000 7ff46ed9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff47015d580 0x7ff470158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57532/0 (socket says 172.21.15.29:57532) 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.894+0000 7ff46ed9d700 1 -- 172.21.15.29:0/481083400 learned_addr learned my addr 172.21.15.29:0/481083400 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46dd9b700 1 --2- 172.21.15.29:0/481083400 >> v2:172.21.15.183:3300/0 conn(0x7ff47015a620 0x7ff47015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46e59c700 1 -- 172.21.15.29:0/481083400 >> v2:172.21.15.183:3300/0 conn(0x7ff47015a620 msgr2=0x7ff47015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46e59c700 1 --2- 172.21.15.29:0/481083400 >> v2:172.21.15.183:3300/0 conn(0x7ff47015a620 0x7ff47015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46e59c700 1 -- 172.21.15.29:0/481083400 >> v1:172.21.15.29:6789/0 conn(0x7ff47015d580 legacy=0x7ff470158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46e59c700 1 -- 172.21.15.29:0/481083400 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47015c560 con 0x7ff470157870 2023-10-08T15:40:23.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46dd9b700 1 --2- 172.21.15.29:0/481083400 >> v2:172.21.15.183:3300/0 conn(0x7ff47015a620 0x7ff47015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46d59a700 1 -- 172.21.15.29:0/481083400 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283069536 0 0) 0x7ff47015cbb0 con 0x7ff47015d580 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46e59c700 1 --2- 172.21.15.29:0/481083400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47015b6a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff47015cb20 tx=0x7ff460009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36eccf5b0e924a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46d59a700 1 -- 172.21.15.29:0/481083400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000e070 con 0x7ff470157870 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46d59a700 1 -- 172.21.15.29:0/481083400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46000bc30 con 0x7ff470157870 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff46d59a700 1 -- 172.21.15.29:0/481083400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460012430 con 0x7ff470157870 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff47496a700 1 -- 172.21.15.29:0/481083400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 msgr2=0x7ff47015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.895+0000 7ff47496a700 1 --2- 172.21.15.29:0/481083400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47015b6a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff47015cb20 tx=0x7ff460009780 comp rx=0 tx=0).stop 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.896+0000 7ff47496a700 1 -- 172.21.15.29:0/481083400 shutdown_connections 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.896+0000 7ff47496a700 1 --2- 172.21.15.29:0/481083400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47015b6a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.896+0000 7ff47496a700 1 --2- 172.21.15.29:0/481083400 >> v2:172.21.15.183:3300/0 conn(0x7ff47015a620 0x7ff47015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.896+0000 7ff47496a700 1 -- 172.21.15.29:0/481083400 >> 172.21.15.29:0/481083400 conn(0x7ff470068ce0 msgr2=0x7ff4700690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:23.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.896+0000 7ff47496a700 1 -- 172.21.15.29:0/481083400 shutdown_connections 2023-10-08T15:40:23.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.896+0000 7ff47496a700 1 -- 172.21.15.29:0/481083400 wait complete. 2023-10-08T15:40:23.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.897+0000 7ff47496a700 1 Processor -- start 2023-10-08T15:40:23.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.897+0000 7ff47496a700 1 -- start start 2023-10-08T15:40:23.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.897+0000 7ff47496a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47016a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.897+0000 7ff47496a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47015a620 0x7ff4700d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.897+0000 7ff47496a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47015d580 0x7ff4700cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.897+0000 7ff47496a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700b0b90 con 0x7ff470157870 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.897+0000 7ff47496a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700cfd00 con 0x7ff47015a620 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.897+0000 7ff47496a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700cffe0 con 0x7ff47015d580 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47016a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47016a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57706/0 (socket says 172.21.15.29:57706) 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 -- 172.21.15.29:0/4184310484 learned_addr learned my addr 172.21.15.29:0/4184310484 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:23.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46dd9b700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47015a620 0x7ff4700d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46ed9d700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47015d580 0x7ff4700cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 -- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47015d580 msgr2=0x7ff4700cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47015d580 0x7ff4700cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 -- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47015a620 msgr2=0x7ff4700d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47015a620 0x7ff4700d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 -- 172.21.15.29:0/4184310484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460009a20 con 0x7ff470157870 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46dd9b700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47015a620 0x7ff4700d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff46e59c700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47016a8e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff460013000 tx=0x7ff460019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff4667fc700 1 -- 172.21.15.29:0/4184310484 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460012d80 con 0x7ff470157870 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff4667fc700 1 -- 172.21.15.29:0/4184310484 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff460027470 con 0x7ff470157870 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4700b07b0 con 0x7ff470157870 2023-10-08T15:40:23.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff4667fc700 1 -- 172.21.15.29:0/4184310484 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460027830 con 0x7ff470157870 2023-10-08T15:40:23.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.898+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff470153930 con 0x7ff470157870 2023-10-08T15:40:23.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.899+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4700d0220 con 0x7ff470157870 2023-10-08T15:40:23.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.899+0000 7ff4667fc700 1 -- 172.21.15.29:0/4184310484 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff460024070 con 0x7ff470157870 2023-10-08T15:40:23.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.900+0000 7ff4667fc700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff450066f30 0x7ff4500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:23.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.900+0000 7ff4667fc700 1 -- 172.21.15.29:0/4184310484 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff460086ad0 con 0x7ff470157870 2023-10-08T15:40:23.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.900+0000 7ff46dd9b700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff450066f30 0x7ff4500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:23.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.900+0000 7ff46dd9b700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff450066f30 0x7ff4500693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff458006f00 tx=0x7ff458008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:23.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:23.904+0000 7ff4667fc700 1 -- 172.21.15.29:0/4184310484 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4700d0220 con 0x7ff470157870 2023-10-08T15:40:24.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.098+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4700b0610 con 0x7ff470157870 2023-10-08T15:40:24.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.099+0000 7ff4667fc700 1 -- 172.21.15.29:0/4184310484 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7ff4700b0610 con 0x7ff470157870 2023-10-08T15:40:24.107 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:24.107 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:23.084852+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff450066f30 msgr2=0x7ff4500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff450066f30 0x7ff4500693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff458006f00 tx=0x7ff458008040 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 msgr2=0x7ff47016a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47016a8e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff460013000 tx=0x7ff460019000 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 shutdown_connections 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff450066f30 0x7ff4500693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff47015d580 0x7ff4700cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff470157870 0x7ff47016a8e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 --2- 172.21.15.29:0/4184310484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff47015a620 0x7ff4700d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 >> 172.21.15.29:0/4184310484 conn(0x7ff470068ce0 msgr2=0x7ff4701554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 shutdown_connections 2023-10-08T15:40:24.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.101+0000 7ff47496a700 1 -- 172.21.15.29:0/4184310484 wait complete. 2023-10-08T15:40:24.114 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:24.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.232+0000 7efdf08b2700 1 Processor -- start 2023-10-08T15:40:24.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.232+0000 7efdf08b2700 1 -- start start 2023-10-08T15:40:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdf08b2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efdec0cd6e0 0x7efdec0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdf08b2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 0x7efdec15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdf08b2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdec15dda0 0x7efdec15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdf08b2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec15e850 con 0x7efdec15dda0 2023-10-08T15:40:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdf08b2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec0cd030 con 0x7efdec0cd6e0 2023-10-08T15:40:24.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdf08b2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0cb7c0 con 0x7efdec0cdab0 2023-10-08T15:40:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdec15dda0 0x7efdec15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdec15dda0 0x7efdec15cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57722/0 (socket says 172.21.15.29:57722) 2023-10-08T15:40:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 -- 172.21.15.29:0/4210199354 learned_addr learned my addr 172.21.15.29:0/4210199354 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdead9d700 1 --2- 172.21.15.29:0/4210199354 >> v2:172.21.15.183:3300/0 conn(0x7efdec0cd6e0 0x7efdec0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdea59c700 1 --2- 172.21.15.29:0/4210199354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 0x7efdec15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 -- 172.21.15.29:0/4210199354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 msgr2=0x7efdec15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 --2- 172.21.15.29:0/4210199354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 0x7efdec15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 -- 172.21.15.29:0/4210199354 >> v2:172.21.15.183:3300/0 conn(0x7efdec0cd6e0 msgr2=0x7efdec0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 --2- 172.21.15.29:0/4210199354 >> v2:172.21.15.183:3300/0 conn(0x7efdec0cd6e0 0x7efdec0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 -- 172.21.15.29:0/4210199354 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec15e290 con 0x7efdec15dda0 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efdeb59e700 1 --2- 172.21.15.29:0/4210199354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec15dda0 0x7efdec15cbd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efdec06b730 tx=0x7efde4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d48cf36795293c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.233+0000 7efde9d9b700 1 -- 172.21.15.29:0/4210199354 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400b640 con 0x7efdec15dda0 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efde9d9b700 1 -- 172.21.15.29:0/4210199354 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde400b7a0 con 0x7efdec15dda0 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efde9d9b700 1 -- 172.21.15.29:0/4210199354 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde400bb60 con 0x7efdec15dda0 2023-10-08T15:40:24.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 -- 172.21.15.29:0/4210199354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec15dda0 msgr2=0x7efdec15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 --2- 172.21.15.29:0/4210199354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec15dda0 0x7efdec15cbd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efdec06b730 tx=0x7efde4009250 comp rx=0 tx=0).stop 2023-10-08T15:40:24.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 -- 172.21.15.29:0/4210199354 shutdown_connections 2023-10-08T15:40:24.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 --2- 172.21.15.29:0/4210199354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec15dda0 0x7efdec15cbd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 --2- 172.21.15.29:0/4210199354 >> v2:172.21.15.183:3300/0 conn(0x7efdec0cd6e0 0x7efdec0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 --2- 172.21.15.29:0/4210199354 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 0x7efdec15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 -- 172.21.15.29:0/4210199354 >> 172.21.15.29:0/4210199354 conn(0x7efdec067660 msgr2=0x7efdec067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 -- 172.21.15.29:0/4210199354 shutdown_connections 2023-10-08T15:40:24.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.234+0000 7efdf08b2700 1 -- 172.21.15.29:0/4210199354 wait complete. 2023-10-08T15:40:24.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.235+0000 7efdf08b2700 1 Processor -- start 2023-10-08T15:40:24.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.235+0000 7efdf08b2700 1 -- start start 2023-10-08T15:40:24.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdf08b2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec0cd6e0 0x7efdec16a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdf08b2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 0x7efdec14c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdf08b2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdec15dda0 0x7efdec0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdf08b2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b68b0 con 0x7efdec0cd6e0 2023-10-08T15:40:24.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdf08b2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b3b40 con 0x7efdec15dda0 2023-10-08T15:40:24.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdf08b2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec16a7e0 con 0x7efdec0cdab0 2023-10-08T15:40:24.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdead9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec0cd6e0 0x7efdec16a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdead9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec0cd6e0 0x7efdec16a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57734/0 (socket says 172.21.15.29:57734) 2023-10-08T15:40:24.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdead9d700 1 -- 172.21.15.29:0/156405991 learned_addr learned my addr 172.21.15.29:0/156405991 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:24.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdead9d700 1 -- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 msgr2=0x7efdec14c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdead9d700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 0x7efdec14c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdeb59e700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdec15dda0 0x7efdec0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdead9d700 1 -- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdec15dda0 msgr2=0x7efdec0b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdead9d700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdec15dda0 0x7efdec0b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.236+0000 7efdead9d700 1 -- 172.21.15.29:0/156405991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde40094f0 con 0x7efdec0cd6e0 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.237+0000 7efdead9d700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec0cd6e0 0x7efdec16a200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efddc009e50 tx=0x7efddc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.237+0000 7efde2ffd700 1 -- 172.21.15.29:0/156405991 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc00cc20 con 0x7efdec0cd6e0 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.237+0000 7efde2ffd700 1 -- 172.21.15.29:0/156405991 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc00f040 con 0x7efdec0cd6e0 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.237+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec16aac0 con 0x7efdec0cd6e0 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.237+0000 7efde2ffd700 1 -- 172.21.15.29:0/156405991 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc014480 con 0x7efdec0cd6e0 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.237+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec16b080 con 0x7efdec0cd6e0 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.238+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec089280 con 0x7efdec0cd6e0 2023-10-08T15:40:24.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.238+0000 7efde2ffd700 1 -- 172.21.15.29:0/156405991 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efddc0147f0 con 0x7efdec0cd6e0 2023-10-08T15:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.238+0000 7efde2ffd700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efdcc066f30 0x7efdcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.238+0000 7efde2ffd700 1 -- 172.21.15.29:0/156405991 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efddc085170 con 0x7efdec0cd6e0 2023-10-08T15:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.239+0000 7efdea59c700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efdcc066f30 0x7efdcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.239+0000 7efdea59c700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efdcc066f30 0x7efdcc0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efdec0b37d0 tx=0x7efdd40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.243+0000 7efde2ffd700 1 -- 172.21.15.29:0/156405991 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efddc0523e0 con 0x7efdec0cd6e0 2023-10-08T15:40:24.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.435+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdec15e570 con 0x7efdec0cd6e0 2023-10-08T15:40:24.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.436+0000 7efde2ffd700 1 -- 172.21.15.29:0/156405991 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7efddc055a00 con 0x7efdec0cd6e0 2023-10-08T15:40:24.437 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:24.437 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:23.084852+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efdcc066f30 msgr2=0x7efdcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efdcc066f30 0x7efdcc0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efdec0b37d0 tx=0x7efdd40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec0cd6e0 msgr2=0x7efdec16a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec0cd6e0 0x7efdec16a200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efddc009e50 tx=0x7efddc00b040 comp rx=0 tx=0).stop 2023-10-08T15:40:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 shutdown_connections 2023-10-08T15:40:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efdcc066f30 0x7efdcc0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdec15dda0 0x7efdec0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdec0cd6e0 0x7efdec16a200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 --2- 172.21.15.29:0/156405991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdec0cdab0 0x7efdec14c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 >> 172.21.15.29:0/156405991 conn(0x7efdec067660 msgr2=0x7efdec0d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 shutdown_connections 2023-10-08T15:40:24.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.438+0000 7efdf08b2700 1 -- 172.21.15.29:0/156405991 wait complete. 2023-10-08T15:40:24.451 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:40:24.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.572+0000 7ff83976f700 1 Processor -- start 2023-10-08T15:40:24.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.572+0000 7ff83976f700 1 -- start start 2023-10-08T15:40:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.573+0000 7ff83976f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff834155700 0x7ff83406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.573+0000 7ff83976f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff834158950 0x7ff83406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.573+0000 7ff83976f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff834159210 con 0x7ff83415c450 2023-10-08T15:40:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.573+0000 7ff83976f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff834158f30 con 0x7ff834158950 2023-10-08T15:40:24.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.573+0000 7ff83976f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83415b970 con 0x7ff834155700 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.573+0000 7ff8337fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff834158950 0x7ff83406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.573+0000 7ff8337fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff834158950 0x7ff83406c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57738/0 (socket says 172.21.15.29:57738) 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.573+0000 7ff8337fe700 1 -- 172.21.15.29:0/2618628238 learned_addr learned my addr 172.21.15.29:0/2618628238 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff832ffd700 1 --2- 172.21.15.29:0/2618628238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff834155700 0x7ff83406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff8337fe700 1 -- 172.21.15.29:0/2618628238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff834155700 msgr2=0x7ff83406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff8337fe700 1 --2- 172.21.15.29:0/2618628238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff834155700 0x7ff83406c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff8337fe700 1 -- 172.21.15.29:0/2618628238 >> v1:172.21.15.183:6789/0 conn(0x7ff83415c450 legacy=0x7ff834158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff8337fe700 1 -- 172.21.15.29:0/2618628238 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83415bc50 con 0x7ff834158950 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff8337fe700 1 --2- 172.21.15.29:0/2618628238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834158950 0x7ff83406c8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0099b0 tx=0x7ff82c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f96fcf9652370a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff831ffb700 1 -- 172.21.15.29:0/2618628238 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c009ea0 con 0x7ff834158950 2023-10-08T15:40:24.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff831ffb700 1 -- 172.21.15.29:0/2618628238 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00b860 con 0x7ff834158950 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff831ffb700 1 -- 172.21.15.29:0/2618628238 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00bc00 con 0x7ff834158950 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff83976f700 1 -- 172.21.15.29:0/2618628238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834158950 msgr2=0x7ff83406c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff83976f700 1 --2- 172.21.15.29:0/2618628238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834158950 0x7ff83406c8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0099b0 tx=0x7ff82c009250 comp rx=0 tx=0).stop 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff83976f700 1 -- 172.21.15.29:0/2618628238 shutdown_connections 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff83976f700 1 --2- 172.21.15.29:0/2618628238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834158950 0x7ff83406c8c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.574+0000 7ff83976f700 1 --2- 172.21.15.29:0/2618628238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff834155700 0x7ff83406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.575+0000 7ff83976f700 1 -- 172.21.15.29:0/2618628238 >> 172.21.15.29:0/2618628238 conn(0x7ff8340cb030 msgr2=0x7ff83406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.575+0000 7ff83976f700 1 -- 172.21.15.29:0/2618628238 shutdown_connections 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.575+0000 7ff83976f700 1 -- 172.21.15.29:0/2618628238 wait complete. 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.576+0000 7ff83976f700 1 Processor -- start 2023-10-08T15:40:24.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.576+0000 7ff83976f700 1 -- start start 2023-10-08T15:40:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.576+0000 7ff83976f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834155700 0x7ff83416b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff83976f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff834158950 0x7ff8340c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff83976f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff83415c450 0x7ff8340c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff83976f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340b33b0 con 0x7ff834155700 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff83976f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff834152fc0 con 0x7ff834158950 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff83976f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83415b410 con 0x7ff83415c450 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834155700 0x7ff83416b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834155700 0x7ff83416b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57742/0 (socket says 172.21.15.29:57742) 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 -- 172.21.15.29:0/367957602 learned_addr learned my addr 172.21.15.29:0/367957602 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff8337fe700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff83415c450 0x7ff8340c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff8327fc700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff834158950 0x7ff8340c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 -- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff83415c450 msgr2=0x7ff8340c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff83415c450 0x7ff8340c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 -- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff834158950 msgr2=0x7ff8340c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:24.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff834158950 0x7ff8340c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 -- 172.21.15.29:0/367957602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0094f0 con 0x7ff834155700 2023-10-08T15:40:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff832ffd700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834155700 0x7ff83416b2e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff824009f20 tx=0x7ff82400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff82affd700 1 -- 172.21.15.29:0/367957602 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400cb70 con 0x7ff834155700 2023-10-08T15:40:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff82affd700 1 -- 172.21.15.29:0/367957602 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400f040 con 0x7ff834155700 2023-10-08T15:40:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8340cc5a0 con 0x7ff834155700 2023-10-08T15:40:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff82affd700 1 -- 172.21.15.29:0/367957602 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824014480 con 0x7ff834155700 2023-10-08T15:40:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.577+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8340cbf50 con 0x7ff834155700 2023-10-08T15:40:24.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.578+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83404c3c0 con 0x7ff834155700 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.579+0000 7ff82affd700 1 -- 172.21.15.29:0/367957602 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8240147f0 con 0x7ff834155700 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.579+0000 7ff82affd700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.579+0000 7ff82affd700 1 -- 172.21.15.29:0/367957602 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8240850e0 con 0x7ff834155700 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.579+0000 7ff8327fc700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.580+0000 7ff8327fc700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff814066f30 0x7ff8140693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff83415b810 tx=0x7ff81c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:24.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.584+0000 7ff82affd700 1 -- 172.21.15.29:0/367957602 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff824052350 con 0x7ff834155700 2023-10-08T15:40:24.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:24.591 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:24.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:24.824+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff83415bf30 con 0x7ff834155700 2023-10-08T15:40:25.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.716+0000 7ff82affd700 1 -- 172.21.15.29:0/367957602 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff824055970 con 0x7ff834155700 2023-10-08T15:40:25.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.718+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff814066f30 msgr2=0x7ff8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:25.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.718+0000 7ff83976f700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff814066f30 0x7ff8140693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff83415b810 tx=0x7ff81c007ec0 comp rx=0 tx=0).stop 2023-10-08T15:40:25.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.718+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834155700 msgr2=0x7ff83416b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:25.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.718+0000 7ff83976f700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834155700 0x7ff83416b2e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff824009f20 tx=0x7ff82400b040 comp rx=0 tx=0).stop 2023-10-08T15:40:25.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.719+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 shutdown_connections 2023-10-08T15:40:25.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.719+0000 7ff83976f700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff814066f30 0x7ff8140693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:25.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.719+0000 7ff83976f700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff83415c450 0x7ff8340c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:25.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.719+0000 7ff83976f700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff834155700 0x7ff83416b2e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:25.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.719+0000 7ff83976f700 1 --2- 172.21.15.29:0/367957602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff834158950 0x7ff8340c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:25.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.719+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 >> 172.21.15.29:0/367957602 conn(0x7ff8340cb030 msgr2=0x7ff834068320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:25.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.719+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 shutdown_connections 2023-10-08T15:40:25.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.719+0000 7ff83976f700 1 -- 172.21.15.29:0/367957602 wait complete. 2023-10-08T15:40:25.862 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:40:25.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.998+0000 7fc086bf7700 1 Processor -- start 2023-10-08T15:40:25.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.998+0000 7fc086bf7700 1 -- start start 2023-10-08T15:40:26.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.998+0000 7fc086bf7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc08015a290 0x7fc08006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.998+0000 7fc086bf7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08006aae0 0x7fc0800cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc086bf7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800b0790 con 0x7fc080159ec0 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc086bf7700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08006af60 con 0x7fc08015a290 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc086bf7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800ce1f0 con 0x7fc08006aae0 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc084993700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc080159ec0 0x7fc0800af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:57540/0 (socket says 172.21.15.29:57540) 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc084993700 1 -- 172.21.15.29:0/2279668796 learned_addr learned my addr 172.21.15.29:0/2279668796 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc085194700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08006aae0 0x7fc0800cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07ffff700 1 --2- 172.21.15.29:0/2279668796 >> v2:172.21.15.183:3300/0 conn(0x7fc08015a290 0x7fc08006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753568332 0 0) 0x7fc0800b0790 con 0x7fc080159ec0 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc068003570 con 0x7fc080159ec0 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1931175181 0 0) 0x7fc068003570 con 0x7fc080159ec0 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08006aae0 msgr2=0x7fc0800cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:26.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08006aae0 0x7fc0800cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 >> v2:172.21.15.183:3300/0 conn(0x7fc08015a290 msgr2=0x7fc08006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 --2- 172.21.15.29:0/2279668796 >> v2:172.21.15.183:3300/0 conn(0x7fc08015a290 0x7fc08006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800b0b20 con 0x7fc080159ec0 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fc070001470 con 0x7fc080159ec0 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 >> v1:172.21.15.29:6789/0 conn(0x7fc080159ec0 legacy=0x7fc0800af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc068003a60 0x7fc068003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068004810 0x7fc068004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08006aae0 0x7fc0680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08006af60 con 0x7fc068003a60 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800ce1f0 con 0x7fc068004810 2023-10-08T15:40:26.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800ba60 con 0x7fc08006aae0 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc084993700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc068003a60 0x7fc068003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc085194700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08006aae0 0x7fc0680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:25.999+0000 7fc07ffff700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068004810 0x7fc068004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc084993700 1 -- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08006aae0 msgr2=0x7fc0680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc084993700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08006aae0 0x7fc0680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc084993700 1 -- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068004810 msgr2=0x7fc068004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc084993700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068004810 0x7fc068004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc084993700 1 -- 172.21.15.29:0/2279668796 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068003570 con 0x7fc068003a60 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc07ffff700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068004810 0x7fc068004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc084993700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc068003a60 0x7fc068003e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc07000c3f0 tx=0x7fc070001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96b1c5f087e2f8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000cc80 con 0x7fc068003a60 2023-10-08T15:40:26.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000ce00 con 0x7fc068003a60 2023-10-08T15:40:26.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc07f7fe700 1 -- 172.21.15.29:0/2279668796 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070005b70 con 0x7fc068003a60 2023-10-08T15:40:26.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc086bf7700 1 -- 172.21.15.29:0/2279668796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc068003a60 msgr2=0x7fc068003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc086bf7700 1 --2- 172.21.15.29:0/2279668796 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc068003a60 0x7fc068003e70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc07000c3f0 tx=0x7fc070001e90 comp rx=0 tx=0).stop 2023-10-08T15:40:26.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc085194700 1 -- 172.21.15.29:0/2279668796 reap_dead start 2023-10-08T15:40:26.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc086bf7700 1 -- 172.21.15.29:0/2279668796 shutdown_connections 2023-10-08T15:40:26.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc086bf7700 1 -- 172.21.15.29:0/2279668796 >> 172.21.15.29:0/2279668796 conn(0x7fc0800d1880 msgr2=0x7fc0800cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:26.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.000+0000 7fc086bf7700 1 -- 172.21.15.29:0/2279668796 shutdown_connections 2023-10-08T15:40:26.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.001+0000 7fc086bf7700 1 -- 172.21.15.29:0/2279668796 wait complete. 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.002+0000 7fc086bf7700 1 Processor -- start 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.002+0000 7fc086bf7700 1 -- start start 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.002+0000 7fc086bf7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068003a60 0x7fc080169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.002+0000 7fc086bf7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08014d8a0 0x7fc0800c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc086bf7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0800c8db0 0x7fc08015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc086bf7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08015a660 con 0x7fc0800c8db0 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc086bf7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08015af00 con 0x7fc068003a60 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc086bf7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800c92f0 con 0x7fc08014d8a0 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0800c8db0 0x7fc08015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc084993700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068003a60 0x7fc080169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0800c8db0 0x7fc08015cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57772/0 (socket says 172.21.15.29:57772) 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 -- 172.21.15.29:0/1167136435 learned_addr learned my addr 172.21.15.29:0/1167136435 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc07ffff700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08014d8a0 0x7fc0800c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 -- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08014d8a0 msgr2=0x7fc0800c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08014d8a0 0x7fc0800c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 -- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068003a60 msgr2=0x7fc080169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068003a60 0x7fc080169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 -- 172.21.15.29:0/1167136435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08015a8b0 con 0x7fc0800c8db0 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc085194700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0800c8db0 0x7fc08015cc30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc0780094d0 tx=0x7fc07800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc07cff9700 1 -- 172.21.15.29:0/1167136435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800e040 con 0x7fc0800c8db0 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc07cff9700 1 -- 172.21.15.29:0/1167136435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800f040 con 0x7fc0800c8db0 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08015ab90 con 0x7fc0800c8db0 2023-10-08T15:40:26.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc07cff9700 1 -- 172.21.15.29:0/1167136435 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800fda0 con 0x7fc0800c8db0 2023-10-08T15:40:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.003+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0800c9e80 con 0x7fc0800c8db0 2023-10-08T15:40:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.004+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08015b090 con 0x7fc0800c8db0 2023-10-08T15:40:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.005+0000 7fc07cff9700 1 -- 172.21.15.29:0/1167136435 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc078015640 con 0x7fc0800c8db0 2023-10-08T15:40:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.005+0000 7fc07cff9700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.005+0000 7fc07cff9700 1 -- 172.21.15.29:0/1167136435 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc078084df0 con 0x7fc0800c8db0 2023-10-08T15:40:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.005+0000 7fc084993700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.006+0000 7fc084993700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc06c066f30 0x7fc06c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc070001ed0 tx=0x7fc070015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:26.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.009+0000 7fc07cff9700 1 -- 172.21.15.29:0/1167136435 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc078052060 con 0x7fc0800c8db0 2023-10-08T15:40:26.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.251+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc08004c3c0 con 0x7fc0800c8db0 2023-10-08T15:40:26.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.719+0000 7fc07cff9700 1 -- 172.21.15.29:0/1167136435 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc078055680 con 0x7fc0800c8db0 2023-10-08T15:40:26.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc06c066f30 msgr2=0x7fc06c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc06c066f30 0x7fc06c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc070001ed0 tx=0x7fc070015000 comp rx=0 tx=0).stop 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0800c8db0 msgr2=0x7fc08015cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0800c8db0 0x7fc08015cc30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc0780094d0 tx=0x7fc07800b040 comp rx=0 tx=0).stop 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 shutdown_connections 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0800c8db0 0x7fc08015cc30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc068003a60 0x7fc080169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 --2- 172.21.15.29:0/1167136435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc08014d8a0 0x7fc0800c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 >> 172.21.15.29:0/1167136435 conn(0x7fc0800d1880 msgr2=0x7fc080158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:26.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 shutdown_connections 2023-10-08T15:40:26.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.722+0000 7fc086bf7700 1 -- 172.21.15.29:0/1167136435 wait complete. 2023-10-08T15:40:26.738 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:26.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.860+0000 7fb77199f700 1 Processor -- start 2023-10-08T15:40:26.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.860+0000 7fb77199f700 1 -- start start 2023-10-08T15:40:26.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb77199f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb76c157870 0x7fb76c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb77199f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157c40 0x7fb76c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb77199f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76c15cbb0 con 0x7fb76c15a620 2023-10-08T15:40:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb77199f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c15bfa0 con 0x7fb76c157870 2023-10-08T15:40:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb77199f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c15c280 con 0x7fb76c157c40 2023-10-08T15:40:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb76c157870 0x7fb76c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76affd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb76c157870 0x7fb76c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57786/0 (socket says 172.21.15.29:57786) 2023-10-08T15:40:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76affd700 1 -- 172.21.15.29:0/476947947 learned_addr learned my addr 172.21.15.29:0/476947947 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76b7fe700 1 --2- 172.21.15.29:0/476947947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157c40 0x7fb76c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76affd700 1 -- 172.21.15.29:0/476947947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157c40 msgr2=0x7fb76c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76affd700 1 --2- 172.21.15.29:0/476947947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157c40 0x7fb76c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76affd700 1 -- 172.21.15.29:0/476947947 >> v1:172.21.15.183:6789/0 conn(0x7fb76c15a620 legacy=0x7fb76c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76affd700 1 -- 172.21.15.29:0/476947947 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c15c560 con 0x7fb76c157870 2023-10-08T15:40:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb76affd700 1 --2- 172.21.15.29:0/476947947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157870 0x7fb76c15b6a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009f20 tx=0x7fb75c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336d68fada59819b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:26.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb769ffb700 1 -- 172.21.15.29:0/476947947 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00e070 con 0x7fb76c157870 2023-10-08T15:40:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb769ffb700 1 -- 172.21.15.29:0/476947947 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c00b9d0 con 0x7fb76c157870 2023-10-08T15:40:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.861+0000 7fb769ffb700 1 -- 172.21.15.29:0/476947947 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0092e0 con 0x7fb76c157870 2023-10-08T15:40:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.862+0000 7fb77199f700 1 -- 172.21.15.29:0/476947947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157870 msgr2=0x7fb76c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.862+0000 7fb77199f700 1 --2- 172.21.15.29:0/476947947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157870 0x7fb76c15b6a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009f20 tx=0x7fb75c009840 comp rx=0 tx=0).stop 2023-10-08T15:40:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.862+0000 7fb77199f700 1 -- 172.21.15.29:0/476947947 shutdown_connections 2023-10-08T15:40:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.862+0000 7fb77199f700 1 --2- 172.21.15.29:0/476947947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157c40 0x7fb76c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.862+0000 7fb77199f700 1 --2- 172.21.15.29:0/476947947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157870 0x7fb76c15b6a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.862+0000 7fb77199f700 1 -- 172.21.15.29:0/476947947 >> 172.21.15.29:0/476947947 conn(0x7fb76c068ce0 msgr2=0x7fb76c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.862+0000 7fb77199f700 1 -- 172.21.15.29:0/476947947 shutdown_connections 2023-10-08T15:40:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.862+0000 7fb77199f700 1 -- 172.21.15.29:0/476947947 wait complete. 2023-10-08T15:40:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.863+0000 7fb77199f700 1 Processor -- start 2023-10-08T15:40:26.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.863+0000 7fb77199f700 1 -- start start 2023-10-08T15:40:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb77199f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157870 0x7fb76c151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb77199f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157c40 0x7fb76c16a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb77199f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb76c15a620 0x7fb76c16a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb77199f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c1543f0 con 0x7fb76c157c40 2023-10-08T15:40:26.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb77199f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0b17a0 con 0x7fb76c15a620 2023-10-08T15:40:26.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb77199f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c153b50 con 0x7fb76c157870 2023-10-08T15:40:26.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157c40 0x7fb76c16a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157c40 0x7fb76c16a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57796/0 (socket says 172.21.15.29:57796) 2023-10-08T15:40:26.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 -- 172.21.15.29:0/4072442186 learned_addr learned my addr 172.21.15.29:0/4072442186 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:26.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76b7fe700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb76c15a620 0x7fb76c16a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76affd700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157870 0x7fb76c151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 -- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157870 msgr2=0x7fb76c151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157870 0x7fb76c151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 -- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb76c15a620 msgr2=0x7fb76c16a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:26.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb76c15a620 0x7fb76c16a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:26.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 -- 172.21.15.29:0/4072442186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c009ae0 con 0x7fb76c157c40 2023-10-08T15:40:26.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.864+0000 7fb76a7fc700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157c40 0x7fb76c16a360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb75400c590 tx=0x7fb754007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:26.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.865+0000 7fb762ffd700 1 -- 172.21.15.29:0/4072442186 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011590 con 0x7fb76c157c40 2023-10-08T15:40:26.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.865+0000 7fb762ffd700 1 -- 172.21.15.29:0/4072442186 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754011710 con 0x7fb76c157c40 2023-10-08T15:40:26.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.865+0000 7fb762ffd700 1 -- 172.21.15.29:0/4072442186 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011ad0 con 0x7fb76c157c40 2023-10-08T15:40:26.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.865+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c153e30 con 0x7fb76c157c40 2023-10-08T15:40:26.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.865+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c153860 con 0x7fb76c157c40 2023-10-08T15:40:26.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.866+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c0b1950 con 0x7fb76c157c40 2023-10-08T15:40:26.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.866+0000 7fb762ffd700 1 -- 172.21.15.29:0/4072442186 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb75401a360 con 0x7fb76c157c40 2023-10-08T15:40:26.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.866+0000 7fb762ffd700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb74c066f30 0x7fb74c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:26.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.866+0000 7fb762ffd700 1 -- 172.21.15.29:0/4072442186 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb754083360 con 0x7fb76c157c40 2023-10-08T15:40:26.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.867+0000 7fb76affd700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb74c066f30 0x7fb74c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:26.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.867+0000 7fb76affd700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb74c066f30 0x7fb74c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0d0690 tx=0x7fb75c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:26.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:26.871+0000 7fb762ffd700 1 -- 172.21.15.29:0/4072442186 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb76c0b1950 con 0x7fb76c157c40 2023-10-08T15:40:27.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.107+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb76c0b1910 con 0x7fb76c157c40 2023-10-08T15:40:27.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.108+0000 7fb762ffd700 1 -- 172.21.15.29:0/4072442186 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fb7540505d0 con 0x7fb76c157c40 2023-10-08T15:40:27.108 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:27.108 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:23.085169+0000","modified":"2023-10-08T15:40:26.715893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:40:27.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb74c066f30 msgr2=0x7fb74c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb74c066f30 0x7fb74c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0d0690 tx=0x7fb75c018000 comp rx=0 tx=0).stop 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157c40 msgr2=0x7fb76c16a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157c40 0x7fb76c16a360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb75400c590 tx=0x7fb754007f50 comp rx=0 tx=0).stop 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 shutdown_connections 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb74c066f30 0x7fb74c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb76c15a620 0x7fb76c16a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76c157870 0x7fb76c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 --2- 172.21.15.29:0/4072442186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb76c157c40 0x7fb76c16a360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 >> 172.21.15.29:0/4072442186 conn(0x7fb76c068ce0 msgr2=0x7fb76c0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:27.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 shutdown_connections 2023-10-08T15:40:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.110+0000 7fb77199f700 1 -- 172.21.15.29:0/4072442186 wait complete. 2023-10-08T15:40:27.112 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2023-10-08T15:40:27.122 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:27.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.240+0000 7f7c7d655700 1 Processor -- start 2023-10-08T15:40:27.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.240+0000 7f7c7d655700 1 -- start start 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.241+0000 7f7c7d655700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c78157870 0x7f7c7815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.241+0000 7f7c7d655700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7c7815a620 0x7f7c7815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.241+0000 7f7c7d655700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7815cbb0 con 0x7f7c7815d580 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.241+0000 7f7c7d655700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7815bfa0 con 0x7f7c7815a620 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.241+0000 7f7c7d655700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7815c280 con 0x7f7c78157870 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c76ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c78157870 0x7f7c7815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c767fc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7c7815a620 0x7f7c7815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c777fe700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f7c7815d580 0x7f7c78158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:42278/0 (socket says 172.21.15.29:42278) 2023-10-08T15:40:27.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c76ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c78157870 0x7f7c7815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:58538/0 (socket says 172.21.15.29:58538) 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c777fe700 1 -- 172.21.15.29:0/3054668258 learned_addr learned my addr 172.21.15.29:0/3054668258 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c767fc700 1 -- 172.21.15.29:0/3054668258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c78157870 msgr2=0x7f7c7815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c767fc700 1 --2- 172.21.15.29:0/3054668258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c78157870 0x7f7c7815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c767fc700 1 -- 172.21.15.29:0/3054668258 >> v1:172.21.15.183:6789/0 conn(0x7f7c7815d580 legacy=0x7f7c78158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c75ffb700 1 -- 172.21.15.29:0/3054668258 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089995808 0 0) 0x7f7c7815cbb0 con 0x7f7c7815d580 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c767fc700 1 -- 172.21.15.29:0/3054668258 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7815c560 con 0x7f7c7815a620 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c767fc700 1 --2- 172.21.15.29:0/3054668258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7815a620 0x7f7c7815d040 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c600098e0 tx=0x7f7c600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feb9bf43ae94ed14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c75ffb700 1 -- 172.21.15.29:0/3054668258 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000b640 con 0x7f7c7815a620 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c75ffb700 1 -- 172.21.15.29:0/3054668258 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000b7a0 con 0x7f7c7815a620 2023-10-08T15:40:27.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.242+0000 7f7c75ffb700 1 -- 172.21.15.29:0/3054668258 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000bb40 con 0x7f7c7815a620 2023-10-08T15:40:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.243+0000 7f7c7d655700 1 -- 172.21.15.29:0/3054668258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7815a620 msgr2=0x7f7c7815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.243+0000 7f7c7d655700 1 --2- 172.21.15.29:0/3054668258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7815a620 0x7f7c7815d040 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c600098e0 tx=0x7f7c600091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.243+0000 7f7c7d655700 1 -- 172.21.15.29:0/3054668258 shutdown_connections 2023-10-08T15:40:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.243+0000 7f7c7d655700 1 --2- 172.21.15.29:0/3054668258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c78157870 0x7f7c7815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.243+0000 7f7c7d655700 1 --2- 172.21.15.29:0/3054668258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c7815a620 0x7f7c7815d040 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.243+0000 7f7c7d655700 1 -- 172.21.15.29:0/3054668258 >> 172.21.15.29:0/3054668258 conn(0x7f7c78068ce0 msgr2=0x7f7c780690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.243+0000 7f7c7d655700 1 -- 172.21.15.29:0/3054668258 shutdown_connections 2023-10-08T15:40:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.243+0000 7f7c7d655700 1 -- 172.21.15.29:0/3054668258 wait complete. 2023-10-08T15:40:27.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.244+0000 7f7c7d655700 1 Processor -- start 2023-10-08T15:40:27.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.244+0000 7f7c7d655700 1 -- start start 2023-10-08T15:40:27.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c7d655700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c78157870 0x7f7c780b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c7d655700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c7815a620 0x7f7c7816e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c7d655700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7815d580 0x7f7c7814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c7d655700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780b32c0 con 0x7f7c7815a620 2023-10-08T15:40:27.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c7d655700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7816eca0 con 0x7f7c78157870 2023-10-08T15:40:27.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c7d655700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7814e9f0 con 0x7f7c7815d580 2023-10-08T15:40:27.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c767fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c7815a620 0x7f7c7816e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c767fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c7815a620 0x7f7c7816e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57804/0 (socket says 172.21.15.29:57804) 2023-10-08T15:40:27.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c767fc700 1 -- 172.21.15.29:0/2711433462 learned_addr learned my addr 172.21.15.29:0/2711433462 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c777fe700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7815d580 0x7f7c7814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c76ffd700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c78157870 0x7f7c780b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c767fc700 1 -- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7815d580 msgr2=0x7f7c7814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c767fc700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7815d580 0x7f7c7814bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c767fc700 1 -- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c78157870 msgr2=0x7f7c780b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c767fc700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c78157870 0x7f7c780b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c767fc700 1 -- 172.21.15.29:0/2711433462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60009420 con 0x7f7c7815a620 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.245+0000 7f7c777fe700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7815d580 0x7f7c7814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.246+0000 7f7c767fc700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c7815a620 0x7f7c7816e760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c7806b530 tx=0x7f7c60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.246+0000 7f7c6effd700 1 -- 172.21.15.29:0/2711433462 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60000d10 con 0x7f7c7815a620 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.246+0000 7f7c6effd700 1 -- 172.21.15.29:0/2711433462 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000bb20 con 0x7f7c7815a620 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.246+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7814ecd0 con 0x7f7c7815a620 2023-10-08T15:40:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.246+0000 7f7c6effd700 1 -- 172.21.15.29:0/2711433462 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60011670 con 0x7f7c7815a620 2023-10-08T15:40:27.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.246+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7814f290 con 0x7f7c7815a620 2023-10-08T15:40:27.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.247+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7804c3c0 con 0x7f7c7815a620 2023-10-08T15:40:27.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.247+0000 7f7c6effd700 1 -- 172.21.15.29:0/2711433462 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c60011a20 con 0x7f7c7815a620 2023-10-08T15:40:27.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.247+0000 7f7c6effd700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7c58066f30 0x7f7c580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.248+0000 7f7c6effd700 1 -- 172.21.15.29:0/2711433462 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c60085b10 con 0x7f7c7815a620 2023-10-08T15:40:27.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.248+0000 7f7c76ffd700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7c58066f30 0x7f7c580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.248+0000 7f7c76ffd700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7c58066f30 0x7f7c580693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009db0 tx=0x7f7c680091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.252+0000 7f7c6effd700 1 -- 172.21.15.29:0/2711433462 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c60052d80 con 0x7f7c7815a620 2023-10-08T15:40:27.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.445+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c7815c840 con 0x7f7c7815a620 2023-10-08T15:40:27.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.446+0000 7f7c6effd700 1 -- 172.21.15.29:0/2711433462 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f7c600563a0 con 0x7f7c7815a620 2023-10-08T15:40:27.447 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:27.447 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7c58066f30 msgr2=0x7f7c580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7c58066f30 0x7f7c580693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009db0 tx=0x7f7c680091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c7815a620 msgr2=0x7f7c7816e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c7815a620 0x7f7c7816e760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c7806b530 tx=0x7f7c60017000 comp rx=0 tx=0).stop 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 shutdown_connections 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7c58066f30 0x7f7c580693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c7815d580 0x7f7c7814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c78157870 0x7f7c780b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 --2- 172.21.15.29:0/2711433462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c7815a620 0x7f7c7816e760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 >> 172.21.15.29:0/2711433462 conn(0x7f7c78068ce0 msgr2=0x7f7c781596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:27.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 shutdown_connections 2023-10-08T15:40:27.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.448+0000 7f7c7d655700 1 -- 172.21.15.29:0/2711433462 wait complete. 2023-10-08T15:40:27.461 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:40:27.461 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:27.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.579+0000 7f91fd25a700 1 Processor -- start 2023-10-08T15:40:27.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.579+0000 7f91fd25a700 1 -- start start 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.579+0000 7f91fd25a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f91f80d1c30 0x7f91f80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.579+0000 7f91fd25a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f91f815a680 0x7f91f80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.579+0000 7f91fd25a700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f80c5d80 con 0x7f91f815a2b0 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91fd25a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f8068470 con 0x7f91f815a680 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91fd25a700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f80c6060 con 0x7f91f80d1c30 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f91f815a680 0x7f91f80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f6d9d700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f91f815a2b0 0x7f91f80b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:42290/0 (socket says 172.21.15.29:42290) 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f91f815a680 0x7f91f80cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57812/0 (socket says 172.21.15.29:57812) 2023-10-08T15:40:27.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f6d9d700 1 -- 172.21.15.29:0/3986411542 learned_addr learned my addr 172.21.15.29:0/3986411542 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f659c700 1 --2- 172.21.15.29:0/3986411542 >> v2:172.21.15.183:3300/0 conn(0x7f91f80d1c30 0x7f91f80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f759e700 1 -- 172.21.15.29:0/3986411542 >> v2:172.21.15.183:3300/0 conn(0x7f91f80d1c30 msgr2=0x7f91f80ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f759e700 1 --2- 172.21.15.29:0/3986411542 >> v2:172.21.15.183:3300/0 conn(0x7f91f80d1c30 0x7f91f80ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f5d9b700 1 -- 172.21.15.29:0/3986411542 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282142530 0 0) 0x7f91f80c5d80 con 0x7f91f815a2b0 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f759e700 1 -- 172.21.15.29:0/3986411542 >> v1:172.21.15.183:6789/0 conn(0x7f91f815a2b0 legacy=0x7f91f80b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f759e700 1 -- 172.21.15.29:0/3986411542 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f80c6340 con 0x7f91f815a680 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f759e700 1 --2- 172.21.15.29:0/3986411542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f80cf710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f91f8089190 tx=0x7f91f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf180679286d301 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f5d9b700 1 -- 172.21.15.29:0/3986411542 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011630 con 0x7f91f815a680 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f5d9b700 1 -- 172.21.15.29:0/3986411542 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0011790 con 0x7f91f815a680 2023-10-08T15:40:27.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.580+0000 7f91f5d9b700 1 -- 172.21.15.29:0/3986411542 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011b30 con 0x7f91f815a680 2023-10-08T15:40:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.581+0000 7f91fd25a700 1 -- 172.21.15.29:0/3986411542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 msgr2=0x7f91f80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.581+0000 7f91fd25a700 1 --2- 172.21.15.29:0/3986411542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f80cf710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f91f8089190 tx=0x7f91f00091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.581+0000 7f91fd25a700 1 -- 172.21.15.29:0/3986411542 shutdown_connections 2023-10-08T15:40:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.581+0000 7f91fd25a700 1 --2- 172.21.15.29:0/3986411542 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f80cf710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.581+0000 7f91fd25a700 1 --2- 172.21.15.29:0/3986411542 >> v2:172.21.15.183:3300/0 conn(0x7f91f80d1c30 0x7f91f80ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.581+0000 7f91fd25a700 1 -- 172.21.15.29:0/3986411542 >> 172.21.15.29:0/3986411542 conn(0x7f91f8067e40 msgr2=0x7f91f80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.581+0000 7f91fd25a700 1 -- 172.21.15.29:0/3986411542 shutdown_connections 2023-10-08T15:40:27.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.581+0000 7f91fd25a700 1 -- 172.21.15.29:0/3986411542 wait complete. 2023-10-08T15:40:27.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.582+0000 7f91fd25a700 1 Processor -- start 2023-10-08T15:40:27.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.582+0000 7f91fd25a700 1 -- start start 2023-10-08T15:40:27.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91fd25a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91f80d1c30 0x7f91f80c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91fd25a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91f815a2b0 0x7f91f815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91fd25a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91fd25a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80c8d40 con 0x7f91f815a680 2023-10-08T15:40:27.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91fd25a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80c8130 con 0x7f91f80d1c30 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91fd25a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80c8410 con 0x7f91f815a2b0 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f806a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57816/0 (socket says 172.21.15.29:57816) 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 -- 172.21.15.29:0/2707610518 learned_addr learned my addr 172.21.15.29:0/2707610518 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f6d9d700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91f80d1c30 0x7f91f80c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f659c700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91f815a2b0 0x7f91f815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 -- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91f815a2b0 msgr2=0x7f91f815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91f815a2b0 0x7f91f815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 -- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91f80d1c30 msgr2=0x7f91f80c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91f80d1c30 0x7f91f80c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 -- 172.21.15.29:0/2707610518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f0009420 con 0x7f91f815a680 2023-10-08T15:40:27.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f6d9d700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91f80d1c30 0x7f91f80c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.583+0000 7f91f759e700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f806a4e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91f8089120 tx=0x7f91f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.584+0000 7f91eeffd700 1 -- 172.21.15.29:0/2707610518 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00195c0 con 0x7f91f815a680 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.584+0000 7f91eeffd700 1 -- 172.21.15.29:0/2707610518 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0019720 con 0x7f91f815a680 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.584+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f80c86f0 con 0x7f91f815a680 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.584+0000 7f91eeffd700 1 -- 172.21.15.29:0/2707610518 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0019ae0 con 0x7f91f815a680 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.584+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f815d560 con 0x7f91f815a680 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.584+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f80c8eb0 con 0x7f91f815a680 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.585+0000 7f91eeffd700 1 -- 172.21.15.29:0/2707610518 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91f00253f0 con 0x7f91f815a680 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.585+0000 7f91eeffd700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f91d8066f30 0x7f91d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.585+0000 7f91eeffd700 1 -- 172.21.15.29:0/2707610518 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91f0085fd0 con 0x7f91f815a680 2023-10-08T15:40:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.586+0000 7f91f6d9d700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f91d8066f30 0x7f91d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.586+0000 7f91f6d9d700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f91d8066f30 0x7f91d80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f91e800e1b0 tx=0x7f91e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.590+0000 7f91eeffd700 1 -- 172.21.15.29:0/2707610518 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91f0053240 con 0x7f91f815a680 2023-10-08T15:40:27.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.779+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91f804c3c0 con 0x7f91d8066f30 2023-10-08T15:40:27.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.787+0000 7f91eeffd700 1 -- 172.21.15.29:0/2707610518 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257349 (secure 0 0 0) 0x7f91f804c3c0 con 0x7f91d8066f30 2023-10-08T15:40:27.791 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:27.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f91d8066f30 msgr2=0x7f91d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f91d8066f30 0x7f91d80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f91e800e1b0 tx=0x7f91e8009040 comp rx=0 tx=0).stop 2023-10-08T15:40:27.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 msgr2=0x7f91f806a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f806a4e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91f8089120 tx=0x7f91f0017000 comp rx=0 tx=0).stop 2023-10-08T15:40:27.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 shutdown_connections 2023-10-08T15:40:27.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f91d8066f30 0x7f91d80693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91f815a680 0x7f91f806a4e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91f80d1c30 0x7f91f80c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 --2- 172.21.15.29:0/2707610518 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91f815a2b0 0x7f91f815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 >> 172.21.15.29:0/2707610518 conn(0x7f91f8067e40 msgr2=0x7f91f80c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:27.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 shutdown_connections 2023-10-08T15:40:27.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.790+0000 7f91fd25a700 1 -- 172.21.15.29:0/2707610518 wait complete. 2023-10-08T15:40:27.794 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:40:27.803 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-10-08T15:40:26.303026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560910,"statfs":{"total":1600000000,"available":1598372246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.620058"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693529+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691024+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692619+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693983+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.697525+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694739+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691637+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693023+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.695987+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691951+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693336+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689391+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692614+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693509+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691228+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694333+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.696842+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689960+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.695512+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695776+0000","last_change":"2023-10-08T15:40:22.695776+0000","last_active":"2023-10-08T15:40:22.695776+0000","last_peered":"2023-10-08T15:40:22.695776+0000","last_clean":"2023-10-08T15:40:22.695776+0000","last_became_active":"2023-10-08T15:40:22.695553+0000","last_became_peered":"2023-10-08T15:40:22.695553+0000","last_unstale":"2023-10-08T15:40:22.695776+0000","last_undegraded":"2023-10-08T15:40:22.695776+0000","last_fullsized":"2023-10-08T15:40:22.695776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693470+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699564+0000","last_change":"2023-10-08T15:40:22.699564+0000","last_active":"2023-10-08T15:40:22.699564+0000","last_peered":"2023-10-08T15:40:22.699564+0000","last_clean":"2023-10-08T15:40:22.699564+0000","last_became_active":"2023-10-08T15:40:22.698627+0000","last_became_peered":"2023-10-08T15:40:22.698627+0000","last_unstale":"2023-10-08T15:40:22.699564+0000","last_undegraded":"2023-10-08T15:40:22.699564+0000","last_fullsized":"2023-10-08T15:40:22.699564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692277+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700173+0000","last_change":"2023-10-08T15:40:22.700173+0000","last_active":"2023-10-08T15:40:22.700173+0000","last_peered":"2023-10-08T15:40:22.700173+0000","last_clean":"2023-10-08T15:40:22.700173+0000","last_became_active":"2023-10-08T15:40:22.699897+0000","last_became_peered":"2023-10-08T15:40:22.699897+0000","last_unstale":"2023-10-08T15:40:22.700173+0000","last_undegraded":"2023-10-08T15:40:22.700173+0000","last_fullsized":"2023-10-08T15:40:22.700173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:48.001159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692202+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702341+0000","last_change":"2023-10-08T15:40:22.702341+0000","last_active":"2023-10-08T15:40:22.702341+0000","last_peered":"2023-10-08T15:40:22.702341+0000","last_clean":"2023-10-08T15:40:22.702341+0000","last_became_active":"2023-10-08T15:40:22.701383+0000","last_became_peered":"2023-10-08T15:40:22.701383+0000","last_unstale":"2023-10-08T15:40:22.702341+0000","last_undegraded":"2023-10-08T15:40:22.702341+0000","last_fullsized":"2023-10-08T15:40:22.702341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691316+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698477+0000","last_change":"2023-10-08T15:40:22.698477+0000","last_active":"2023-10-08T15:40:22.698477+0000","last_peered":"2023-10-08T15:40:22.698477+0000","last_clean":"2023-10-08T15:40:22.698477+0000","last_became_active":"2023-10-08T15:40:22.698057+0000","last_became_peered":"2023-10-08T15:40:22.698057+0000","last_unstale":"2023-10-08T15:40:22.698477+0000","last_undegraded":"2023-10-08T15:40:22.698477+0000","last_fullsized":"2023-10-08T15:40:22.698477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690441+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695547+0000","last_change":"2023-10-08T15:40:22.695547+0000","last_active":"2023-10-08T15:40:22.695547+0000","last_peered":"2023-10-08T15:40:22.695547+0000","last_clean":"2023-10-08T15:40:22.695547+0000","last_became_active":"2023-10-08T15:40:22.695272+0000","last_became_peered":"2023-10-08T15:40:22.695272+0000","last_unstale":"2023-10-08T15:40:22.695547+0000","last_undegraded":"2023-10-08T15:40:22.695547+0000","last_fullsized":"2023-10-08T15:40:22.695547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690907+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700006+0000","last_change":"2023-10-08T15:40:22.700006+0000","last_active":"2023-10-08T15:40:22.700006+0000","last_peered":"2023-10-08T15:40:22.700006+0000","last_clean":"2023-10-08T15:40:22.700006+0000","last_became_active":"2023-10-08T15:40:22.699783+0000","last_became_peered":"2023-10-08T15:40:22.699783+0000","last_unstale":"2023-10-08T15:40:22.700006+0000","last_undegraded":"2023-10-08T15:40:22.700006+0000","last_fullsized":"2023-10-08T15:40:22.700006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690498+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695652+0000","last_change":"2023-10-08T15:40:22.695652+0000","last_active":"2023-10-08T15:40:22.695652+0000","last_peered":"2023-10-08T15:40:22.695652+0000","last_clean":"2023-10-08T15:40:22.695652+0000","last_became_active":"2023-10-08T15:40:22.695043+0000","last_became_peered":"2023-10-08T15:40:22.695043+0000","last_unstale":"2023-10-08T15:40:22.695652+0000","last_undegraded":"2023-10-08T15:40:22.695652+0000","last_fullsized":"2023-10-08T15:40:22.695652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691125+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702796+0000","last_change":"2023-10-08T15:40:22.702796+0000","last_active":"2023-10-08T15:40:22.702796+0000","last_peered":"2023-10-08T15:40:22.702796+0000","last_clean":"2023-10-08T15:40:22.702796+0000","last_became_active":"2023-10-08T15:40:22.702571+0000","last_became_peered":"2023-10-08T15:40:22.702571+0000","last_unstale":"2023-10-08T15:40:22.702796+0000","last_undegraded":"2023-10-08T15:40:22.702796+0000","last_fullsized":"2023-10-08T15:40:22.702796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690992+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702638+0000","last_change":"2023-10-08T15:40:22.702638+0000","last_active":"2023-10-08T15:40:22.702638+0000","last_peered":"2023-10-08T15:40:22.702638+0000","last_clean":"2023-10-08T15:40:22.702638+0000","last_became_active":"2023-10-08T15:40:22.702409+0000","last_became_peered":"2023-10-08T15:40:22.702409+0000","last_unstale":"2023-10-08T15:40:22.702638+0000","last_undegraded":"2023-10-08T15:40:22.702638+0000","last_fullsized":"2023-10-08T15:40:22.702638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692194+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.697798+0000","last_change":"2023-10-08T15:40:22.697798+0000","last_active":"2023-10-08T15:40:22.697798+0000","last_peered":"2023-10-08T15:40:22.697798+0000","last_clean":"2023-10-08T15:40:22.697798+0000","last_became_active":"2023-10-08T15:40:22.697562+0000","last_became_peered":"2023-10-08T15:40:22.697562+0000","last_unstale":"2023-10-08T15:40:22.697798+0000","last_undegraded":"2023-10-08T15:40:22.697798+0000","last_fullsized":"2023-10-08T15:40:22.697798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689689+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700551+0000","last_change":"2023-10-08T15:40:22.700551+0000","last_active":"2023-10-08T15:40:22.700551+0000","last_peered":"2023-10-08T15:40:22.700551+0000","last_clean":"2023-10-08T15:40:22.700551+0000","last_became_active":"2023-10-08T15:40:22.700305+0000","last_became_peered":"2023-10-08T15:40:22.700305+0000","last_unstale":"2023-10-08T15:40:22.700551+0000","last_undegraded":"2023-10-08T15:40:22.700551+0000","last_fullsized":"2023-10-08T15:40:22.700551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690968+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695062+0000","last_change":"2023-10-08T15:40:22.695062+0000","last_active":"2023-10-08T15:40:22.695062+0000","last_peered":"2023-10-08T15:40:22.695062+0000","last_clean":"2023-10-08T15:40:22.695062+0000","last_became_active":"2023-10-08T15:40:22.694763+0000","last_became_peered":"2023-10-08T15:40:22.694763+0000","last_unstale":"2023-10-08T15:40:22.695062+0000","last_undegraded":"2023-10-08T15:40:22.695062+0000","last_fullsized":"2023-10-08T15:40:22.695062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691797+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701263+0000","last_change":"2023-10-08T15:40:22.701263+0000","last_active":"2023-10-08T15:40:22.701263+0000","last_peered":"2023-10-08T15:40:22.701263+0000","last_clean":"2023-10-08T15:40:22.701263+0000","last_became_active":"2023-10-08T15:40:22.700296+0000","last_became_peered":"2023-10-08T15:40:22.700296+0000","last_unstale":"2023-10-08T15:40:22.701263+0000","last_undegraded":"2023-10-08T15:40:22.701263+0000","last_fullsized":"2023-10-08T15:40:22.701263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.697143+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699338+0000","last_change":"2023-10-08T15:40:22.699338+0000","last_active":"2023-10-08T15:40:22.699338+0000","last_peered":"2023-10-08T15:40:22.699338+0000","last_clean":"2023-10-08T15:40:22.699338+0000","last_became_active":"2023-10-08T15:40:22.698307+0000","last_became_peered":"2023-10-08T15:40:22.698307+0000","last_unstale":"2023-10-08T15:40:22.699338+0000","last_undegraded":"2023-10-08T15:40:22.699338+0000","last_fullsized":"2023-10-08T15:40:22.699338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693459+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.692944+0000","last_change":"2023-10-08T15:40:22.692944+0000","last_active":"2023-10-08T15:40:22.692944+0000","last_peered":"2023-10-08T15:40:22.692944+0000","last_clean":"2023-10-08T15:40:22.692944+0000","last_became_active":"2023-10-08T15:40:22.692741+0000","last_became_peered":"2023-10-08T15:40:22.692741+0000","last_unstale":"2023-10-08T15:40:22.692944+0000","last_undegraded":"2023-10-08T15:40:22.692944+0000","last_fullsized":"2023-10-08T15:40:22.692944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691096+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.696237+0000","last_change":"2023-10-08T15:40:22.696237+0000","last_active":"2023-10-08T15:40:22.696237+0000","last_peered":"2023-10-08T15:40:22.696237+0000","last_clean":"2023-10-08T15:40:22.696237+0000","last_became_active":"2023-10-08T15:40:22.695953+0000","last_became_peered":"2023-10-08T15:40:22.695953+0000","last_unstale":"2023-10-08T15:40:22.696237+0000","last_undegraded":"2023-10-08T15:40:22.696237+0000","last_fullsized":"2023-10-08T15:40:22.696237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:40.912548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691778+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695667+0000","last_change":"2023-10-08T15:40:22.695667+0000","last_active":"2023-10-08T15:40:22.695667+0000","last_peered":"2023-10-08T15:40:22.695667+0000","last_clean":"2023-10-08T15:40:22.695667+0000","last_became_active":"2023-10-08T15:40:22.695439+0000","last_became_peered":"2023-10-08T15:40:22.695439+0000","last_unstale":"2023-10-08T15:40:22.695667+0000","last_undegraded":"2023-10-08T15:40:22.695667+0000","last_fullsized":"2023-10-08T15:40:22.695667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690107+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698283+0000","last_change":"2023-10-08T15:40:22.698283+0000","last_active":"2023-10-08T15:40:22.698283+0000","last_peered":"2023-10-08T15:40:22.698283+0000","last_clean":"2023-10-08T15:40:22.698283+0000","last_became_active":"2023-10-08T15:40:22.697621+0000","last_became_peered":"2023-10-08T15:40:22.697621+0000","last_unstale":"2023-10-08T15:40:22.698283+0000","last_undegraded":"2023-10-08T15:40:22.698283+0000","last_fullsized":"2023-10-08T15:40:22.698283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689173+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:20.554850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690751+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698673+0000","last_change":"2023-10-08T15:40:22.698673+0000","last_active":"2023-10-08T15:40:22.698673+0000","last_peered":"2023-10-08T15:40:22.698673+0000","last_clean":"2023-10-08T15:40:22.698673+0000","last_became_active":"2023-10-08T15:40:22.698433+0000","last_became_peered":"2023-10-08T15:40:22.698433+0000","last_unstale":"2023-10-08T15:40:22.698673+0000","last_undegraded":"2023-10-08T15:40:22.698673+0000","last_fullsized":"2023-10-08T15:40:22.698673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693015+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701412+0000","last_change":"2023-10-08T15:40:22.701412+0000","last_active":"2023-10-08T15:40:22.701412+0000","last_peered":"2023-10-08T15:40:22.701412+0000","last_clean":"2023-10-08T15:40:22.701412+0000","last_became_active":"2023-10-08T15:40:22.701018+0000","last_became_peered":"2023-10-08T15:40:22.701018+0000","last_unstale":"2023-10-08T15:40:22.701412+0000","last_undegraded":"2023-10-08T15:40:22.701412+0000","last_fullsized":"2023-10-08T15:40:22.701412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T15:40:21.685151+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:40:21.685151+0000","last_peered":"2023-10-08T15:40:21.685151+0000","last_clean":"2023-10-08T15:40:21.685151+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:40:21.685151+0000","last_undegraded":"2023-10-08T15:40:21.685151+0000","last_fullsized":"2023-10-08T15:40:21.685151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691253+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702091+0000","last_change":"2023-10-08T15:40:22.702091+0000","last_active":"2023-10-08T15:40:22.702091+0000","last_peered":"2023-10-08T15:40:22.702091+0000","last_clean":"2023-10-08T15:40:22.702091+0000","last_became_active":"2023-10-08T15:40:22.701729+0000","last_became_peered":"2023-10-08T15:40:22.701729+0000","last_unstale":"2023-10-08T15:40:22.702091+0000","last_undegraded":"2023-10-08T15:40:22.702091+0000","last_fullsized":"2023-10-08T15:40:22.702091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:00.869317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701958+0000","last_change":"2023-10-08T15:40:22.701958+0000","last_active":"2023-10-08T15:40:22.701958+0000","last_peered":"2023-10-08T15:40:22.701958+0000","last_clean":"2023-10-08T15:40:22.701958+0000","last_became_active":"2023-10-08T15:40:22.701237+0000","last_became_peered":"2023-10-08T15:40:22.701237+0000","last_unstale":"2023-10-08T15:40:22.701958+0000","last_undegraded":"2023-10-08T15:40:22.701958+0000","last_fullsized":"2023-10-08T15:40:22.701958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690858+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702336+0000","last_change":"2023-10-08T15:40:22.702336+0000","last_active":"2023-10-08T15:40:22.702336+0000","last_peered":"2023-10-08T15:40:22.702336+0000","last_clean":"2023-10-08T15:40:22.702336+0000","last_became_active":"2023-10-08T15:40:22.702088+0000","last_became_peered":"2023-10-08T15:40:22.702088+0000","last_unstale":"2023-10-08T15:40:22.702336+0000","last_undegraded":"2023-10-08T15:40:22.702336+0000","last_fullsized":"2023-10-08T15:40:22.702336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693412+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699798+0000","last_change":"2023-10-08T15:40:22.699798+0000","last_active":"2023-10-08T15:40:22.699798+0000","last_peered":"2023-10-08T15:40:22.699798+0000","last_clean":"2023-10-08T15:40:22.699798+0000","last_became_active":"2023-10-08T15:40:22.699567+0000","last_became_peered":"2023-10-08T15:40:22.699567+0000","last_unstale":"2023-10-08T15:40:22.699798+0000","last_undegraded":"2023-10-08T15:40:22.699798+0000","last_fullsized":"2023-10-08T15:40:22.699798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691937+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701044+0000","last_change":"2023-10-08T15:40:22.701044+0000","last_active":"2023-10-08T15:40:22.701044+0000","last_peered":"2023-10-08T15:40:22.701044+0000","last_clean":"2023-10-08T15:40:22.701044+0000","last_became_active":"2023-10-08T15:40:22.700575+0000","last_became_peered":"2023-10-08T15:40:22.700575+0000","last_unstale":"2023-10-08T15:40:22.701044+0000","last_undegraded":"2023-10-08T15:40:22.701044+0000","last_fullsized":"2023-10-08T15:40:22.701044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689144+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:56.355768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700842+0000","last_change":"2023-10-08T15:40:22.700842+0000","last_active":"2023-10-08T15:40:22.700842+0000","last_peered":"2023-10-08T15:40:22.700842+0000","last_clean":"2023-10-08T15:40:22.700842+0000","last_became_active":"2023-10-08T15:40:22.700609+0000","last_became_peered":"2023-10-08T15:40:22.700609+0000","last_unstale":"2023-10-08T15:40:22.700842+0000","last_undegraded":"2023-10-08T15:40:22.700842+0000","last_fullsized":"2023-10-08T15:40:22.700842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691193+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700304+0000","last_change":"2023-10-08T15:40:22.700304+0000","last_active":"2023-10-08T15:40:22.700304+0000","last_peered":"2023-10-08T15:40:22.700304+0000","last_clean":"2023-10-08T15:40:22.700304+0000","last_became_active":"2023-10-08T15:40:22.700075+0000","last_became_peered":"2023-10-08T15:40:22.700075+0000","last_unstale":"2023-10-08T15:40:22.700304+0000","last_undegraded":"2023-10-08T15:40:22.700304+0000","last_fullsized":"2023-10-08T15:40:22.700304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691547+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699299+0000","last_change":"2023-10-08T15:40:22.699299+0000","last_active":"2023-10-08T15:40:22.699299+0000","last_peered":"2023-10-08T15:40:22.699299+0000","last_clean":"2023-10-08T15:40:22.699299+0000","last_became_active":"2023-10-08T15:40:22.699051+0000","last_became_peered":"2023-10-08T15:40:22.699051+0000","last_unstale":"2023-10-08T15:40:22.699299+0000","last_undegraded":"2023-10-08T15:40:22.699299+0000","last_fullsized":"2023-10-08T15:40:22.699299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691403+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.694836+0000","last_change":"2023-10-08T15:40:22.694836+0000","last_active":"2023-10-08T15:40:22.694836+0000","last_peered":"2023-10-08T15:40:22.694836+0000","last_clean":"2023-10-08T15:40:22.694836+0000","last_became_active":"2023-10-08T15:40:22.694608+0000","last_became_peered":"2023-10-08T15:40:22.694608+0000","last_unstale":"2023-10-08T15:40:22.694836+0000","last_undegraded":"2023-10-08T15:40:22.694836+0000","last_fullsized":"2023-10-08T15:40:22.694836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691764+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.694954+0000","last_change":"2023-10-08T15:40:22.694954+0000","last_active":"2023-10-08T15:40:22.694954+0000","last_peered":"2023-10-08T15:40:22.694954+0000","last_clean":"2023-10-08T15:40:22.694954+0000","last_became_active":"2023-10-08T15:40:22.694720+0000","last_became_peered":"2023-10-08T15:40:22.694720+0000","last_unstale":"2023-10-08T15:40:22.694954+0000","last_undegraded":"2023-10-08T15:40:22.694954+0000","last_fullsized":"2023-10-08T15:40:22.694954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690636+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.696186+0000","last_change":"2023-10-08T15:40:22.696186+0000","last_active":"2023-10-08T15:40:22.696186+0000","last_peered":"2023-10-08T15:40:22.696186+0000","last_clean":"2023-10-08T15:40:22.696186+0000","last_became_active":"2023-10-08T15:40:22.695949+0000","last_became_peered":"2023-10-08T15:40:22.695949+0000","last_unstale":"2023-10-08T15:40:22.696186+0000","last_undegraded":"2023-10-08T15:40:22.696186+0000","last_fullsized":"2023-10-08T15:40:22.696186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692910+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.696262+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690372+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691698+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694335+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691906+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690392+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692069+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691009+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690586+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692271+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693301+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692573+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691224+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199352189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199352189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]}],"pool_statfs":[]}} 2023-10-08T15:40:27.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:27.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.962+0000 7faeb4b77700 1 Processor -- start 2023-10-08T15:40:27.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.962+0000 7faeb4b77700 1 -- start start 2023-10-08T15:40:27.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.963+0000 7faeb4b77700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faeb00cdab0 0x7faeb015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.963+0000 7faeb4b77700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb015dda0 0x7faeb015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.963+0000 7faeb4b77700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb00cb7c0 con 0x7faeb00cd6e0 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.963+0000 7faeb4b77700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb015e850 con 0x7faeb00cdab0 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.963+0000 7faeb4b77700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00cc360 con 0x7faeb015dda0 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb015dda0 0x7faeb015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faeb00cdab0 0x7faeb015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb015dda0 0x7faeb015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:58568/0 (socket says 172.21.15.29:58568) 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaeffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faeb00cdab0 0x7faeb015d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:48712/0 (socket says 172.21.15.29:48712) 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaffff700 1 -- 172.21.15.29:0/3010984410 learned_addr learned my addr 172.21.15.29:0/3010984410 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:27.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaf7fe700 1 --1- 172.21.15.29:0/3010984410 >> v1:172.21.15.183:6789/0 conn(0x7faeb00cd6e0 0x7faeb00cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:42300/0 (socket says 172.21.15.29:42300) 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaffff700 1 -- 172.21.15.29:0/3010984410 >> v2:172.21.15.183:3300/0 conn(0x7faeb00cdab0 msgr2=0x7faeb015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaffff700 1 --2- 172.21.15.29:0/3010984410 >> v2:172.21.15.183:3300/0 conn(0x7faeb00cdab0 0x7faeb015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaffff700 1 -- 172.21.15.29:0/3010984410 >> v1:172.21.15.183:6789/0 conn(0x7faeb00cd6e0 legacy=0x7faeb00cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaffff700 1 -- 172.21.15.29:0/3010984410 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb015e290 con 0x7faeb015dda0 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaeffd700 1 --2- 172.21.15.29:0/3010984410 >> v2:172.21.15.183:3300/0 conn(0x7faeb00cdab0 0x7faeb015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeaffff700 1 --2- 172.21.15.29:0/3010984410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb015dda0 0x7faeb015cbd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faea8009f20 tx=0x7faea8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c5480554e19ec76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeae7fc700 1 -- 172.21.15.29:0/3010984410 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800e070 con 0x7faeb015dda0 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeae7fc700 1 -- 172.21.15.29:0/3010984410 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800b9d0 con 0x7faeb015dda0 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.964+0000 7faeae7fc700 1 -- 172.21.15.29:0/3010984410 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80092e0 con 0x7faeb015dda0 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.965+0000 7faeb4b77700 1 -- 172.21.15.29:0/3010984410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb015dda0 msgr2=0x7faeb015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.965+0000 7faeb4b77700 1 --2- 172.21.15.29:0/3010984410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb015dda0 0x7faeb015cbd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faea8009f20 tx=0x7faea8009840 comp rx=0 tx=0).stop 2023-10-08T15:40:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.965+0000 7faeb4b77700 1 -- 172.21.15.29:0/3010984410 shutdown_connections 2023-10-08T15:40:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.965+0000 7faeb4b77700 1 --2- 172.21.15.29:0/3010984410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb015dda0 0x7faeb015cbd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.965+0000 7faeb4b77700 1 --2- 172.21.15.29:0/3010984410 >> v2:172.21.15.183:3300/0 conn(0x7faeb00cdab0 0x7faeb015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.965+0000 7faeb4b77700 1 -- 172.21.15.29:0/3010984410 >> 172.21.15.29:0/3010984410 conn(0x7faeb0067660 msgr2=0x7faeb0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.965+0000 7faeb4b77700 1 -- 172.21.15.29:0/3010984410 shutdown_connections 2023-10-08T15:40:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.965+0000 7faeb4b77700 1 -- 172.21.15.29:0/3010984410 wait complete. 2023-10-08T15:40:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.966+0000 7faeb4b77700 1 Processor -- start 2023-10-08T15:40:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.966+0000 7faeb4b77700 1 -- start start 2023-10-08T15:40:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeb4b77700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeb00cd6e0 0x7faeb014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeb4b77700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb00cdab0 0x7faeb00b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeb4b77700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb015dda0 0x7faeb00b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeb4b77700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb014c890 con 0x7faeb00cd6e0 2023-10-08T15:40:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeb4b77700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00c86f0 con 0x7faeb015dda0 2023-10-08T15:40:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeb4b77700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00b5f80 con 0x7faeb00cdab0 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeb00cd6e0 0x7faeb014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeb00cd6e0 0x7faeb014bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57818/0 (socket says 172.21.15.29:57818) 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 -- 172.21.15.29:0/2094775939 learned_addr learned my addr 172.21.15.29:0/2094775939 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaffff700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb015dda0 0x7faeb00b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaeffd700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb00cdab0 0x7faeb00b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 -- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb00cdab0 msgr2=0x7faeb00b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb00cdab0 0x7faeb00b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 -- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb015dda0 msgr2=0x7faeb00b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb015dda0 0x7faeb00b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 -- 172.21.15.29:0/2094775939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea4009420 con 0x7faeb00cd6e0 2023-10-08T15:40:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7faeaf7fe700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeb00cd6e0 0x7faeb014bd10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faea000c560 tx=0x7faea0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.967+0000 7fae977fe700 1 -- 172.21.15.29:0/2094775939 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0005a70 con 0x7faeb00cd6e0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.968+0000 7fae977fe700 1 -- 172.21.15.29:0/2094775939 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea0005bd0 con 0x7faeb00cd6e0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.968+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea8009ae0 con 0x7faeb00cd6e0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.968+0000 7fae977fe700 1 -- 172.21.15.29:0/2094775939 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea00070d0 con 0x7faeb00cd6e0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.968+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb00c80a0 con 0x7faeb00cd6e0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.968+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb0089280 con 0x7faeb00cd6e0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.969+0000 7fae977fe700 1 -- 172.21.15.29:0/2094775939 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faea0007480 con 0x7faeb00cd6e0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.969+0000 7fae977fe700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae9c066f30 0x7fae9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.969+0000 7fae977fe700 1 -- 172.21.15.29:0/2094775939 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faea00838a0 con 0x7faeb00cd6e0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.969+0000 7faeaeffd700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae9c066f30 0x7fae9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.970+0000 7faeaeffd700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae9c066f30 0x7fae9c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faeb00c7a00 tx=0x7faea40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:27.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:27.974+0000 7fae977fe700 1 -- 172.21.15.29:0/2094775939 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faea0050b10 con 0x7faeb00cd6e0 2023-10-08T15:40:28.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.160+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faeb004bb80 con 0x7fae9c066f30 2023-10-08T15:40:28.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.167+0000 7fae977fe700 1 -- 172.21.15.29:0/2094775939 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257349 (secure 0 0 0) 0x7faeb004bb80 con 0x7fae9c066f30 2023-10-08T15:40:28.170 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae9c066f30 msgr2=0x7fae9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae9c066f30 0x7fae9c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faeb00c7a00 tx=0x7faea40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeb00cd6e0 msgr2=0x7faeb014bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeb00cd6e0 0x7faeb014bd10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faea000c560 tx=0x7faea0007f70 comp rx=0 tx=0).stop 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 shutdown_connections 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae9c066f30 0x7fae9c0693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faeb015dda0 0x7faeb00b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeb00cd6e0 0x7faeb014bd10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 --2- 172.21.15.29:0/2094775939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faeb00cdab0 0x7faeb00b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 >> 172.21.15.29:0/2094775939 conn(0x7faeb0067660 msgr2=0x7faeb00cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 shutdown_connections 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.170+0000 7faeb4b77700 1 -- 172.21.15.29:0/2094775939 wait complete. 2023-10-08T15:40:28.173 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:40:28.182 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-10-08T15:40:26.303026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560910,"statfs":{"total":1600000000,"available":1598372246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.620058"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693529+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691024+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692619+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693983+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.697525+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694739+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691637+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693023+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.695987+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691951+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693336+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689391+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692614+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693509+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691228+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694333+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.696842+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689960+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.695512+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695776+0000","last_change":"2023-10-08T15:40:22.695776+0000","last_active":"2023-10-08T15:40:22.695776+0000","last_peered":"2023-10-08T15:40:22.695776+0000","last_clean":"2023-10-08T15:40:22.695776+0000","last_became_active":"2023-10-08T15:40:22.695553+0000","last_became_peered":"2023-10-08T15:40:22.695553+0000","last_unstale":"2023-10-08T15:40:22.695776+0000","last_undegraded":"2023-10-08T15:40:22.695776+0000","last_fullsized":"2023-10-08T15:40:22.695776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693470+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699564+0000","last_change":"2023-10-08T15:40:22.699564+0000","last_active":"2023-10-08T15:40:22.699564+0000","last_peered":"2023-10-08T15:40:22.699564+0000","last_clean":"2023-10-08T15:40:22.699564+0000","last_became_active":"2023-10-08T15:40:22.698627+0000","last_became_peered":"2023-10-08T15:40:22.698627+0000","last_unstale":"2023-10-08T15:40:22.699564+0000","last_undegraded":"2023-10-08T15:40:22.699564+0000","last_fullsized":"2023-10-08T15:40:22.699564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692277+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700173+0000","last_change":"2023-10-08T15:40:22.700173+0000","last_active":"2023-10-08T15:40:22.700173+0000","last_peered":"2023-10-08T15:40:22.700173+0000","last_clean":"2023-10-08T15:40:22.700173+0000","last_became_active":"2023-10-08T15:40:22.699897+0000","last_became_peered":"2023-10-08T15:40:22.699897+0000","last_unstale":"2023-10-08T15:40:22.700173+0000","last_undegraded":"2023-10-08T15:40:22.700173+0000","last_fullsized":"2023-10-08T15:40:22.700173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:48.001159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692202+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702341+0000","last_change":"2023-10-08T15:40:22.702341+0000","last_active":"2023-10-08T15:40:22.702341+0000","last_peered":"2023-10-08T15:40:22.702341+0000","last_clean":"2023-10-08T15:40:22.702341+0000","last_became_active":"2023-10-08T15:40:22.701383+0000","last_became_peered":"2023-10-08T15:40:22.701383+0000","last_unstale":"2023-10-08T15:40:22.702341+0000","last_undegraded":"2023-10-08T15:40:22.702341+0000","last_fullsized":"2023-10-08T15:40:22.702341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691316+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698477+0000","last_change":"2023-10-08T15:40:22.698477+0000","last_active":"2023-10-08T15:40:22.698477+0000","last_peered":"2023-10-08T15:40:22.698477+0000","last_clean":"2023-10-08T15:40:22.698477+0000","last_became_active":"2023-10-08T15:40:22.698057+0000","last_became_peered":"2023-10-08T15:40:22.698057+0000","last_unstale":"2023-10-08T15:40:22.698477+0000","last_undegraded":"2023-10-08T15:40:22.698477+0000","last_fullsized":"2023-10-08T15:40:22.698477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690441+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695547+0000","last_change":"2023-10-08T15:40:22.695547+0000","last_active":"2023-10-08T15:40:22.695547+0000","last_peered":"2023-10-08T15:40:22.695547+0000","last_clean":"2023-10-08T15:40:22.695547+0000","last_became_active":"2023-10-08T15:40:22.695272+0000","last_became_peered":"2023-10-08T15:40:22.695272+0000","last_unstale":"2023-10-08T15:40:22.695547+0000","last_undegraded":"2023-10-08T15:40:22.695547+0000","last_fullsized":"2023-10-08T15:40:22.695547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690907+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700006+0000","last_change":"2023-10-08T15:40:22.700006+0000","last_active":"2023-10-08T15:40:22.700006+0000","last_peered":"2023-10-08T15:40:22.700006+0000","last_clean":"2023-10-08T15:40:22.700006+0000","last_became_active":"2023-10-08T15:40:22.699783+0000","last_became_peered":"2023-10-08T15:40:22.699783+0000","last_unstale":"2023-10-08T15:40:22.700006+0000","last_undegraded":"2023-10-08T15:40:22.700006+0000","last_fullsized":"2023-10-08T15:40:22.700006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690498+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695652+0000","last_change":"2023-10-08T15:40:22.695652+0000","last_active":"2023-10-08T15:40:22.695652+0000","last_peered":"2023-10-08T15:40:22.695652+0000","last_clean":"2023-10-08T15:40:22.695652+0000","last_became_active":"2023-10-08T15:40:22.695043+0000","last_became_peered":"2023-10-08T15:40:22.695043+0000","last_unstale":"2023-10-08T15:40:22.695652+0000","last_undegraded":"2023-10-08T15:40:22.695652+0000","last_fullsized":"2023-10-08T15:40:22.695652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691125+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702796+0000","last_change":"2023-10-08T15:40:22.702796+0000","last_active":"2023-10-08T15:40:22.702796+0000","last_peered":"2023-10-08T15:40:22.702796+0000","last_clean":"2023-10-08T15:40:22.702796+0000","last_became_active":"2023-10-08T15:40:22.702571+0000","last_became_peered":"2023-10-08T15:40:22.702571+0000","last_unstale":"2023-10-08T15:40:22.702796+0000","last_undegraded":"2023-10-08T15:40:22.702796+0000","last_fullsized":"2023-10-08T15:40:22.702796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690992+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702638+0000","last_change":"2023-10-08T15:40:22.702638+0000","last_active":"2023-10-08T15:40:22.702638+0000","last_peered":"2023-10-08T15:40:22.702638+0000","last_clean":"2023-10-08T15:40:22.702638+0000","last_became_active":"2023-10-08T15:40:22.702409+0000","last_became_peered":"2023-10-08T15:40:22.702409+0000","last_unstale":"2023-10-08T15:40:22.702638+0000","last_undegraded":"2023-10-08T15:40:22.702638+0000","last_fullsized":"2023-10-08T15:40:22.702638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692194+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.697798+0000","last_change":"2023-10-08T15:40:22.697798+0000","last_active":"2023-10-08T15:40:22.697798+0000","last_peered":"2023-10-08T15:40:22.697798+0000","last_clean":"2023-10-08T15:40:22.697798+0000","last_became_active":"2023-10-08T15:40:22.697562+0000","last_became_peered":"2023-10-08T15:40:22.697562+0000","last_unstale":"2023-10-08T15:40:22.697798+0000","last_undegraded":"2023-10-08T15:40:22.697798+0000","last_fullsized":"2023-10-08T15:40:22.697798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689689+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700551+0000","last_change":"2023-10-08T15:40:22.700551+0000","last_active":"2023-10-08T15:40:22.700551+0000","last_peered":"2023-10-08T15:40:22.700551+0000","last_clean":"2023-10-08T15:40:22.700551+0000","last_became_active":"2023-10-08T15:40:22.700305+0000","last_became_peered":"2023-10-08T15:40:22.700305+0000","last_unstale":"2023-10-08T15:40:22.700551+0000","last_undegraded":"2023-10-08T15:40:22.700551+0000","last_fullsized":"2023-10-08T15:40:22.700551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690968+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695062+0000","last_change":"2023-10-08T15:40:22.695062+0000","last_active":"2023-10-08T15:40:22.695062+0000","last_peered":"2023-10-08T15:40:22.695062+0000","last_clean":"2023-10-08T15:40:22.695062+0000","last_became_active":"2023-10-08T15:40:22.694763+0000","last_became_peered":"2023-10-08T15:40:22.694763+0000","last_unstale":"2023-10-08T15:40:22.695062+0000","last_undegraded":"2023-10-08T15:40:22.695062+0000","last_fullsized":"2023-10-08T15:40:22.695062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691797+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701263+0000","last_change":"2023-10-08T15:40:22.701263+0000","last_active":"2023-10-08T15:40:22.701263+0000","last_peered":"2023-10-08T15:40:22.701263+0000","last_clean":"2023-10-08T15:40:22.701263+0000","last_became_active":"2023-10-08T15:40:22.700296+0000","last_became_peered":"2023-10-08T15:40:22.700296+0000","last_unstale":"2023-10-08T15:40:22.701263+0000","last_undegraded":"2023-10-08T15:40:22.701263+0000","last_fullsized":"2023-10-08T15:40:22.701263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.697143+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699338+0000","last_change":"2023-10-08T15:40:22.699338+0000","last_active":"2023-10-08T15:40:22.699338+0000","last_peered":"2023-10-08T15:40:22.699338+0000","last_clean":"2023-10-08T15:40:22.699338+0000","last_became_active":"2023-10-08T15:40:22.698307+0000","last_became_peered":"2023-10-08T15:40:22.698307+0000","last_unstale":"2023-10-08T15:40:22.699338+0000","last_undegraded":"2023-10-08T15:40:22.699338+0000","last_fullsized":"2023-10-08T15:40:22.699338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693459+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.692944+0000","last_change":"2023-10-08T15:40:22.692944+0000","last_active":"2023-10-08T15:40:22.692944+0000","last_peered":"2023-10-08T15:40:22.692944+0000","last_clean":"2023-10-08T15:40:22.692944+0000","last_became_active":"2023-10-08T15:40:22.692741+0000","last_became_peered":"2023-10-08T15:40:22.692741+0000","last_unstale":"2023-10-08T15:40:22.692944+0000","last_undegraded":"2023-10-08T15:40:22.692944+0000","last_fullsized":"2023-10-08T15:40:22.692944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691096+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.696237+0000","last_change":"2023-10-08T15:40:22.696237+0000","last_active":"2023-10-08T15:40:22.696237+0000","last_peered":"2023-10-08T15:40:22.696237+0000","last_clean":"2023-10-08T15:40:22.696237+0000","last_became_active":"2023-10-08T15:40:22.695953+0000","last_became_peered":"2023-10-08T15:40:22.695953+0000","last_unstale":"2023-10-08T15:40:22.696237+0000","last_undegraded":"2023-10-08T15:40:22.696237+0000","last_fullsized":"2023-10-08T15:40:22.696237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:40.912548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691778+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695667+0000","last_change":"2023-10-08T15:40:22.695667+0000","last_active":"2023-10-08T15:40:22.695667+0000","last_peered":"2023-10-08T15:40:22.695667+0000","last_clean":"2023-10-08T15:40:22.695667+0000","last_became_active":"2023-10-08T15:40:22.695439+0000","last_became_peered":"2023-10-08T15:40:22.695439+0000","last_unstale":"2023-10-08T15:40:22.695667+0000","last_undegraded":"2023-10-08T15:40:22.695667+0000","last_fullsized":"2023-10-08T15:40:22.695667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690107+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698283+0000","last_change":"2023-10-08T15:40:22.698283+0000","last_active":"2023-10-08T15:40:22.698283+0000","last_peered":"2023-10-08T15:40:22.698283+0000","last_clean":"2023-10-08T15:40:22.698283+0000","last_became_active":"2023-10-08T15:40:22.697621+0000","last_became_peered":"2023-10-08T15:40:22.697621+0000","last_unstale":"2023-10-08T15:40:22.698283+0000","last_undegraded":"2023-10-08T15:40:22.698283+0000","last_fullsized":"2023-10-08T15:40:22.698283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689173+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:20.554850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690751+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698673+0000","last_change":"2023-10-08T15:40:22.698673+0000","last_active":"2023-10-08T15:40:22.698673+0000","last_peered":"2023-10-08T15:40:22.698673+0000","last_clean":"2023-10-08T15:40:22.698673+0000","last_became_active":"2023-10-08T15:40:22.698433+0000","last_became_peered":"2023-10-08T15:40:22.698433+0000","last_unstale":"2023-10-08T15:40:22.698673+0000","last_undegraded":"2023-10-08T15:40:22.698673+0000","last_fullsized":"2023-10-08T15:40:22.698673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693015+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701412+0000","last_change":"2023-10-08T15:40:22.701412+0000","last_active":"2023-10-08T15:40:22.701412+0000","last_peered":"2023-10-08T15:40:22.701412+0000","last_clean":"2023-10-08T15:40:22.701412+0000","last_became_active":"2023-10-08T15:40:22.701018+0000","last_became_peered":"2023-10-08T15:40:22.701018+0000","last_unstale":"2023-10-08T15:40:22.701412+0000","last_undegraded":"2023-10-08T15:40:22.701412+0000","last_fullsized":"2023-10-08T15:40:22.701412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T15:40:21.685151+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:40:21.685151+0000","last_peered":"2023-10-08T15:40:21.685151+0000","last_clean":"2023-10-08T15:40:21.685151+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:40:21.685151+0000","last_undegraded":"2023-10-08T15:40:21.685151+0000","last_fullsized":"2023-10-08T15:40:21.685151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691253+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702091+0000","last_change":"2023-10-08T15:40:22.702091+0000","last_active":"2023-10-08T15:40:22.702091+0000","last_peered":"2023-10-08T15:40:22.702091+0000","last_clean":"2023-10-08T15:40:22.702091+0000","last_became_active":"2023-10-08T15:40:22.701729+0000","last_became_peered":"2023-10-08T15:40:22.701729+0000","last_unstale":"2023-10-08T15:40:22.702091+0000","last_undegraded":"2023-10-08T15:40:22.702091+0000","last_fullsized":"2023-10-08T15:40:22.702091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:00.869317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701958+0000","last_change":"2023-10-08T15:40:22.701958+0000","last_active":"2023-10-08T15:40:22.701958+0000","last_peered":"2023-10-08T15:40:22.701958+0000","last_clean":"2023-10-08T15:40:22.701958+0000","last_became_active":"2023-10-08T15:40:22.701237+0000","last_became_peered":"2023-10-08T15:40:22.701237+0000","last_unstale":"2023-10-08T15:40:22.701958+0000","last_undegraded":"2023-10-08T15:40:22.701958+0000","last_fullsized":"2023-10-08T15:40:22.701958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690858+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702336+0000","last_change":"2023-10-08T15:40:22.702336+0000","last_active":"2023-10-08T15:40:22.702336+0000","last_peered":"2023-10-08T15:40:22.702336+0000","last_clean":"2023-10-08T15:40:22.702336+0000","last_became_active":"2023-10-08T15:40:22.702088+0000","last_became_peered":"2023-10-08T15:40:22.702088+0000","last_unstale":"2023-10-08T15:40:22.702336+0000","last_undegraded":"2023-10-08T15:40:22.702336+0000","last_fullsized":"2023-10-08T15:40:22.702336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693412+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699798+0000","last_change":"2023-10-08T15:40:22.699798+0000","last_active":"2023-10-08T15:40:22.699798+0000","last_peered":"2023-10-08T15:40:22.699798+0000","last_clean":"2023-10-08T15:40:22.699798+0000","last_became_active":"2023-10-08T15:40:22.699567+0000","last_became_peered":"2023-10-08T15:40:22.699567+0000","last_unstale":"2023-10-08T15:40:22.699798+0000","last_undegraded":"2023-10-08T15:40:22.699798+0000","last_fullsized":"2023-10-08T15:40:22.699798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691937+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701044+0000","last_change":"2023-10-08T15:40:22.701044+0000","last_active":"2023-10-08T15:40:22.701044+0000","last_peered":"2023-10-08T15:40:22.701044+0000","last_clean":"2023-10-08T15:40:22.701044+0000","last_became_active":"2023-10-08T15:40:22.700575+0000","last_became_peered":"2023-10-08T15:40:22.700575+0000","last_unstale":"2023-10-08T15:40:22.701044+0000","last_undegraded":"2023-10-08T15:40:22.701044+0000","last_fullsized":"2023-10-08T15:40:22.701044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689144+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:56.355768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700842+0000","last_change":"2023-10-08T15:40:22.700842+0000","last_active":"2023-10-08T15:40:22.700842+0000","last_peered":"2023-10-08T15:40:22.700842+0000","last_clean":"2023-10-08T15:40:22.700842+0000","last_became_active":"2023-10-08T15:40:22.700609+0000","last_became_peered":"2023-10-08T15:40:22.700609+0000","last_unstale":"2023-10-08T15:40:22.700842+0000","last_undegraded":"2023-10-08T15:40:22.700842+0000","last_fullsized":"2023-10-08T15:40:22.700842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691193+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700304+0000","last_change":"2023-10-08T15:40:22.700304+0000","last_active":"2023-10-08T15:40:22.700304+0000","last_peered":"2023-10-08T15:40:22.700304+0000","last_clean":"2023-10-08T15:40:22.700304+0000","last_became_active":"2023-10-08T15:40:22.700075+0000","last_became_peered":"2023-10-08T15:40:22.700075+0000","last_unstale":"2023-10-08T15:40:22.700304+0000","last_undegraded":"2023-10-08T15:40:22.700304+0000","last_fullsized":"2023-10-08T15:40:22.700304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691547+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699299+0000","last_change":"2023-10-08T15:40:22.699299+0000","last_active":"2023-10-08T15:40:22.699299+0000","last_peered":"2023-10-08T15:40:22.699299+0000","last_clean":"2023-10-08T15:40:22.699299+0000","last_became_active":"2023-10-08T15:40:22.699051+0000","last_became_peered":"2023-10-08T15:40:22.699051+0000","last_unstale":"2023-10-08T15:40:22.699299+0000","last_undegraded":"2023-10-08T15:40:22.699299+0000","last_fullsized":"2023-10-08T15:40:22.699299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691403+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.694836+0000","last_change":"2023-10-08T15:40:22.694836+0000","last_active":"2023-10-08T15:40:22.694836+0000","last_peered":"2023-10-08T15:40:22.694836+0000","last_clean":"2023-10-08T15:40:22.694836+0000","last_became_active":"2023-10-08T15:40:22.694608+0000","last_became_peered":"2023-10-08T15:40:22.694608+0000","last_unstale":"2023-10-08T15:40:22.694836+0000","last_undegraded":"2023-10-08T15:40:22.694836+0000","last_fullsized":"2023-10-08T15:40:22.694836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691764+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.694954+0000","last_change":"2023-10-08T15:40:22.694954+0000","last_active":"2023-10-08T15:40:22.694954+0000","last_peered":"2023-10-08T15:40:22.694954+0000","last_clean":"2023-10-08T15:40:22.694954+0000","last_became_active":"2023-10-08T15:40:22.694720+0000","last_became_peered":"2023-10-08T15:40:22.694720+0000","last_unstale":"2023-10-08T15:40:22.694954+0000","last_undegraded":"2023-10-08T15:40:22.694954+0000","last_fullsized":"2023-10-08T15:40:22.694954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690636+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.696186+0000","last_change":"2023-10-08T15:40:22.696186+0000","last_active":"2023-10-08T15:40:22.696186+0000","last_peered":"2023-10-08T15:40:22.696186+0000","last_clean":"2023-10-08T15:40:22.696186+0000","last_became_active":"2023-10-08T15:40:22.695949+0000","last_became_peered":"2023-10-08T15:40:22.695949+0000","last_unstale":"2023-10-08T15:40:22.696186+0000","last_undegraded":"2023-10-08T15:40:22.696186+0000","last_fullsized":"2023-10-08T15:40:22.696186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692910+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.696262+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690372+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691698+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694335+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691906+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690392+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692069+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691009+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690586+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692271+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693301+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692573+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691224+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199352189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199352189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]}],"pool_statfs":[]}} 2023-10-08T15:40:28.281 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.400+0000 7fee6e8de700 1 Processor -- start 2023-10-08T15:40:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.400+0000 7fee6e8de700 1 -- start start 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee6e8de700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee6815a620 0x7fee6815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee6e8de700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6815cbb0 con 0x7fee6815d580 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee6e8de700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6815bfa0 con 0x7fee68157870 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee6e8de700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6815bdb0 con 0x7fee6815a620 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee677fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee6815a620 0x7fee6815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee6ce7b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fee6815d580 0x7fee68158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43182/0 (socket says 172.21.15.29:43182) 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee6ce7b700 1 -- 172.21.15.29:0/3560659319 learned_addr learned my addr 172.21.15.29:0/3560659319 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee677fe700 1 --2- 172.21.15.29:0/3560659319 >> v2:172.21.15.29:3300/0 conn(0x7fee6815a620 0x7fee6815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33426/0 (socket says 172.21.15.29:33426) 2023-10-08T15:40:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee66ffd700 1 -- 172.21.15.29:0/3560659319 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555477287 0 0) 0x7fee6815cbb0 con 0x7fee6815d580 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee66ffd700 1 -- 172.21.15.29:0/3560659319 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee54003570 con 0x7fee6815d580 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee677fe700 1 -- 172.21.15.29:0/3560659319 >> v1:172.21.15.183:6789/0 conn(0x7fee68157870 legacy=0x7fee6815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee677fe700 1 -- 172.21.15.29:0/3560659319 >> v1:172.21.15.29:6789/0 conn(0x7fee6815d580 legacy=0x7fee68158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee677fe700 1 -- 172.21.15.29:0/3560659319 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6815c280 con 0x7fee6815a620 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.401+0000 7fee677fe700 1 --2- 172.21.15.29:0/3560659319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815a620 0x7fee6815d040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee580098e0 tx=0x7fee580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2201db66c7cf854f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee66ffd700 1 -- 172.21.15.29:0/3560659319 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5800b640 con 0x7fee6815a620 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee66ffd700 1 -- 172.21.15.29:0/3560659319 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5800b7a0 con 0x7fee6815a620 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee66ffd700 1 -- 172.21.15.29:0/3560659319 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5800bb40 con 0x7fee6815a620 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee6e8de700 1 -- 172.21.15.29:0/3560659319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815a620 msgr2=0x7fee6815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee6e8de700 1 --2- 172.21.15.29:0/3560659319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815a620 0x7fee6815d040 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee580098e0 tx=0x7fee580091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee6e8de700 1 -- 172.21.15.29:0/3560659319 shutdown_connections 2023-10-08T15:40:28.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee6e8de700 1 --2- 172.21.15.29:0/3560659319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815a620 0x7fee6815d040 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee6e8de700 1 -- 172.21.15.29:0/3560659319 >> 172.21.15.29:0/3560659319 conn(0x7fee68068ce0 msgr2=0x7fee680690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:28.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee6e8de700 1 -- 172.21.15.29:0/3560659319 shutdown_connections 2023-10-08T15:40:28.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.402+0000 7fee6e8de700 1 -- 172.21.15.29:0/3560659319 wait complete. 2023-10-08T15:40:28.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.403+0000 7fee6e8de700 1 Processor -- start 2023-10-08T15:40:28.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.403+0000 7fee6e8de700 1 -- start start 2023-10-08T15:40:28.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6e8de700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee68157870 0x7fee68151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:28.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6e8de700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6815a620 0x7fee680b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6e8de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815d580 0x7fee68152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6e8de700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6816b530 con 0x7fee6815d580 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6e8de700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681516c0 con 0x7fee6815a620 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6e8de700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680b2f50 con 0x7fee68157870 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6ce7b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815d580 0x7fee68152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6ce7b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815d580 0x7fee68152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33442/0 (socket says 172.21.15.29:33442) 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee6ce7b700 1 -- 172.21.15.29:0/624454872 learned_addr learned my addr 172.21.15.29:0/624454872 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee677fe700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6815a620 0x7fee680b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.404+0000 7fee67fff700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee68157870 0x7fee68151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee6ce7b700 1 -- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee68157870 msgr2=0x7fee68151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:28.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee6ce7b700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee68157870 0x7fee68151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee6ce7b700 1 -- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6815a620 msgr2=0x7fee680b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee6ce7b700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6815a620 0x7fee680b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee6ce7b700 1 -- 172.21.15.29:0/624454872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58009420 con 0x7fee6815d580 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee6ce7b700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815d580 0x7fee68152bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cc40 tx=0x7fee60001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee5ffff700 1 -- 172.21.15.29:0/624454872 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000a850 con 0x7fee6815d580 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee5ffff700 1 -- 172.21.15.29:0/624454872 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000a9b0 con 0x7fee6815d580 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee68150b00 con 0x7fee6815d580 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee5ffff700 1 -- 172.21.15.29:0/624454872 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000ad30 con 0x7fee6815d580 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.405+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6815dba0 con 0x7fee6815d580 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.406+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6804c3c0 con 0x7fee6815d580 2023-10-08T15:40:28.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.406+0000 7fee5ffff700 1 -- 172.21.15.29:0/624454872 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee60007300 con 0x7fee6815d580 2023-10-08T15:40:28.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.407+0000 7fee5ffff700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee48066f30 0x7fee480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:28.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.407+0000 7fee5ffff700 1 -- 172.21.15.29:0/624454872 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee600848b0 con 0x7fee6815d580 2023-10-08T15:40:28.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.407+0000 7fee67fff700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee48066f30 0x7fee480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:28.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.407+0000 7fee67fff700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee48066f30 0x7fee480693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee50003860 tx=0x7fee50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:28.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.411+0000 7fee5ffff700 1 -- 172.21.15.29:0/624454872 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee60051b10 con 0x7fee6815d580 2023-10-08T15:40:28.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.599+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee6815c560 con 0x7fee48066f30 2023-10-08T15:40:28.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.606+0000 7fee5ffff700 1 -- 172.21.15.29:0/624454872 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257349 (secure 0 0 0) 0x7fee6815c560 con 0x7fee48066f30 2023-10-08T15:40:28.609 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:28.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee48066f30 msgr2=0x7fee480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:28.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee48066f30 0x7fee480693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee50003860 tx=0x7fee50009040 comp rx=0 tx=0).stop 2023-10-08T15:40:28.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815d580 msgr2=0x7fee68152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815d580 0x7fee68152bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cc40 tx=0x7fee60001a00 comp rx=0 tx=0).stop 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 shutdown_connections 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee48066f30 0x7fee480693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6815d580 0x7fee68152bb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee68157870 0x7fee68151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 --2- 172.21.15.29:0/624454872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6815a620 0x7fee680b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 >> 172.21.15.29:0/624454872 conn(0x7fee68068ce0 msgr2=0x7fee680b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 shutdown_connections 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.609+0000 7fee6e8de700 1 -- 172.21.15.29:0/624454872 wait complete. 2023-10-08T15:40:28.612 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:40:28.621 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T15:40:28.303589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560910,"statfs":{"total":1600000000,"available":1598372246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001487"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693529+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691024+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692619+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693983+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.697525+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694739+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691637+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693023+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.695987+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691951+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693336+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689391+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692614+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693509+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691228+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694333+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.696842+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689960+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.695512+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695776+0000","last_change":"2023-10-08T15:40:22.695776+0000","last_active":"2023-10-08T15:40:22.695776+0000","last_peered":"2023-10-08T15:40:22.695776+0000","last_clean":"2023-10-08T15:40:22.695776+0000","last_became_active":"2023-10-08T15:40:22.695553+0000","last_became_peered":"2023-10-08T15:40:22.695553+0000","last_unstale":"2023-10-08T15:40:22.695776+0000","last_undegraded":"2023-10-08T15:40:22.695776+0000","last_fullsized":"2023-10-08T15:40:22.695776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693470+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699564+0000","last_change":"2023-10-08T15:40:22.699564+0000","last_active":"2023-10-08T15:40:22.699564+0000","last_peered":"2023-10-08T15:40:22.699564+0000","last_clean":"2023-10-08T15:40:22.699564+0000","last_became_active":"2023-10-08T15:40:22.698627+0000","last_became_peered":"2023-10-08T15:40:22.698627+0000","last_unstale":"2023-10-08T15:40:22.699564+0000","last_undegraded":"2023-10-08T15:40:22.699564+0000","last_fullsized":"2023-10-08T15:40:22.699564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692277+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700173+0000","last_change":"2023-10-08T15:40:22.700173+0000","last_active":"2023-10-08T15:40:22.700173+0000","last_peered":"2023-10-08T15:40:22.700173+0000","last_clean":"2023-10-08T15:40:22.700173+0000","last_became_active":"2023-10-08T15:40:22.699897+0000","last_became_peered":"2023-10-08T15:40:22.699897+0000","last_unstale":"2023-10-08T15:40:22.700173+0000","last_undegraded":"2023-10-08T15:40:22.700173+0000","last_fullsized":"2023-10-08T15:40:22.700173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:48.001159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692202+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702341+0000","last_change":"2023-10-08T15:40:22.702341+0000","last_active":"2023-10-08T15:40:22.702341+0000","last_peered":"2023-10-08T15:40:22.702341+0000","last_clean":"2023-10-08T15:40:22.702341+0000","last_became_active":"2023-10-08T15:40:22.701383+0000","last_became_peered":"2023-10-08T15:40:22.701383+0000","last_unstale":"2023-10-08T15:40:22.702341+0000","last_undegraded":"2023-10-08T15:40:22.702341+0000","last_fullsized":"2023-10-08T15:40:22.702341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691316+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698477+0000","last_change":"2023-10-08T15:40:22.698477+0000","last_active":"2023-10-08T15:40:22.698477+0000","last_peered":"2023-10-08T15:40:22.698477+0000","last_clean":"2023-10-08T15:40:22.698477+0000","last_became_active":"2023-10-08T15:40:22.698057+0000","last_became_peered":"2023-10-08T15:40:22.698057+0000","last_unstale":"2023-10-08T15:40:22.698477+0000","last_undegraded":"2023-10-08T15:40:22.698477+0000","last_fullsized":"2023-10-08T15:40:22.698477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690441+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695547+0000","last_change":"2023-10-08T15:40:22.695547+0000","last_active":"2023-10-08T15:40:22.695547+0000","last_peered":"2023-10-08T15:40:22.695547+0000","last_clean":"2023-10-08T15:40:22.695547+0000","last_became_active":"2023-10-08T15:40:22.695272+0000","last_became_peered":"2023-10-08T15:40:22.695272+0000","last_unstale":"2023-10-08T15:40:22.695547+0000","last_undegraded":"2023-10-08T15:40:22.695547+0000","last_fullsized":"2023-10-08T15:40:22.695547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690907+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700006+0000","last_change":"2023-10-08T15:40:22.700006+0000","last_active":"2023-10-08T15:40:22.700006+0000","last_peered":"2023-10-08T15:40:22.700006+0000","last_clean":"2023-10-08T15:40:22.700006+0000","last_became_active":"2023-10-08T15:40:22.699783+0000","last_became_peered":"2023-10-08T15:40:22.699783+0000","last_unstale":"2023-10-08T15:40:22.700006+0000","last_undegraded":"2023-10-08T15:40:22.700006+0000","last_fullsized":"2023-10-08T15:40:22.700006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690498+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695652+0000","last_change":"2023-10-08T15:40:22.695652+0000","last_active":"2023-10-08T15:40:22.695652+0000","last_peered":"2023-10-08T15:40:22.695652+0000","last_clean":"2023-10-08T15:40:22.695652+0000","last_became_active":"2023-10-08T15:40:22.695043+0000","last_became_peered":"2023-10-08T15:40:22.695043+0000","last_unstale":"2023-10-08T15:40:22.695652+0000","last_undegraded":"2023-10-08T15:40:22.695652+0000","last_fullsized":"2023-10-08T15:40:22.695652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691125+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702796+0000","last_change":"2023-10-08T15:40:22.702796+0000","last_active":"2023-10-08T15:40:22.702796+0000","last_peered":"2023-10-08T15:40:22.702796+0000","last_clean":"2023-10-08T15:40:22.702796+0000","last_became_active":"2023-10-08T15:40:22.702571+0000","last_became_peered":"2023-10-08T15:40:22.702571+0000","last_unstale":"2023-10-08T15:40:22.702796+0000","last_undegraded":"2023-10-08T15:40:22.702796+0000","last_fullsized":"2023-10-08T15:40:22.702796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690992+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702638+0000","last_change":"2023-10-08T15:40:22.702638+0000","last_active":"2023-10-08T15:40:22.702638+0000","last_peered":"2023-10-08T15:40:22.702638+0000","last_clean":"2023-10-08T15:40:22.702638+0000","last_became_active":"2023-10-08T15:40:22.702409+0000","last_became_peered":"2023-10-08T15:40:22.702409+0000","last_unstale":"2023-10-08T15:40:22.702638+0000","last_undegraded":"2023-10-08T15:40:22.702638+0000","last_fullsized":"2023-10-08T15:40:22.702638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692194+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.697798+0000","last_change":"2023-10-08T15:40:22.697798+0000","last_active":"2023-10-08T15:40:22.697798+0000","last_peered":"2023-10-08T15:40:22.697798+0000","last_clean":"2023-10-08T15:40:22.697798+0000","last_became_active":"2023-10-08T15:40:22.697562+0000","last_became_peered":"2023-10-08T15:40:22.697562+0000","last_unstale":"2023-10-08T15:40:22.697798+0000","last_undegraded":"2023-10-08T15:40:22.697798+0000","last_fullsized":"2023-10-08T15:40:22.697798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689689+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700551+0000","last_change":"2023-10-08T15:40:22.700551+0000","last_active":"2023-10-08T15:40:22.700551+0000","last_peered":"2023-10-08T15:40:22.700551+0000","last_clean":"2023-10-08T15:40:22.700551+0000","last_became_active":"2023-10-08T15:40:22.700305+0000","last_became_peered":"2023-10-08T15:40:22.700305+0000","last_unstale":"2023-10-08T15:40:22.700551+0000","last_undegraded":"2023-10-08T15:40:22.700551+0000","last_fullsized":"2023-10-08T15:40:22.700551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690968+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695062+0000","last_change":"2023-10-08T15:40:22.695062+0000","last_active":"2023-10-08T15:40:22.695062+0000","last_peered":"2023-10-08T15:40:22.695062+0000","last_clean":"2023-10-08T15:40:22.695062+0000","last_became_active":"2023-10-08T15:40:22.694763+0000","last_became_peered":"2023-10-08T15:40:22.694763+0000","last_unstale":"2023-10-08T15:40:22.695062+0000","last_undegraded":"2023-10-08T15:40:22.695062+0000","last_fullsized":"2023-10-08T15:40:22.695062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691797+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701263+0000","last_change":"2023-10-08T15:40:22.701263+0000","last_active":"2023-10-08T15:40:22.701263+0000","last_peered":"2023-10-08T15:40:22.701263+0000","last_clean":"2023-10-08T15:40:22.701263+0000","last_became_active":"2023-10-08T15:40:22.700296+0000","last_became_peered":"2023-10-08T15:40:22.700296+0000","last_unstale":"2023-10-08T15:40:22.701263+0000","last_undegraded":"2023-10-08T15:40:22.701263+0000","last_fullsized":"2023-10-08T15:40:22.701263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.697143+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699338+0000","last_change":"2023-10-08T15:40:22.699338+0000","last_active":"2023-10-08T15:40:22.699338+0000","last_peered":"2023-10-08T15:40:22.699338+0000","last_clean":"2023-10-08T15:40:22.699338+0000","last_became_active":"2023-10-08T15:40:22.698307+0000","last_became_peered":"2023-10-08T15:40:22.698307+0000","last_unstale":"2023-10-08T15:40:22.699338+0000","last_undegraded":"2023-10-08T15:40:22.699338+0000","last_fullsized":"2023-10-08T15:40:22.699338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693459+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.692944+0000","last_change":"2023-10-08T15:40:22.692944+0000","last_active":"2023-10-08T15:40:22.692944+0000","last_peered":"2023-10-08T15:40:22.692944+0000","last_clean":"2023-10-08T15:40:22.692944+0000","last_became_active":"2023-10-08T15:40:22.692741+0000","last_became_peered":"2023-10-08T15:40:22.692741+0000","last_unstale":"2023-10-08T15:40:22.692944+0000","last_undegraded":"2023-10-08T15:40:22.692944+0000","last_fullsized":"2023-10-08T15:40:22.692944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691096+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.696237+0000","last_change":"2023-10-08T15:40:22.696237+0000","last_active":"2023-10-08T15:40:22.696237+0000","last_peered":"2023-10-08T15:40:22.696237+0000","last_clean":"2023-10-08T15:40:22.696237+0000","last_became_active":"2023-10-08T15:40:22.695953+0000","last_became_peered":"2023-10-08T15:40:22.695953+0000","last_unstale":"2023-10-08T15:40:22.696237+0000","last_undegraded":"2023-10-08T15:40:22.696237+0000","last_fullsized":"2023-10-08T15:40:22.696237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:40.912548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691778+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695667+0000","last_change":"2023-10-08T15:40:22.695667+0000","last_active":"2023-10-08T15:40:22.695667+0000","last_peered":"2023-10-08T15:40:22.695667+0000","last_clean":"2023-10-08T15:40:22.695667+0000","last_became_active":"2023-10-08T15:40:22.695439+0000","last_became_peered":"2023-10-08T15:40:22.695439+0000","last_unstale":"2023-10-08T15:40:22.695667+0000","last_undegraded":"2023-10-08T15:40:22.695667+0000","last_fullsized":"2023-10-08T15:40:22.695667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690107+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698283+0000","last_change":"2023-10-08T15:40:22.698283+0000","last_active":"2023-10-08T15:40:22.698283+0000","last_peered":"2023-10-08T15:40:22.698283+0000","last_clean":"2023-10-08T15:40:22.698283+0000","last_became_active":"2023-10-08T15:40:22.697621+0000","last_became_peered":"2023-10-08T15:40:22.697621+0000","last_unstale":"2023-10-08T15:40:22.698283+0000","last_undegraded":"2023-10-08T15:40:22.698283+0000","last_fullsized":"2023-10-08T15:40:22.698283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689173+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:20.554850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690751+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698673+0000","last_change":"2023-10-08T15:40:22.698673+0000","last_active":"2023-10-08T15:40:22.698673+0000","last_peered":"2023-10-08T15:40:22.698673+0000","last_clean":"2023-10-08T15:40:22.698673+0000","last_became_active":"2023-10-08T15:40:22.698433+0000","last_became_peered":"2023-10-08T15:40:22.698433+0000","last_unstale":"2023-10-08T15:40:22.698673+0000","last_undegraded":"2023-10-08T15:40:22.698673+0000","last_fullsized":"2023-10-08T15:40:22.698673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693015+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701412+0000","last_change":"2023-10-08T15:40:22.701412+0000","last_active":"2023-10-08T15:40:22.701412+0000","last_peered":"2023-10-08T15:40:22.701412+0000","last_clean":"2023-10-08T15:40:22.701412+0000","last_became_active":"2023-10-08T15:40:22.701018+0000","last_became_peered":"2023-10-08T15:40:22.701018+0000","last_unstale":"2023-10-08T15:40:22.701412+0000","last_undegraded":"2023-10-08T15:40:22.701412+0000","last_fullsized":"2023-10-08T15:40:22.701412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T15:40:21.685151+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:40:21.685151+0000","last_peered":"2023-10-08T15:40:21.685151+0000","last_clean":"2023-10-08T15:40:21.685151+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:40:21.685151+0000","last_undegraded":"2023-10-08T15:40:21.685151+0000","last_fullsized":"2023-10-08T15:40:21.685151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691253+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702091+0000","last_change":"2023-10-08T15:40:22.702091+0000","last_active":"2023-10-08T15:40:22.702091+0000","last_peered":"2023-10-08T15:40:22.702091+0000","last_clean":"2023-10-08T15:40:22.702091+0000","last_became_active":"2023-10-08T15:40:22.701729+0000","last_became_peered":"2023-10-08T15:40:22.701729+0000","last_unstale":"2023-10-08T15:40:22.702091+0000","last_undegraded":"2023-10-08T15:40:22.702091+0000","last_fullsized":"2023-10-08T15:40:22.702091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:00.869317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701958+0000","last_change":"2023-10-08T15:40:22.701958+0000","last_active":"2023-10-08T15:40:22.701958+0000","last_peered":"2023-10-08T15:40:22.701958+0000","last_clean":"2023-10-08T15:40:22.701958+0000","last_became_active":"2023-10-08T15:40:22.701237+0000","last_became_peered":"2023-10-08T15:40:22.701237+0000","last_unstale":"2023-10-08T15:40:22.701958+0000","last_undegraded":"2023-10-08T15:40:22.701958+0000","last_fullsized":"2023-10-08T15:40:22.701958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690858+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702336+0000","last_change":"2023-10-08T15:40:22.702336+0000","last_active":"2023-10-08T15:40:22.702336+0000","last_peered":"2023-10-08T15:40:22.702336+0000","last_clean":"2023-10-08T15:40:22.702336+0000","last_became_active":"2023-10-08T15:40:22.702088+0000","last_became_peered":"2023-10-08T15:40:22.702088+0000","last_unstale":"2023-10-08T15:40:22.702336+0000","last_undegraded":"2023-10-08T15:40:22.702336+0000","last_fullsized":"2023-10-08T15:40:22.702336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693412+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699798+0000","last_change":"2023-10-08T15:40:22.699798+0000","last_active":"2023-10-08T15:40:22.699798+0000","last_peered":"2023-10-08T15:40:22.699798+0000","last_clean":"2023-10-08T15:40:22.699798+0000","last_became_active":"2023-10-08T15:40:22.699567+0000","last_became_peered":"2023-10-08T15:40:22.699567+0000","last_unstale":"2023-10-08T15:40:22.699798+0000","last_undegraded":"2023-10-08T15:40:22.699798+0000","last_fullsized":"2023-10-08T15:40:22.699798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691937+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701044+0000","last_change":"2023-10-08T15:40:22.701044+0000","last_active":"2023-10-08T15:40:22.701044+0000","last_peered":"2023-10-08T15:40:22.701044+0000","last_clean":"2023-10-08T15:40:22.701044+0000","last_became_active":"2023-10-08T15:40:22.700575+0000","last_became_peered":"2023-10-08T15:40:22.700575+0000","last_unstale":"2023-10-08T15:40:22.701044+0000","last_undegraded":"2023-10-08T15:40:22.701044+0000","last_fullsized":"2023-10-08T15:40:22.701044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689144+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:56.355768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700842+0000","last_change":"2023-10-08T15:40:22.700842+0000","last_active":"2023-10-08T15:40:22.700842+0000","last_peered":"2023-10-08T15:40:22.700842+0000","last_clean":"2023-10-08T15:40:22.700842+0000","last_became_active":"2023-10-08T15:40:22.700609+0000","last_became_peered":"2023-10-08T15:40:22.700609+0000","last_unstale":"2023-10-08T15:40:22.700842+0000","last_undegraded":"2023-10-08T15:40:22.700842+0000","last_fullsized":"2023-10-08T15:40:22.700842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691193+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700304+0000","last_change":"2023-10-08T15:40:22.700304+0000","last_active":"2023-10-08T15:40:22.700304+0000","last_peered":"2023-10-08T15:40:22.700304+0000","last_clean":"2023-10-08T15:40:22.700304+0000","last_became_active":"2023-10-08T15:40:22.700075+0000","last_became_peered":"2023-10-08T15:40:22.700075+0000","last_unstale":"2023-10-08T15:40:22.700304+0000","last_undegraded":"2023-10-08T15:40:22.700304+0000","last_fullsized":"2023-10-08T15:40:22.700304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691547+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699299+0000","last_change":"2023-10-08T15:40:22.699299+0000","last_active":"2023-10-08T15:40:22.699299+0000","last_peered":"2023-10-08T15:40:22.699299+0000","last_clean":"2023-10-08T15:40:22.699299+0000","last_became_active":"2023-10-08T15:40:22.699051+0000","last_became_peered":"2023-10-08T15:40:22.699051+0000","last_unstale":"2023-10-08T15:40:22.699299+0000","last_undegraded":"2023-10-08T15:40:22.699299+0000","last_fullsized":"2023-10-08T15:40:22.699299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691403+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.694836+0000","last_change":"2023-10-08T15:40:22.694836+0000","last_active":"2023-10-08T15:40:22.694836+0000","last_peered":"2023-10-08T15:40:22.694836+0000","last_clean":"2023-10-08T15:40:22.694836+0000","last_became_active":"2023-10-08T15:40:22.694608+0000","last_became_peered":"2023-10-08T15:40:22.694608+0000","last_unstale":"2023-10-08T15:40:22.694836+0000","last_undegraded":"2023-10-08T15:40:22.694836+0000","last_fullsized":"2023-10-08T15:40:22.694836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691764+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.694954+0000","last_change":"2023-10-08T15:40:22.694954+0000","last_active":"2023-10-08T15:40:22.694954+0000","last_peered":"2023-10-08T15:40:22.694954+0000","last_clean":"2023-10-08T15:40:22.694954+0000","last_became_active":"2023-10-08T15:40:22.694720+0000","last_became_peered":"2023-10-08T15:40:22.694720+0000","last_unstale":"2023-10-08T15:40:22.694954+0000","last_undegraded":"2023-10-08T15:40:22.694954+0000","last_fullsized":"2023-10-08T15:40:22.694954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690636+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.696186+0000","last_change":"2023-10-08T15:40:22.696186+0000","last_active":"2023-10-08T15:40:22.696186+0000","last_peered":"2023-10-08T15:40:22.696186+0000","last_clean":"2023-10-08T15:40:22.696186+0000","last_became_active":"2023-10-08T15:40:22.695949+0000","last_became_peered":"2023-10-08T15:40:22.695949+0000","last_unstale":"2023-10-08T15:40:22.696186+0000","last_undegraded":"2023-10-08T15:40:22.696186+0000","last_fullsized":"2023-10-08T15:40:22.696186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692910+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.696262+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690372+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691698+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694335+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691906+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690392+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692069+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691009+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690586+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692271+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693301+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692573+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691224+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199352189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199352189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]}],"pool_statfs":[]}} 2023-10-08T15:40:28.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-08T15:40:28.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693529+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691024+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692619+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693983+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.697525+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.694739+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691637+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693023+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.695987+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-08T15:40:28.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691951+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693336+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.689391+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692614+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693509+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691228+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.694333+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.696842+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.689960+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-08T15:40:28.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.695512+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-08T15:40:28.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693470+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-08T15:40:28.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692277+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-08T15:40:28.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692202+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-08T15:40:28.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691316+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690441+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690907+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690498+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691125+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-08T15:40:28.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690992+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692194+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.689689+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690968+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691797+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-08T15:40:28.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.697143+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-08T15:40:28.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693459+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:40:28.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-08T15:40:28.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691096+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-08T15:40:28.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691778+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-08T15:40:28.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690107+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-08T15:40:28.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.689173+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:39:20.554850+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:40:28.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690751+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693015+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691253+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690858+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-08T15:40:28.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693412+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691937+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.689144+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:50:56.355768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691193+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691547+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691403+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691764+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690636+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692910+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-08T15:40:28.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.696262+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690372+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691698+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.694335+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691906+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-08T15:40:28.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690392+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692069+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691009+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.690586+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692271+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-08T15:40:28.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.693301+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:40:28.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-08T15:40:28.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.692573+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:40:28.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-08T15:40:28.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:40:22.681788+0000', 'last_change': '2023-10-08T15:40:22.691224+0000', 'last_active': '2023-10-08T15:40:22.681788+0000', 'last_peered': '2023-10-08T15:40:22.681788+0000', 'last_clean': '2023-10-08T15:40:22.681788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:40:22.681788+0000', 'last_undegraded': '2023-10-08T15:40:22.681788+0000', 'last_fullsized': '2023-10-08T15:40:22.681788+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'last_clean_scrub_stamp': '2023-10-08T15:40:22.681788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:40:28.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T15:40:28.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.886+0000 7fab2cf18700 1 Processor -- start 2023-10-08T15:40:29.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.886+0000 7fab2cf18700 1 -- start start 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2cf18700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab28157870 0x7fab2815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2cf18700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fab2815a620 0x7fab2815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2cf18700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2815cbb0 con 0x7fab2815d580 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2cf18700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2815bfa0 con 0x7fab2815a620 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2cf18700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2815c280 con 0x7fab28157870 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab26d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fab2815d580 0x7fab28158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43194/0 (socket says 172.21.15.29:43194) 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab26d9d700 1 -- 172.21.15.29:0/4196631246 learned_addr learned my addr 172.21.15.29:0/4196631246 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2659c700 1 --2- 172.21.15.29:0/4196631246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab28157870 0x7fab2815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab25d9b700 1 --2- 172.21.15.29:0/4196631246 >> v2:172.21.15.183:3300/0 conn(0x7fab2815a620 0x7fab2815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2559a700 1 -- 172.21.15.29:0/4196631246 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879461168 0 0) 0x7fab2815cbb0 con 0x7fab2815d580 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2559a700 1 -- 172.21.15.29:0/4196631246 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab14003570 con 0x7fab2815d580 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2659c700 1 -- 172.21.15.29:0/4196631246 >> v2:172.21.15.183:3300/0 conn(0x7fab2815a620 msgr2=0x7fab2815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2659c700 1 --2- 172.21.15.29:0/4196631246 >> v2:172.21.15.183:3300/0 conn(0x7fab2815a620 0x7fab2815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2659c700 1 -- 172.21.15.29:0/4196631246 >> v1:172.21.15.29:6789/0 conn(0x7fab2815d580 legacy=0x7fab28158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2659c700 1 -- 172.21.15.29:0/4196631246 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2815c560 con 0x7fab28157870 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.887+0000 7fab2659c700 1 --2- 172.21.15.29:0/4196631246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab28157870 0x7fab2815b6a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e60 tx=0x7fab18009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff8a32d995fc1946 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2559a700 1 -- 172.21.15.29:0/4196631246 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800e070 con 0x7fab28157870 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2559a700 1 -- 172.21.15.29:0/4196631246 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1800bab0 con 0x7fab28157870 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2559a700 1 -- 172.21.15.29:0/4196631246 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800be70 con 0x7fab28157870 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2cf18700 1 -- 172.21.15.29:0/4196631246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab28157870 msgr2=0x7fab2815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2cf18700 1 --2- 172.21.15.29:0/4196631246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab28157870 0x7fab2815b6a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e60 tx=0x7fab18009780 comp rx=0 tx=0).stop 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2cf18700 1 -- 172.21.15.29:0/4196631246 shutdown_connections 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2cf18700 1 --2- 172.21.15.29:0/4196631246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab28157870 0x7fab2815b6a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2cf18700 1 --2- 172.21.15.29:0/4196631246 >> v2:172.21.15.183:3300/0 conn(0x7fab2815a620 0x7fab2815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2cf18700 1 -- 172.21.15.29:0/4196631246 >> 172.21.15.29:0/4196631246 conn(0x7fab28068ce0 msgr2=0x7fab280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2cf18700 1 -- 172.21.15.29:0/4196631246 shutdown_connections 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.888+0000 7fab2cf18700 1 -- 172.21.15.29:0/4196631246 wait complete. 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.889+0000 7fab2cf18700 1 Processor -- start 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab2cf18700 1 -- start start 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab2cf18700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab28157870 0x7fab280cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab2cf18700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab2815a620 0x7fab280c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab2cf18700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab2815d580 0x7fab280b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab2cf18700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab280b2f10 con 0x7fab2815a620 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab2cf18700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab280b2040 con 0x7fab28157870 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab2cf18700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab280b2300 con 0x7fab2815d580 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab25d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab2815a620 0x7fab280c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab25d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab2815a620 0x7fab280c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33458/0 (socket says 172.21.15.29:33458) 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.890+0000 7fab25d9b700 1 -- 172.21.15.29:0/1552053379 learned_addr learned my addr 172.21.15.29:0/1552053379 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab25d9b700 1 -- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab2815d580 msgr2=0x7fab280b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab25d9b700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab2815d580 0x7fab280b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab25d9b700 1 -- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab28157870 msgr2=0x7fab280cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab2659c700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab28157870 0x7fab280cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab25d9b700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab28157870 0x7fab280cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab25d9b700 1 -- 172.21.15.29:0/1552053379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009a20 con 0x7fab2815a620 2023-10-08T15:40:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab25d9b700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab2815a620 0x7fab280c6440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab1000ec80 tx=0x7fab100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab1e7fc700 1 -- 172.21.15.29:0/1552053379 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000c9d0 con 0x7fab2815a620 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab1e7fc700 1 -- 172.21.15.29:0/1552053379 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000cb30 con 0x7fab2815a620 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab280b25e0 con 0x7fab2815a620 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab1e7fc700 1 -- 172.21.15.29:0/1552053379 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10013470 con 0x7fab2815a620 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.891+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab280b2ba0 con 0x7fab2815a620 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.892+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab280b30c0 con 0x7fab2815a620 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.892+0000 7fab1e7fc700 1 -- 172.21.15.29:0/1552053379 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab10013820 con 0x7fab2815a620 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.893+0000 7fab1e7fc700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fab08066f30 0x7fab080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.893+0000 7fab1e7fc700 1 -- 172.21.15.29:0/1552053379 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab10084990 con 0x7fab2815a620 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.893+0000 7fab2659c700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fab08066f30 0x7fab080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.894+0000 7fab2659c700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fab08066f30 0x7fab080693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e60 tx=0x7fab18019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:29.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:28.897+0000 7fab1e7fc700 1 -- 172.21.15.29:0/1552053379 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab280b30c0 con 0x7fab2815a620 2023-10-08T15:40:29.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.167+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fab2804c3c0 con 0x7fab2815a620 2023-10-08T15:40:29.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.167+0000 7fab1e7fc700 1 -- 172.21.15.29:0/1552053379 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1027 (secure 0 0 0) 0x7fab10051b60 con 0x7fab2815a620 2023-10-08T15:40:29.221 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:29.221 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":22,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696779612,"num_in_osds":8,"osd_in_since":1696779609,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1627754,"bytes_avail":1598372246,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4273}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-08T15:40:06.699980+0000","services":{}},"progress_events":{}} 2023-10-08T15:40:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fab08066f30 msgr2=0x7fab080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fab08066f30 0x7fab080693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e60 tx=0x7fab18019000 comp rx=0 tx=0).stop 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab2815a620 msgr2=0x7fab280c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab2815a620 0x7fab280c6440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab1000ec80 tx=0x7fab100091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 shutdown_connections 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fab08066f30 0x7fab080693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab2815d580 0x7fab280b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab28157870 0x7fab280cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 --2- 172.21.15.29:0/1552053379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab2815a620 0x7fab280c6440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 >> 172.21.15.29:0/1552053379 conn(0x7fab28068ce0 msgr2=0x7fab2815f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 shutdown_connections 2023-10-08T15:40:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.169+0000 7fab2cf18700 1 -- 172.21.15.29:0/1552053379 wait complete. 2023-10-08T15:40:29.224 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T15:40:29.224 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:29.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.343+0000 7f37724e9700 1 Processor -- start 2023-10-08T15:40:29.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.343+0000 7f37724e9700 1 -- start start 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f37724e9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f376c157870 0x7f376c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f37724e9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c157c40 0x7f376c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f37724e9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c15cbb0 con 0x7f376c15a620 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f37724e9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c15bfa0 con 0x7f376c157870 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f37724e9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c15c280 con 0x7f376c157c40 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f376b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f376c15a620 0x7f376c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43210/0 (socket says 172.21.15.29:43210) 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f376b7fe700 1 -- 172.21.15.29:0/3310326488 learned_addr learned my addr 172.21.15.29:0/3310326488 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f3770a86700 1 --2- 172.21.15.29:0/3310326488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c157c40 0x7f376c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f376bfff700 1 --2- 172.21.15.29:0/3310326488 >> v2:172.21.15.183:3300/0 conn(0x7f376c157870 0x7f376c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f376affd700 1 -- 172.21.15.29:0/3310326488 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822214744 0 0) 0x7f376c15cbb0 con 0x7f376c15a620 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f376affd700 1 -- 172.21.15.29:0/3310326488 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3754003570 con 0x7f376c15a620 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f3770a86700 1 -- 172.21.15.29:0/3310326488 >> v2:172.21.15.183:3300/0 conn(0x7f376c157870 msgr2=0x7f376c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f3770a86700 1 --2- 172.21.15.29:0/3310326488 >> v2:172.21.15.183:3300/0 conn(0x7f376c157870 0x7f376c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f3770a86700 1 -- 172.21.15.29:0/3310326488 >> v1:172.21.15.29:6789/0 conn(0x7f376c15a620 legacy=0x7f376c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f376affd700 1 -- 172.21.15.29:0/3310326488 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030658561 0 0) 0x7f3754003570 con 0x7f376c15a620 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.344+0000 7f3770a86700 1 -- 172.21.15.29:0/3310326488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c15c560 con 0x7f376c157c40 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f3770a86700 1 --2- 172.21.15.29:0/3310326488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c157c40 0x7f376c158110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3764009e60 tx=0x7f3764009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c295ea7cf6ff51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f376affd700 1 -- 172.21.15.29:0/3310326488 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400e070 con 0x7f376c157c40 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f376affd700 1 -- 172.21.15.29:0/3310326488 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376400b7a0 con 0x7f376c157c40 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f376affd700 1 -- 172.21.15.29:0/3310326488 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760001470 con 0x7f376c157c40 2023-10-08T15:40:29.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f37724e9700 1 -- 172.21.15.29:0/3310326488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c157c40 msgr2=0x7f376c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f37724e9700 1 --2- 172.21.15.29:0/3310326488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c157c40 0x7f376c158110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3764009e60 tx=0x7f3764009780 comp rx=0 tx=0).stop 2023-10-08T15:40:29.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f37724e9700 1 -- 172.21.15.29:0/3310326488 shutdown_connections 2023-10-08T15:40:29.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f37724e9700 1 --2- 172.21.15.29:0/3310326488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c157c40 0x7f376c158110 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f37724e9700 1 --2- 172.21.15.29:0/3310326488 >> v2:172.21.15.183:3300/0 conn(0x7f376c157870 0x7f376c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f37724e9700 1 -- 172.21.15.29:0/3310326488 >> 172.21.15.29:0/3310326488 conn(0x7f376c068ce0 msgr2=0x7f376c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:29.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f37724e9700 1 -- 172.21.15.29:0/3310326488 shutdown_connections 2023-10-08T15:40:29.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.345+0000 7f37724e9700 1 -- 172.21.15.29:0/3310326488 wait complete. 2023-10-08T15:40:29.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.346+0000 7f37724e9700 1 Processor -- start 2023-10-08T15:40:29.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f37724e9700 1 -- start start 2023-10-08T15:40:29.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f37724e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f376c157870 0x7f376c153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f37724e9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f376c157c40 0x7f376c0b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f37724e9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c15a620 0x7f376c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f37724e9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b1690 con 0x7f376c157870 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f37724e9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b18e0 con 0x7f376c157c40 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f37724e9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b1bc0 con 0x7f376c15a620 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f376bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f376c157870 0x7f376c153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f376bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f376c157870 0x7f376c153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33462/0 (socket says 172.21.15.29:33462) 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f376bfff700 1 -- 172.21.15.29:0/3189758439 learned_addr learned my addr 172.21.15.29:0/3189758439 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.347+0000 7f3770a86700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c15a620 0x7f376c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f376b7fe700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f376c157c40 0x7f376c0b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f376bfff700 1 -- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c15a620 msgr2=0x7f376c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f376bfff700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c15a620 0x7f376c15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f376bfff700 1 -- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f376c157c40 msgr2=0x7f376c0b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f376bfff700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f376c157c40 0x7f376c0b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f376bfff700 1 -- 172.21.15.29:0/3189758439 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009a20 con 0x7f376c157870 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f376b7fe700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f376c157c40 0x7f376c0b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f376bfff700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f376c157870 0x7f376c153690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f375c00ec80 tx=0x7f375c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f3753fff700 1 -- 172.21.15.29:0/3189758439 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c00c9d0 con 0x7f376c157870 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f3753fff700 1 -- 172.21.15.29:0/3189758439 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c00cb30 con 0x7f376c157870 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c0b1ea0 con 0x7f376c157870 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f3753fff700 1 -- 172.21.15.29:0/3189758439 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c013470 con 0x7f376c157870 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.348+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c0b2460 con 0x7f376c157870 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.349+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c0b27d0 con 0x7f376c157870 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.349+0000 7f3753fff700 1 -- 172.21.15.29:0/3189758439 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f375c013820 con 0x7f376c157870 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.350+0000 7f3753fff700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.350+0000 7f3753fff700 1 -- 172.21.15.29:0/3189758439 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f375c0848c0 con 0x7f376c157870 2023-10-08T15:40:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.350+0000 7f376b7fe700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.350+0000 7f376b7fe700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3758066f30 0x7f37580693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3760001620 tx=0x7f3760009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.354+0000 7f3753fff700 1 -- 172.21.15.29:0/3189758439 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f375c051b30 con 0x7f376c157870 2023-10-08T15:40:29.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.545+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f376c04c3c0 con 0x7f3758066f30 2023-10-08T15:40:29.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.553+0000 7f3753fff700 1 -- 172.21.15.29:0/3189758439 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257349 (secure 0 0 0) 0x7f376c04c3c0 con 0x7f3758066f30 2023-10-08T15:40:29.556 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3758066f30 msgr2=0x7f37580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3758066f30 0x7f37580693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3760001620 tx=0x7f3760009040 comp rx=0 tx=0).stop 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f376c157870 msgr2=0x7f376c153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f376c157870 0x7f376c153690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f375c00ec80 tx=0x7f375c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 shutdown_connections 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3758066f30 0x7f37580693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f376c15a620 0x7f376c15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f376c157870 0x7f376c153690 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 --2- 172.21.15.29:0/3189758439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f376c157c40 0x7f376c0b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 >> 172.21.15.29:0/3189758439 conn(0x7f376c068ce0 msgr2=0x7f376c0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:29.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.556+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 shutdown_connections 2023-10-08T15:40:29.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:29.557+0000 7f37724e9700 1 -- 172.21.15.29:0/3189758439 wait complete. 2023-10-08T15:40:29.560 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:40:29.569 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-08T15:40:28.303589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560910,"statfs":{"total":1600000000,"available":1598372246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001487"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693529+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691024+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692619+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693983+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.697525+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694739+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691637+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693023+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.695987+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691951+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693336+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689391+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692614+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693509+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691228+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694333+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.696842+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689960+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.695512+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695776+0000","last_change":"2023-10-08T15:40:22.695776+0000","last_active":"2023-10-08T15:40:22.695776+0000","last_peered":"2023-10-08T15:40:22.695776+0000","last_clean":"2023-10-08T15:40:22.695776+0000","last_became_active":"2023-10-08T15:40:22.695553+0000","last_became_peered":"2023-10-08T15:40:22.695553+0000","last_unstale":"2023-10-08T15:40:22.695776+0000","last_undegraded":"2023-10-08T15:40:22.695776+0000","last_fullsized":"2023-10-08T15:40:22.695776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693470+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699564+0000","last_change":"2023-10-08T15:40:22.699564+0000","last_active":"2023-10-08T15:40:22.699564+0000","last_peered":"2023-10-08T15:40:22.699564+0000","last_clean":"2023-10-08T15:40:22.699564+0000","last_became_active":"2023-10-08T15:40:22.698627+0000","last_became_peered":"2023-10-08T15:40:22.698627+0000","last_unstale":"2023-10-08T15:40:22.699564+0000","last_undegraded":"2023-10-08T15:40:22.699564+0000","last_fullsized":"2023-10-08T15:40:22.699564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692277+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700173+0000","last_change":"2023-10-08T15:40:22.700173+0000","last_active":"2023-10-08T15:40:22.700173+0000","last_peered":"2023-10-08T15:40:22.700173+0000","last_clean":"2023-10-08T15:40:22.700173+0000","last_became_active":"2023-10-08T15:40:22.699897+0000","last_became_peered":"2023-10-08T15:40:22.699897+0000","last_unstale":"2023-10-08T15:40:22.700173+0000","last_undegraded":"2023-10-08T15:40:22.700173+0000","last_fullsized":"2023-10-08T15:40:22.700173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:48.001159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692202+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702341+0000","last_change":"2023-10-08T15:40:22.702341+0000","last_active":"2023-10-08T15:40:22.702341+0000","last_peered":"2023-10-08T15:40:22.702341+0000","last_clean":"2023-10-08T15:40:22.702341+0000","last_became_active":"2023-10-08T15:40:22.701383+0000","last_became_peered":"2023-10-08T15:40:22.701383+0000","last_unstale":"2023-10-08T15:40:22.702341+0000","last_undegraded":"2023-10-08T15:40:22.702341+0000","last_fullsized":"2023-10-08T15:40:22.702341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691316+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698477+0000","last_change":"2023-10-08T15:40:22.698477+0000","last_active":"2023-10-08T15:40:22.698477+0000","last_peered":"2023-10-08T15:40:22.698477+0000","last_clean":"2023-10-08T15:40:22.698477+0000","last_became_active":"2023-10-08T15:40:22.698057+0000","last_became_peered":"2023-10-08T15:40:22.698057+0000","last_unstale":"2023-10-08T15:40:22.698477+0000","last_undegraded":"2023-10-08T15:40:22.698477+0000","last_fullsized":"2023-10-08T15:40:22.698477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690441+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695547+0000","last_change":"2023-10-08T15:40:22.695547+0000","last_active":"2023-10-08T15:40:22.695547+0000","last_peered":"2023-10-08T15:40:22.695547+0000","last_clean":"2023-10-08T15:40:22.695547+0000","last_became_active":"2023-10-08T15:40:22.695272+0000","last_became_peered":"2023-10-08T15:40:22.695272+0000","last_unstale":"2023-10-08T15:40:22.695547+0000","last_undegraded":"2023-10-08T15:40:22.695547+0000","last_fullsized":"2023-10-08T15:40:22.695547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690907+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:43.682721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700006+0000","last_change":"2023-10-08T15:40:22.700006+0000","last_active":"2023-10-08T15:40:22.700006+0000","last_peered":"2023-10-08T15:40:22.700006+0000","last_clean":"2023-10-08T15:40:22.700006+0000","last_became_active":"2023-10-08T15:40:22.699783+0000","last_became_peered":"2023-10-08T15:40:22.699783+0000","last_unstale":"2023-10-08T15:40:22.700006+0000","last_undegraded":"2023-10-08T15:40:22.700006+0000","last_fullsized":"2023-10-08T15:40:22.700006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690498+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695652+0000","last_change":"2023-10-08T15:40:22.695652+0000","last_active":"2023-10-08T15:40:22.695652+0000","last_peered":"2023-10-08T15:40:22.695652+0000","last_clean":"2023-10-08T15:40:22.695652+0000","last_became_active":"2023-10-08T15:40:22.695043+0000","last_became_peered":"2023-10-08T15:40:22.695043+0000","last_unstale":"2023-10-08T15:40:22.695652+0000","last_undegraded":"2023-10-08T15:40:22.695652+0000","last_fullsized":"2023-10-08T15:40:22.695652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691125+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702796+0000","last_change":"2023-10-08T15:40:22.702796+0000","last_active":"2023-10-08T15:40:22.702796+0000","last_peered":"2023-10-08T15:40:22.702796+0000","last_clean":"2023-10-08T15:40:22.702796+0000","last_became_active":"2023-10-08T15:40:22.702571+0000","last_became_peered":"2023-10-08T15:40:22.702571+0000","last_unstale":"2023-10-08T15:40:22.702796+0000","last_undegraded":"2023-10-08T15:40:22.702796+0000","last_fullsized":"2023-10-08T15:40:22.702796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690992+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702638+0000","last_change":"2023-10-08T15:40:22.702638+0000","last_active":"2023-10-08T15:40:22.702638+0000","last_peered":"2023-10-08T15:40:22.702638+0000","last_clean":"2023-10-08T15:40:22.702638+0000","last_became_active":"2023-10-08T15:40:22.702409+0000","last_became_peered":"2023-10-08T15:40:22.702409+0000","last_unstale":"2023-10-08T15:40:22.702638+0000","last_undegraded":"2023-10-08T15:40:22.702638+0000","last_fullsized":"2023-10-08T15:40:22.702638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692194+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.697798+0000","last_change":"2023-10-08T15:40:22.697798+0000","last_active":"2023-10-08T15:40:22.697798+0000","last_peered":"2023-10-08T15:40:22.697798+0000","last_clean":"2023-10-08T15:40:22.697798+0000","last_became_active":"2023-10-08T15:40:22.697562+0000","last_became_peered":"2023-10-08T15:40:22.697562+0000","last_unstale":"2023-10-08T15:40:22.697798+0000","last_undegraded":"2023-10-08T15:40:22.697798+0000","last_fullsized":"2023-10-08T15:40:22.697798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689689+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700551+0000","last_change":"2023-10-08T15:40:22.700551+0000","last_active":"2023-10-08T15:40:22.700551+0000","last_peered":"2023-10-08T15:40:22.700551+0000","last_clean":"2023-10-08T15:40:22.700551+0000","last_became_active":"2023-10-08T15:40:22.700305+0000","last_became_peered":"2023-10-08T15:40:22.700305+0000","last_unstale":"2023-10-08T15:40:22.700551+0000","last_undegraded":"2023-10-08T15:40:22.700551+0000","last_fullsized":"2023-10-08T15:40:22.700551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690968+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:11:34.118548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695062+0000","last_change":"2023-10-08T15:40:22.695062+0000","last_active":"2023-10-08T15:40:22.695062+0000","last_peered":"2023-10-08T15:40:22.695062+0000","last_clean":"2023-10-08T15:40:22.695062+0000","last_became_active":"2023-10-08T15:40:22.694763+0000","last_became_peered":"2023-10-08T15:40:22.694763+0000","last_unstale":"2023-10-08T15:40:22.695062+0000","last_undegraded":"2023-10-08T15:40:22.695062+0000","last_fullsized":"2023-10-08T15:40:22.695062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691797+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701263+0000","last_change":"2023-10-08T15:40:22.701263+0000","last_active":"2023-10-08T15:40:22.701263+0000","last_peered":"2023-10-08T15:40:22.701263+0000","last_clean":"2023-10-08T15:40:22.701263+0000","last_became_active":"2023-10-08T15:40:22.700296+0000","last_became_peered":"2023-10-08T15:40:22.700296+0000","last_unstale":"2023-10-08T15:40:22.701263+0000","last_undegraded":"2023-10-08T15:40:22.701263+0000","last_fullsized":"2023-10-08T15:40:22.701263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.697143+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699338+0000","last_change":"2023-10-08T15:40:22.699338+0000","last_active":"2023-10-08T15:40:22.699338+0000","last_peered":"2023-10-08T15:40:22.699338+0000","last_clean":"2023-10-08T15:40:22.699338+0000","last_became_active":"2023-10-08T15:40:22.698307+0000","last_became_peered":"2023-10-08T15:40:22.698307+0000","last_unstale":"2023-10-08T15:40:22.699338+0000","last_undegraded":"2023-10-08T15:40:22.699338+0000","last_fullsized":"2023-10-08T15:40:22.699338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693459+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.692944+0000","last_change":"2023-10-08T15:40:22.692944+0000","last_active":"2023-10-08T15:40:22.692944+0000","last_peered":"2023-10-08T15:40:22.692944+0000","last_clean":"2023-10-08T15:40:22.692944+0000","last_became_active":"2023-10-08T15:40:22.692741+0000","last_became_peered":"2023-10-08T15:40:22.692741+0000","last_unstale":"2023-10-08T15:40:22.692944+0000","last_undegraded":"2023-10-08T15:40:22.692944+0000","last_fullsized":"2023-10-08T15:40:22.692944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691096+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.696237+0000","last_change":"2023-10-08T15:40:22.696237+0000","last_active":"2023-10-08T15:40:22.696237+0000","last_peered":"2023-10-08T15:40:22.696237+0000","last_clean":"2023-10-08T15:40:22.696237+0000","last_became_active":"2023-10-08T15:40:22.695953+0000","last_became_peered":"2023-10-08T15:40:22.695953+0000","last_unstale":"2023-10-08T15:40:22.696237+0000","last_undegraded":"2023-10-08T15:40:22.696237+0000","last_fullsized":"2023-10-08T15:40:22.696237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:40.912548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691778+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.695667+0000","last_change":"2023-10-08T15:40:22.695667+0000","last_active":"2023-10-08T15:40:22.695667+0000","last_peered":"2023-10-08T15:40:22.695667+0000","last_clean":"2023-10-08T15:40:22.695667+0000","last_became_active":"2023-10-08T15:40:22.695439+0000","last_became_peered":"2023-10-08T15:40:22.695439+0000","last_unstale":"2023-10-08T15:40:22.695667+0000","last_undegraded":"2023-10-08T15:40:22.695667+0000","last_fullsized":"2023-10-08T15:40:22.695667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690107+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698283+0000","last_change":"2023-10-08T15:40:22.698283+0000","last_active":"2023-10-08T15:40:22.698283+0000","last_peered":"2023-10-08T15:40:22.698283+0000","last_clean":"2023-10-08T15:40:22.698283+0000","last_became_active":"2023-10-08T15:40:22.697621+0000","last_became_peered":"2023-10-08T15:40:22.697621+0000","last_unstale":"2023-10-08T15:40:22.698283+0000","last_undegraded":"2023-10-08T15:40:22.698283+0000","last_fullsized":"2023-10-08T15:40:22.698283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689173+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:20.554850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690751+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.698673+0000","last_change":"2023-10-08T15:40:22.698673+0000","last_active":"2023-10-08T15:40:22.698673+0000","last_peered":"2023-10-08T15:40:22.698673+0000","last_clean":"2023-10-08T15:40:22.698673+0000","last_became_active":"2023-10-08T15:40:22.698433+0000","last_became_peered":"2023-10-08T15:40:22.698433+0000","last_unstale":"2023-10-08T15:40:22.698673+0000","last_undegraded":"2023-10-08T15:40:22.698673+0000","last_fullsized":"2023-10-08T15:40:22.698673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693015+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701412+0000","last_change":"2023-10-08T15:40:22.701412+0000","last_active":"2023-10-08T15:40:22.701412+0000","last_peered":"2023-10-08T15:40:22.701412+0000","last_clean":"2023-10-08T15:40:22.701412+0000","last_became_active":"2023-10-08T15:40:22.701018+0000","last_became_peered":"2023-10-08T15:40:22.701018+0000","last_unstale":"2023-10-08T15:40:22.701412+0000","last_undegraded":"2023-10-08T15:40:22.701412+0000","last_fullsized":"2023-10-08T15:40:22.701412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T15:40:21.685151+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:40:21.685151+0000","last_peered":"2023-10-08T15:40:21.685151+0000","last_clean":"2023-10-08T15:40:21.685151+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:40:21.685151+0000","last_undegraded":"2023-10-08T15:40:21.685151+0000","last_fullsized":"2023-10-08T15:40:21.685151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691253+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:16.289095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702091+0000","last_change":"2023-10-08T15:40:22.702091+0000","last_active":"2023-10-08T15:40:22.702091+0000","last_peered":"2023-10-08T15:40:22.702091+0000","last_clean":"2023-10-08T15:40:22.702091+0000","last_became_active":"2023-10-08T15:40:22.701729+0000","last_became_peered":"2023-10-08T15:40:22.701729+0000","last_unstale":"2023-10-08T15:40:22.702091+0000","last_undegraded":"2023-10-08T15:40:22.702091+0000","last_fullsized":"2023-10-08T15:40:22.702091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:00.869317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701958+0000","last_change":"2023-10-08T15:40:22.701958+0000","last_active":"2023-10-08T15:40:22.701958+0000","last_peered":"2023-10-08T15:40:22.701958+0000","last_clean":"2023-10-08T15:40:22.701958+0000","last_became_active":"2023-10-08T15:40:22.701237+0000","last_became_peered":"2023-10-08T15:40:22.701237+0000","last_unstale":"2023-10-08T15:40:22.701958+0000","last_undegraded":"2023-10-08T15:40:22.701958+0000","last_fullsized":"2023-10-08T15:40:22.701958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690858+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.702336+0000","last_change":"2023-10-08T15:40:22.702336+0000","last_active":"2023-10-08T15:40:22.702336+0000","last_peered":"2023-10-08T15:40:22.702336+0000","last_clean":"2023-10-08T15:40:22.702336+0000","last_became_active":"2023-10-08T15:40:22.702088+0000","last_became_peered":"2023-10-08T15:40:22.702088+0000","last_unstale":"2023-10-08T15:40:22.702336+0000","last_undegraded":"2023-10-08T15:40:22.702336+0000","last_fullsized":"2023-10-08T15:40:22.702336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693412+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699798+0000","last_change":"2023-10-08T15:40:22.699798+0000","last_active":"2023-10-08T15:40:22.699798+0000","last_peered":"2023-10-08T15:40:22.699798+0000","last_clean":"2023-10-08T15:40:22.699798+0000","last_became_active":"2023-10-08T15:40:22.699567+0000","last_became_peered":"2023-10-08T15:40:22.699567+0000","last_unstale":"2023-10-08T15:40:22.699798+0000","last_undegraded":"2023-10-08T15:40:22.699798+0000","last_fullsized":"2023-10-08T15:40:22.699798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691937+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.701044+0000","last_change":"2023-10-08T15:40:22.701044+0000","last_active":"2023-10-08T15:40:22.701044+0000","last_peered":"2023-10-08T15:40:22.701044+0000","last_clean":"2023-10-08T15:40:22.701044+0000","last_became_active":"2023-10-08T15:40:22.700575+0000","last_became_peered":"2023-10-08T15:40:22.700575+0000","last_unstale":"2023-10-08T15:40:22.701044+0000","last_undegraded":"2023-10-08T15:40:22.701044+0000","last_fullsized":"2023-10-08T15:40:22.701044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.689144+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:56.355768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700842+0000","last_change":"2023-10-08T15:40:22.700842+0000","last_active":"2023-10-08T15:40:22.700842+0000","last_peered":"2023-10-08T15:40:22.700842+0000","last_clean":"2023-10-08T15:40:22.700842+0000","last_became_active":"2023-10-08T15:40:22.700609+0000","last_became_peered":"2023-10-08T15:40:22.700609+0000","last_unstale":"2023-10-08T15:40:22.700842+0000","last_undegraded":"2023-10-08T15:40:22.700842+0000","last_fullsized":"2023-10-08T15:40:22.700842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691193+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.700304+0000","last_change":"2023-10-08T15:40:22.700304+0000","last_active":"2023-10-08T15:40:22.700304+0000","last_peered":"2023-10-08T15:40:22.700304+0000","last_clean":"2023-10-08T15:40:22.700304+0000","last_became_active":"2023-10-08T15:40:22.700075+0000","last_became_peered":"2023-10-08T15:40:22.700075+0000","last_unstale":"2023-10-08T15:40:22.700304+0000","last_undegraded":"2023-10-08T15:40:22.700304+0000","last_fullsized":"2023-10-08T15:40:22.700304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691547+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.699299+0000","last_change":"2023-10-08T15:40:22.699299+0000","last_active":"2023-10-08T15:40:22.699299+0000","last_peered":"2023-10-08T15:40:22.699299+0000","last_clean":"2023-10-08T15:40:22.699299+0000","last_became_active":"2023-10-08T15:40:22.699051+0000","last_became_peered":"2023-10-08T15:40:22.699051+0000","last_unstale":"2023-10-08T15:40:22.699299+0000","last_undegraded":"2023-10-08T15:40:22.699299+0000","last_fullsized":"2023-10-08T15:40:22.699299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691403+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.694836+0000","last_change":"2023-10-08T15:40:22.694836+0000","last_active":"2023-10-08T15:40:22.694836+0000","last_peered":"2023-10-08T15:40:22.694836+0000","last_clean":"2023-10-08T15:40:22.694836+0000","last_became_active":"2023-10-08T15:40:22.694608+0000","last_became_peered":"2023-10-08T15:40:22.694608+0000","last_unstale":"2023-10-08T15:40:22.694836+0000","last_undegraded":"2023-10-08T15:40:22.694836+0000","last_fullsized":"2023-10-08T15:40:22.694836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691764+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.694954+0000","last_change":"2023-10-08T15:40:22.694954+0000","last_active":"2023-10-08T15:40:22.694954+0000","last_peered":"2023-10-08T15:40:22.694954+0000","last_clean":"2023-10-08T15:40:22.694954+0000","last_became_active":"2023-10-08T15:40:22.694720+0000","last_became_peered":"2023-10-08T15:40:22.694720+0000","last_unstale":"2023-10-08T15:40:22.694954+0000","last_undegraded":"2023-10-08T15:40:22.694954+0000","last_fullsized":"2023-10-08T15:40:22.694954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690636+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":8,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T15:40:22.696186+0000","last_change":"2023-10-08T15:40:22.696186+0000","last_active":"2023-10-08T15:40:22.696186+0000","last_peered":"2023-10-08T15:40:22.696186+0000","last_clean":"2023-10-08T15:40:22.696186+0000","last_became_active":"2023-10-08T15:40:22.695949+0000","last_became_peered":"2023-10-08T15:40:22.695949+0000","last_unstale":"2023-10-08T15:40:22.696186+0000","last_undegraded":"2023-10-08T15:40:22.696186+0000","last_fullsized":"2023-10-08T15:40:22.696186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692910+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.696262+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690372+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:19.176123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691698+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.694335+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691906+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690392+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692069+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691009+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.690586+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692271+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.693301+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.692573+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:40:22.681788+0000","last_change":"2023-10-08T15:40:22.691224+0000","last_active":"2023-10-08T15:40:22.681788+0000","last_peered":"2023-10-08T15:40:22.681788+0000","last_clean":"2023-10-08T15:40:22.681788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:40:22.681788+0000","last_undegraded":"2023-10-08T15:40:22.681788+0000","last_fullsized":"2023-10-08T15:40:22.681788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199352189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194679,"statfs":{"total":200000000,"available":199352189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942557,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]}],"pool_statfs":[]}} 2023-10-08T15:40:29.677 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-10-08T15:40:29.677+0000 7fce2bf40700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:40:32.576 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:32.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.709+0000 7faf6d275700 1 Processor -- start 2023-10-08T15:40:32.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.709+0000 7faf6d275700 1 -- start start 2023-10-08T15:40:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf6d275700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf6815a620 0x7faf6815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf6d275700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faf6815d580 0x7faf68158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf6d275700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6815cbb0 con 0x7faf68157870 2023-10-08T15:40:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf6d275700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6815bdb0 con 0x7faf6815a620 2023-10-08T15:40:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf6d275700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6815bfa0 con 0x7faf6815d580 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf667fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf6815a620 0x7faf6815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf667fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf6815a620 0x7faf6815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33478/0 (socket says 172.21.15.29:33478) 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf667fc700 1 -- 172.21.15.29:0/1635209753 learned_addr learned my addr 172.21.15.29:0/1635209753 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf677fe700 1 --2- 172.21.15.29:0/1635209753 >> v2:172.21.15.183:3300/0 conn(0x7faf6815d580 0x7faf68158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf667fc700 1 -- 172.21.15.29:0/1635209753 >> v2:172.21.15.183:3300/0 conn(0x7faf6815d580 msgr2=0x7faf68158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf667fc700 1 --2- 172.21.15.29:0/1635209753 >> v2:172.21.15.183:3300/0 conn(0x7faf6815d580 0x7faf68158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf667fc700 1 -- 172.21.15.29:0/1635209753 >> v1:172.21.15.183:6789/0 conn(0x7faf68157870 legacy=0x7faf6815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf667fc700 1 -- 172.21.15.29:0/1635209753 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6815c280 con 0x7faf6815a620 2023-10-08T15:40:32.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.710+0000 7faf667fc700 1 --2- 172.21.15.29:0/1635209753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf6815a620 0x7faf6815d040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf6806b4e0 tx=0x7faf50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82f6a9ae144db83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf65ffb700 1 -- 172.21.15.29:0/1635209753 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50009e70 con 0x7faf6815a620 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf65ffb700 1 -- 172.21.15.29:0/1635209753 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5000b860 con 0x7faf6815a620 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf65ffb700 1 -- 172.21.15.29:0/1635209753 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000bc00 con 0x7faf6815a620 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf6d275700 1 -- 172.21.15.29:0/1635209753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf6815a620 msgr2=0x7faf6815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf6d275700 1 --2- 172.21.15.29:0/1635209753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf6815a620 0x7faf6815d040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf6806b4e0 tx=0x7faf50009250 comp rx=0 tx=0).stop 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf6d275700 1 -- 172.21.15.29:0/1635209753 shutdown_connections 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf6d275700 1 --2- 172.21.15.29:0/1635209753 >> v2:172.21.15.183:3300/0 conn(0x7faf6815d580 0x7faf68158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf6d275700 1 --2- 172.21.15.29:0/1635209753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf6815a620 0x7faf6815d040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf6d275700 1 -- 172.21.15.29:0/1635209753 >> 172.21.15.29:0/1635209753 conn(0x7faf68068ce0 msgr2=0x7faf680690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:32.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf6d275700 1 -- 172.21.15.29:0/1635209753 shutdown_connections 2023-10-08T15:40:32.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.711+0000 7faf6d275700 1 -- 172.21.15.29:0/1635209753 wait complete. 2023-10-08T15:40:32.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf6d275700 1 Processor -- start 2023-10-08T15:40:32.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf6d275700 1 -- start start 2023-10-08T15:40:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf6d275700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf68157870 0x7faf6816a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf6d275700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf6815a620 0x7faf680c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf6d275700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf6815d580 0x7faf680cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf6d275700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680cc640 con 0x7faf68157870 2023-10-08T15:40:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf6d275700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680cd7d0 con 0x7faf6815d580 2023-10-08T15:40:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf6d275700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c5f60 con 0x7faf6815a620 2023-10-08T15:40:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf66ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf68157870 0x7faf6816a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf66ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf68157870 0x7faf6816a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33486/0 (socket says 172.21.15.29:33486) 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.713+0000 7faf66ffd700 1 -- 172.21.15.29:0/3685022850 learned_addr learned my addr 172.21.15.29:0/3685022850 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf677fe700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf6815d580 0x7faf680cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf667fc700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf6815a620 0x7faf680c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf66ffd700 1 -- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf6815a620 msgr2=0x7faf680c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf66ffd700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf6815a620 0x7faf680c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf66ffd700 1 -- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf6815d580 msgr2=0x7faf680cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf66ffd700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf6815d580 0x7faf680cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf66ffd700 1 -- 172.21.15.29:0/3685022850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf500094f0 con 0x7faf68157870 2023-10-08T15:40:32.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf677fe700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf6815d580 0x7faf680cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf66ffd700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf68157870 0x7faf6816a550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf6000c590 tx=0x7faf6000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf5effd700 1 -- 172.21.15.29:0/3685022850 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60011590 con 0x7faf68157870 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf5effd700 1 -- 172.21.15.29:0/3685022850 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf600116f0 con 0x7faf68157870 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf5effd700 1 -- 172.21.15.29:0/3685022850 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60011ab0 con 0x7faf68157870 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf680c6240 con 0x7faf68157870 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.714+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf680c6800 con 0x7faf68157870 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.715+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf680c7540 con 0x7faf68157870 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.715+0000 7faf5effd700 1 -- 172.21.15.29:0/3685022850 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf6001b3b0 con 0x7faf68157870 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.716+0000 7faf5effd700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:32.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.716+0000 7faf5effd700 1 -- 172.21.15.29:0/3685022850 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf60083ae0 con 0x7faf68157870 2023-10-08T15:40:32.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.716+0000 7faf667fc700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:32.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.717+0000 7faf667fc700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faf48066f30 0x7faf480693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf6806b4e0 tx=0x7faf50017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:32.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.720+0000 7faf5effd700 1 -- 172.21.15.29:0/3685022850 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf60050d50 con 0x7faf68157870 2023-10-08T15:40:32.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.908+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf6804c3c0 con 0x7faf48066f30 2023-10-08T15:40:32.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.915+0000 7faf5effd700 1 -- 172.21.15.29:0/3685022850 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260161 (secure 0 0 0) 0x7faf6804c3c0 con 0x7faf48066f30 2023-10-08T15:40:32.918 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:32.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faf48066f30 msgr2=0x7faf480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faf48066f30 0x7faf480693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf6806b4e0 tx=0x7faf50017000 comp rx=0 tx=0).stop 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf68157870 msgr2=0x7faf6816a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf68157870 0x7faf6816a550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf6000c590 tx=0x7faf6000c950 comp rx=0 tx=0).stop 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 shutdown_connections 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faf48066f30 0x7faf480693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf6815d580 0x7faf680cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf68157870 0x7faf6816a550 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 --2- 172.21.15.29:0/3685022850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf6815a620 0x7faf680c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 >> 172.21.15.29:0/3685022850 conn(0x7faf68068ce0 msgr2=0x7faf680690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 shutdown_connections 2023-10-08T15:40:32.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:32.918+0000 7faf6d275700 1 -- 172.21.15.29:0/3685022850 wait complete. 2023-10-08T15:40:32.922 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:40:32.931 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-08T15:40:32.304610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.615965"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701562+0000","last_change":"2023-10-08T15:40:23.700602+0000","last_active":"2023-10-08T15:40:23.701562+0000","last_peered":"2023-10-08T15:40:23.701562+0000","last_clean":"2023-10-08T15:40:23.701562+0000","last_became_active":"2023-10-08T15:40:23.700351+0000","last_became_peered":"2023-10-08T15:40:23.700351+0000","last_unstale":"2023-10-08T15:40:23.701562+0000","last_undegraded":"2023-10-08T15:40:23.701562+0000","last_fullsized":"2023-10-08T15:40:23.701562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:17.290508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705971+0000","last_change":"2023-10-08T15:40:23.705905+0000","last_active":"2023-10-08T15:40:23.705971+0000","last_peered":"2023-10-08T15:40:23.705971+0000","last_clean":"2023-10-08T15:40:23.705971+0000","last_became_active":"2023-10-08T15:40:23.705644+0000","last_became_peered":"2023-10-08T15:40:23.705644+0000","last_unstale":"2023-10-08T15:40:23.705971+0000","last_undegraded":"2023-10-08T15:40:23.705971+0000","last_fullsized":"2023-10-08T15:40:23.705971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707366+0000","last_change":"2023-10-08T15:40:23.705871+0000","last_active":"2023-10-08T15:40:23.707366+0000","last_peered":"2023-10-08T15:40:23.707366+0000","last_clean":"2023-10-08T15:40:23.707366+0000","last_became_active":"2023-10-08T15:40:23.705207+0000","last_became_peered":"2023-10-08T15:40:23.705207+0000","last_unstale":"2023-10-08T15:40:23.707366+0000","last_undegraded":"2023-10-08T15:40:23.707366+0000","last_fullsized":"2023-10-08T15:40:23.707366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695623+0000","last_change":"2023-10-08T15:40:23.695515+0000","last_active":"2023-10-08T15:40:23.695623+0000","last_peered":"2023-10-08T15:40:23.695623+0000","last_clean":"2023-10-08T15:40:23.695623+0000","last_became_active":"2023-10-08T15:40:23.695301+0000","last_became_peered":"2023-10-08T15:40:23.695301+0000","last_unstale":"2023-10-08T15:40:23.695623+0000","last_undegraded":"2023-10-08T15:40:23.695623+0000","last_fullsized":"2023-10-08T15:40:23.695623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:56:55.421889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700059+0000","last_change":"2023-10-08T15:40:23.698698+0000","last_active":"2023-10-08T15:40:23.700059+0000","last_peered":"2023-10-08T15:40:23.700059+0000","last_clean":"2023-10-08T15:40:23.700059+0000","last_became_active":"2023-10-08T15:40:23.698435+0000","last_became_peered":"2023-10-08T15:40:23.698435+0000","last_unstale":"2023-10-08T15:40:23.700059+0000","last_undegraded":"2023-10-08T15:40:23.700059+0000","last_fullsized":"2023-10-08T15:40:23.700059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:27.901303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710147+0000","last_change":"2023-10-08T15:40:23.709600+0000","last_active":"2023-10-08T15:40:23.710147+0000","last_peered":"2023-10-08T15:40:23.710147+0000","last_clean":"2023-10-08T15:40:23.710147+0000","last_became_active":"2023-10-08T15:40:23.709218+0000","last_became_peered":"2023-10-08T15:40:23.709218+0000","last_unstale":"2023-10-08T15:40:23.710147+0000","last_undegraded":"2023-10-08T15:40:23.710147+0000","last_fullsized":"2023-10-08T15:40:23.710147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:17.290508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711213+0000","last_change":"2023-10-08T15:40:23.711171+0000","last_active":"2023-10-08T15:40:23.711213+0000","last_peered":"2023-10-08T15:40:23.711213+0000","last_clean":"2023-10-08T15:40:23.711213+0000","last_became_active":"2023-10-08T15:40:23.710893+0000","last_became_peered":"2023-10-08T15:40:23.710893+0000","last_unstale":"2023-10-08T15:40:23.711213+0000","last_undegraded":"2023-10-08T15:40:23.711213+0000","last_fullsized":"2023-10-08T15:40:23.711213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703451+0000","last_change":"2023-10-08T15:40:23.702893+0000","last_active":"2023-10-08T15:40:23.703451+0000","last_peered":"2023-10-08T15:40:23.703451+0000","last_clean":"2023-10-08T15:40:23.703451+0000","last_became_active":"2023-10-08T15:40:23.701153+0000","last_became_peered":"2023-10-08T15:40:23.701153+0000","last_unstale":"2023-10-08T15:40:23.703451+0000","last_undegraded":"2023-10-08T15:40:23.703451+0000","last_fullsized":"2023-10-08T15:40:23.703451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704759+0000","last_change":"2023-10-08T15:40:23.704635+0000","last_active":"2023-10-08T15:40:23.704759+0000","last_peered":"2023-10-08T15:40:23.704759+0000","last_clean":"2023-10-08T15:40:23.704759+0000","last_became_active":"2023-10-08T15:40:23.704385+0000","last_became_peered":"2023-10-08T15:40:23.704385+0000","last_unstale":"2023-10-08T15:40:23.704759+0000","last_undegraded":"2023-10-08T15:40:23.704759+0000","last_fullsized":"2023-10-08T15:40:23.704759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:08:21.476854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709217+0000","last_change":"2023-10-08T15:40:23.709147+0000","last_active":"2023-10-08T15:40:23.709217+0000","last_peered":"2023-10-08T15:40:23.709217+0000","last_clean":"2023-10-08T15:40:23.709217+0000","last_became_active":"2023-10-08T15:40:23.708936+0000","last_became_peered":"2023-10-08T15:40:23.708936+0000","last_unstale":"2023-10-08T15:40:23.709217+0000","last_undegraded":"2023-10-08T15:40:23.709217+0000","last_fullsized":"2023-10-08T15:40:23.709217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.706519+0000","last_change":"2023-10-08T15:40:23.706380+0000","last_active":"2023-10-08T15:40:23.706519+0000","last_peered":"2023-10-08T15:40:23.706519+0000","last_clean":"2023-10-08T15:40:23.706519+0000","last_became_active":"2023-10-08T15:40:23.706144+0000","last_became_peered":"2023-10-08T15:40:23.706144+0000","last_unstale":"2023-10-08T15:40:23.706519+0000","last_undegraded":"2023-10-08T15:40:23.706519+0000","last_fullsized":"2023-10-08T15:40:23.706519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695687+0000","last_change":"2023-10-08T15:40:23.695528+0000","last_active":"2023-10-08T15:40:23.695687+0000","last_peered":"2023-10-08T15:40:23.695687+0000","last_clean":"2023-10-08T15:40:23.695687+0000","last_became_active":"2023-10-08T15:40:23.695302+0000","last_became_peered":"2023-10-08T15:40:23.695302+0000","last_unstale":"2023-10-08T15:40:23.695687+0000","last_undegraded":"2023-10-08T15:40:23.695687+0000","last_fullsized":"2023-10-08T15:40:23.695687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703495+0000","last_change":"2023-10-08T15:40:23.703349+0000","last_active":"2023-10-08T15:40:23.703495+0000","last_peered":"2023-10-08T15:40:23.703495+0000","last_clean":"2023-10-08T15:40:23.703495+0000","last_became_active":"2023-10-08T15:40:23.702660+0000","last_became_peered":"2023-10-08T15:40:23.702660+0000","last_unstale":"2023-10-08T15:40:23.703495+0000","last_undegraded":"2023-10-08T15:40:23.703495+0000","last_fullsized":"2023-10-08T15:40:23.703495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707426+0000","last_change":"2023-10-08T15:40:23.707180+0000","last_active":"2023-10-08T15:40:23.707426+0000","last_peered":"2023-10-08T15:40:23.707426+0000","last_clean":"2023-10-08T15:40:23.707426+0000","last_became_active":"2023-10-08T15:40:23.706069+0000","last_became_peered":"2023-10-08T15:40:23.706069+0000","last_unstale":"2023-10-08T15:40:23.707426+0000","last_undegraded":"2023-10-08T15:40:23.707426+0000","last_fullsized":"2023-10-08T15:40:23.707426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703755+0000","last_change":"2023-10-08T15:40:23.703647+0000","last_active":"2023-10-08T15:40:23.703755+0000","last_peered":"2023-10-08T15:40:23.703755+0000","last_clean":"2023-10-08T15:40:23.703755+0000","last_became_active":"2023-10-08T15:40:23.703408+0000","last_became_peered":"2023-10-08T15:40:23.703408+0000","last_unstale":"2023-10-08T15:40:23.703755+0000","last_undegraded":"2023-10-08T15:40:23.703755+0000","last_fullsized":"2023-10-08T15:40:23.703755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710129+0000","last_change":"2023-10-08T15:40:23.709470+0000","last_active":"2023-10-08T15:40:23.710129+0000","last_peered":"2023-10-08T15:40:23.710129+0000","last_clean":"2023-10-08T15:40:23.710129+0000","last_became_active":"2023-10-08T15:40:23.708885+0000","last_became_peered":"2023-10-08T15:40:23.708885+0000","last_unstale":"2023-10-08T15:40:23.710129+0000","last_undegraded":"2023-10-08T15:40:23.710129+0000","last_fullsized":"2023-10-08T15:40:23.710129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:27.901303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705498+0000","last_change":"2023-10-08T15:40:23.703463+0000","last_active":"2023-10-08T15:40:23.705498+0000","last_peered":"2023-10-08T15:40:23.705498+0000","last_clean":"2023-10-08T15:40:23.705498+0000","last_became_active":"2023-10-08T15:40:23.702524+0000","last_became_peered":"2023-10-08T15:40:23.702524+0000","last_unstale":"2023-10-08T15:40:23.705498+0000","last_undegraded":"2023-10-08T15:40:23.705498+0000","last_fullsized":"2023-10-08T15:40:23.705498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704661+0000","last_change":"2023-10-08T15:40:23.702028+0000","last_active":"2023-10-08T15:40:23.704661+0000","last_peered":"2023-10-08T15:40:23.704661+0000","last_clean":"2023-10-08T15:40:23.704661+0000","last_became_active":"2023-10-08T15:40:23.701778+0000","last_became_peered":"2023-10-08T15:40:23.701778+0000","last_unstale":"2023-10-08T15:40:23.704661+0000","last_undegraded":"2023-10-08T15:40:23.704661+0000","last_fullsized":"2023-10-08T15:40:23.704661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700079+0000","last_change":"2023-10-08T15:40:23.699492+0000","last_active":"2023-10-08T15:40:23.700079+0000","last_peered":"2023-10-08T15:40:23.700079+0000","last_clean":"2023-10-08T15:40:23.700079+0000","last_became_active":"2023-10-08T15:40:23.698975+0000","last_became_peered":"2023-10-08T15:40:23.698975+0000","last_unstale":"2023-10-08T15:40:23.700079+0000","last_undegraded":"2023-10-08T15:40:23.700079+0000","last_fullsized":"2023-10-08T15:40:23.700079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710621+0000","last_change":"2023-10-08T15:40:22.695776+0000","last_active":"2023-10-08T15:40:23.710621+0000","last_peered":"2023-10-08T15:40:23.710621+0000","last_clean":"2023-10-08T15:40:23.710621+0000","last_became_active":"2023-10-08T15:40:22.695553+0000","last_became_peered":"2023-10-08T15:40:22.695553+0000","last_unstale":"2023-10-08T15:40:23.710621+0000","last_undegraded":"2023-10-08T15:40:23.710621+0000","last_fullsized":"2023-10-08T15:40:23.710621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.698627+0000","last_change":"2023-10-08T15:40:23.697252+0000","last_active":"2023-10-08T15:40:23.698627+0000","last_peered":"2023-10-08T15:40:23.698627+0000","last_clean":"2023-10-08T15:40:23.698627+0000","last_became_active":"2023-10-08T15:40:23.697020+0000","last_became_peered":"2023-10-08T15:40:23.697020+0000","last_unstale":"2023-10-08T15:40:23.698627+0000","last_undegraded":"2023-10-08T15:40:23.698627+0000","last_fullsized":"2023-10-08T15:40:23.698627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708476+0000","last_change":"2023-10-08T15:40:22.699564+0000","last_active":"2023-10-08T15:40:23.708476+0000","last_peered":"2023-10-08T15:40:23.708476+0000","last_clean":"2023-10-08T15:40:23.708476+0000","last_became_active":"2023-10-08T15:40:22.698627+0000","last_became_peered":"2023-10-08T15:40:22.698627+0000","last_unstale":"2023-10-08T15:40:23.708476+0000","last_undegraded":"2023-10-08T15:40:23.708476+0000","last_fullsized":"2023-10-08T15:40:23.708476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707387+0000","last_change":"2023-10-08T15:40:23.706021+0000","last_active":"2023-10-08T15:40:23.707387+0000","last_peered":"2023-10-08T15:40:23.707387+0000","last_clean":"2023-10-08T15:40:23.707387+0000","last_became_active":"2023-10-08T15:40:23.705521+0000","last_became_peered":"2023-10-08T15:40:23.705521+0000","last_unstale":"2023-10-08T15:40:23.707387+0000","last_undegraded":"2023-10-08T15:40:23.707387+0000","last_fullsized":"2023-10-08T15:40:23.707387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707933+0000","last_change":"2023-10-08T15:40:22.700173+0000","last_active":"2023-10-08T15:40:23.707933+0000","last_peered":"2023-10-08T15:40:23.707933+0000","last_clean":"2023-10-08T15:40:23.707933+0000","last_became_active":"2023-10-08T15:40:22.699897+0000","last_became_peered":"2023-10-08T15:40:22.699897+0000","last_unstale":"2023-10-08T15:40:23.707933+0000","last_undegraded":"2023-10-08T15:40:23.707933+0000","last_fullsized":"2023-10-08T15:40:23.707933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:48.001159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702397+0000","last_change":"2023-10-08T15:40:23.702311+0000","last_active":"2023-10-08T15:40:23.702397+0000","last_peered":"2023-10-08T15:40:23.702397+0000","last_clean":"2023-10-08T15:40:23.702397+0000","last_became_active":"2023-10-08T15:40:23.702075+0000","last_became_peered":"2023-10-08T15:40:23.702075+0000","last_unstale":"2023-10-08T15:40:23.702397+0000","last_undegraded":"2023-10-08T15:40:23.702397+0000","last_fullsized":"2023-10-08T15:40:23.702397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:47.802873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709088+0000","last_change":"2023-10-08T15:40:22.702341+0000","last_active":"2023-10-08T15:40:23.709088+0000","last_peered":"2023-10-08T15:40:23.709088+0000","last_clean":"2023-10-08T15:40:23.709088+0000","last_became_active":"2023-10-08T15:40:22.701383+0000","last_became_peered":"2023-10-08T15:40:22.701383+0000","last_unstale":"2023-10-08T15:40:23.709088+0000","last_undegraded":"2023-10-08T15:40:23.709088+0000","last_fullsized":"2023-10-08T15:40:23.709088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708763+0000","last_change":"2023-10-08T15:40:23.708521+0000","last_active":"2023-10-08T15:40:23.708763+0000","last_peered":"2023-10-08T15:40:23.708763+0000","last_clean":"2023-10-08T15:40:23.708763+0000","last_became_active":"2023-10-08T15:40:23.708313+0000","last_became_peered":"2023-10-08T15:40:23.708313+0000","last_unstale":"2023-10-08T15:40:23.708763+0000","last_undegraded":"2023-10-08T15:40:23.708763+0000","last_fullsized":"2023-10-08T15:40:23.708763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703043+0000","last_change":"2023-10-08T15:40:22.698477+0000","last_active":"2023-10-08T15:40:23.703043+0000","last_peered":"2023-10-08T15:40:23.703043+0000","last_clean":"2023-10-08T15:40:23.703043+0000","last_became_active":"2023-10-08T15:40:22.698057+0000","last_became_peered":"2023-10-08T15:40:22.698057+0000","last_unstale":"2023-10-08T15:40:23.703043+0000","last_undegraded":"2023-10-08T15:40:23.703043+0000","last_fullsized":"2023-10-08T15:40:23.703043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695668+0000","last_change":"2023-10-08T15:40:23.695420+0000","last_active":"2023-10-08T15:40:23.695668+0000","last_peered":"2023-10-08T15:40:23.695668+0000","last_clean":"2023-10-08T15:40:23.695668+0000","last_became_active":"2023-10-08T15:40:23.695193+0000","last_became_peered":"2023-10-08T15:40:23.695193+0000","last_unstale":"2023-10-08T15:40:23.695668+0000","last_undegraded":"2023-10-08T15:40:23.695668+0000","last_fullsized":"2023-10-08T15:40:23.695668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704172+0000","last_change":"2023-10-08T15:40:22.695547+0000","last_active":"2023-10-08T15:40:23.704172+0000","last_peered":"2023-10-08T15:40:23.704172+0000","last_clean":"2023-10-08T15:40:23.704172+0000","last_became_active":"2023-10-08T15:40:22.695272+0000","last_became_peered":"2023-10-08T15:40:22.695272+0000","last_unstale":"2023-10-08T15:40:23.704172+0000","last_undegraded":"2023-10-08T15:40:23.704172+0000","last_fullsized":"2023-10-08T15:40:23.704172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708209+0000","last_change":"2023-10-08T15:40:23.708141+0000","last_active":"2023-10-08T15:40:23.708209+0000","last_peered":"2023-10-08T15:40:23.708209+0000","last_clean":"2023-10-08T15:40:23.708209+0000","last_became_active":"2023-10-08T15:40:23.707923+0000","last_became_peered":"2023-10-08T15:40:23.707923+0000","last_unstale":"2023-10-08T15:40:23.708209+0000","last_undegraded":"2023-10-08T15:40:23.708209+0000","last_fullsized":"2023-10-08T15:40:23.708209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692120+0000","last_change":"2023-10-08T15:40:22.700006+0000","last_active":"2023-10-08T15:40:23.692120+0000","last_peered":"2023-10-08T15:40:23.692120+0000","last_clean":"2023-10-08T15:40:23.692120+0000","last_became_active":"2023-10-08T15:40:22.699783+0000","last_became_peered":"2023-10-08T15:40:22.699783+0000","last_unstale":"2023-10-08T15:40:23.692120+0000","last_undegraded":"2023-10-08T15:40:23.692120+0000","last_fullsized":"2023-10-08T15:40:23.692120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705390+0000","last_change":"2023-10-08T15:40:23.705275+0000","last_active":"2023-10-08T15:40:23.705390+0000","last_peered":"2023-10-08T15:40:23.705390+0000","last_clean":"2023-10-08T15:40:23.705390+0000","last_became_active":"2023-10-08T15:40:23.700794+0000","last_became_peered":"2023-10-08T15:40:23.700794+0000","last_unstale":"2023-10-08T15:40:23.705390+0000","last_undegraded":"2023-10-08T15:40:23.705390+0000","last_fullsized":"2023-10-08T15:40:23.705390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694804+0000","last_change":"2023-10-08T15:40:22.695652+0000","last_active":"2023-10-08T15:40:23.694804+0000","last_peered":"2023-10-08T15:40:23.694804+0000","last_clean":"2023-10-08T15:40:23.694804+0000","last_became_active":"2023-10-08T15:40:22.695043+0000","last_became_peered":"2023-10-08T15:40:22.695043+0000","last_unstale":"2023-10-08T15:40:23.694804+0000","last_undegraded":"2023-10-08T15:40:23.694804+0000","last_fullsized":"2023-10-08T15:40:23.694804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695661+0000","last_change":"2023-10-08T15:40:23.695481+0000","last_active":"2023-10-08T15:40:23.695661+0000","last_peered":"2023-10-08T15:40:23.695661+0000","last_clean":"2023-10-08T15:40:23.695661+0000","last_became_active":"2023-10-08T15:40:23.695247+0000","last_became_peered":"2023-10-08T15:40:23.695247+0000","last_unstale":"2023-10-08T15:40:23.695661+0000","last_undegraded":"2023-10-08T15:40:23.695661+0000","last_fullsized":"2023-10-08T15:40:23.695661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693450+0000","last_change":"2023-10-08T15:40:22.702796+0000","last_active":"2023-10-08T15:40:23.693450+0000","last_peered":"2023-10-08T15:40:23.693450+0000","last_clean":"2023-10-08T15:40:23.693450+0000","last_became_active":"2023-10-08T15:40:22.702571+0000","last_became_peered":"2023-10-08T15:40:22.702571+0000","last_unstale":"2023-10-08T15:40:23.693450+0000","last_undegraded":"2023-10-08T15:40:23.693450+0000","last_fullsized":"2023-10-08T15:40:23.693450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708503+0000","last_change":"2023-10-08T15:40:23.708328+0000","last_active":"2023-10-08T15:40:23.708503+0000","last_peered":"2023-10-08T15:40:23.708503+0000","last_clean":"2023-10-08T15:40:23.708503+0000","last_became_active":"2023-10-08T15:40:23.703248+0000","last_became_peered":"2023-10-08T15:40:23.703248+0000","last_unstale":"2023-10-08T15:40:23.708503+0000","last_undegraded":"2023-10-08T15:40:23.708503+0000","last_fullsized":"2023-10-08T15:40:23.708503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689878+0000","last_change":"2023-10-08T15:40:22.702638+0000","last_active":"2023-10-08T15:40:23.689878+0000","last_peered":"2023-10-08T15:40:23.689878+0000","last_clean":"2023-10-08T15:40:23.689878+0000","last_became_active":"2023-10-08T15:40:22.702409+0000","last_became_peered":"2023-10-08T15:40:22.702409+0000","last_unstale":"2023-10-08T15:40:23.689878+0000","last_undegraded":"2023-10-08T15:40:23.689878+0000","last_fullsized":"2023-10-08T15:40:23.689878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711325+0000","last_change":"2023-10-08T15:40:23.711250+0000","last_active":"2023-10-08T15:40:23.711325+0000","last_peered":"2023-10-08T15:40:23.711325+0000","last_clean":"2023-10-08T15:40:23.711325+0000","last_became_active":"2023-10-08T15:40:23.710219+0000","last_became_peered":"2023-10-08T15:40:23.710219+0000","last_unstale":"2023-10-08T15:40:23.711325+0000","last_undegraded":"2023-10-08T15:40:23.711325+0000","last_fullsized":"2023-10-08T15:40:23.711325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705796+0000","last_change":"2023-10-08T15:40:22.697798+0000","last_active":"2023-10-08T15:40:23.705796+0000","last_peered":"2023-10-08T15:40:23.705796+0000","last_clean":"2023-10-08T15:40:23.705796+0000","last_became_active":"2023-10-08T15:40:22.697562+0000","last_became_peered":"2023-10-08T15:40:22.697562+0000","last_unstale":"2023-10-08T15:40:23.705796+0000","last_undegraded":"2023-10-08T15:40:23.705796+0000","last_fullsized":"2023-10-08T15:40:23.705796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.697935+0000","last_change":"2023-10-08T15:40:23.697679+0000","last_active":"2023-10-08T15:40:23.697935+0000","last_peered":"2023-10-08T15:40:23.697935+0000","last_clean":"2023-10-08T15:40:23.697935+0000","last_became_active":"2023-10-08T15:40:23.697500+0000","last_became_peered":"2023-10-08T15:40:23.697500+0000","last_unstale":"2023-10-08T15:40:23.697935+0000","last_undegraded":"2023-10-08T15:40:23.697935+0000","last_fullsized":"2023-10-08T15:40:23.697935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708929+0000","last_change":"2023-10-08T15:40:22.700551+0000","last_active":"2023-10-08T15:40:23.708929+0000","last_peered":"2023-10-08T15:40:23.708929+0000","last_clean":"2023-10-08T15:40:23.708929+0000","last_became_active":"2023-10-08T15:40:22.700305+0000","last_became_peered":"2023-10-08T15:40:22.700305+0000","last_unstale":"2023-10-08T15:40:23.708929+0000","last_undegraded":"2023-10-08T15:40:23.708929+0000","last_fullsized":"2023-10-08T15:40:23.708929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707313+0000","last_change":"2023-10-08T15:40:23.707252+0000","last_active":"2023-10-08T15:40:23.707313+0000","last_peered":"2023-10-08T15:40:23.707313+0000","last_clean":"2023-10-08T15:40:23.707313+0000","last_became_active":"2023-10-08T15:40:23.706836+0000","last_became_peered":"2023-10-08T15:40:23.706836+0000","last_unstale":"2023-10-08T15:40:23.707313+0000","last_undegraded":"2023-10-08T15:40:23.707313+0000","last_fullsized":"2023-10-08T15:40:23.707313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:56:55.421889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711061+0000","last_change":"2023-10-08T15:40:22.695062+0000","last_active":"2023-10-08T15:40:23.711061+0000","last_peered":"2023-10-08T15:40:23.711061+0000","last_clean":"2023-10-08T15:40:23.711061+0000","last_became_active":"2023-10-08T15:40:22.694763+0000","last_became_peered":"2023-10-08T15:40:22.694763+0000","last_unstale":"2023-10-08T15:40:23.711061+0000","last_undegraded":"2023-10-08T15:40:23.711061+0000","last_fullsized":"2023-10-08T15:40:23.711061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711493+0000","last_change":"2023-10-08T15:40:23.711417+0000","last_active":"2023-10-08T15:40:23.711493+0000","last_peered":"2023-10-08T15:40:23.711493+0000","last_clean":"2023-10-08T15:40:23.711493+0000","last_became_active":"2023-10-08T15:40:23.710718+0000","last_became_peered":"2023-10-08T15:40:23.710718+0000","last_unstale":"2023-10-08T15:40:23.711493+0000","last_undegraded":"2023-10-08T15:40:23.711493+0000","last_fullsized":"2023-10-08T15:40:23.711493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690573+0000","last_change":"2023-10-08T15:40:22.701263+0000","last_active":"2023-10-08T15:40:23.690573+0000","last_peered":"2023-10-08T15:40:23.690573+0000","last_clean":"2023-10-08T15:40:23.690573+0000","last_became_active":"2023-10-08T15:40:22.700296+0000","last_became_peered":"2023-10-08T15:40:22.700296+0000","last_unstale":"2023-10-08T15:40:23.690573+0000","last_undegraded":"2023-10-08T15:40:23.690573+0000","last_fullsized":"2023-10-08T15:40:23.690573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702914+0000","last_change":"2023-10-08T15:40:23.702841+0000","last_active":"2023-10-08T15:40:23.702914+0000","last_peered":"2023-10-08T15:40:23.702914+0000","last_clean":"2023-10-08T15:40:23.702914+0000","last_became_active":"2023-10-08T15:40:23.702595+0000","last_became_peered":"2023-10-08T15:40:23.702595+0000","last_unstale":"2023-10-08T15:40:23.702914+0000","last_undegraded":"2023-10-08T15:40:23.702914+0000","last_fullsized":"2023-10-08T15:40:23.702914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:21.202497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694299+0000","last_change":"2023-10-08T15:40:22.699338+0000","last_active":"2023-10-08T15:40:23.694299+0000","last_peered":"2023-10-08T15:40:23.694299+0000","last_clean":"2023-10-08T15:40:23.694299+0000","last_became_active":"2023-10-08T15:40:22.698307+0000","last_became_peered":"2023-10-08T15:40:22.698307+0000","last_unstale":"2023-10-08T15:40:23.694299+0000","last_undegraded":"2023-10-08T15:40:23.694299+0000","last_fullsized":"2023-10-08T15:40:23.694299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710031+0000","last_change":"2023-10-08T15:40:23.709914+0000","last_active":"2023-10-08T15:40:23.710031+0000","last_peered":"2023-10-08T15:40:23.710031+0000","last_clean":"2023-10-08T15:40:23.710031+0000","last_became_active":"2023-10-08T15:40:23.709690+0000","last_became_peered":"2023-10-08T15:40:23.709690+0000","last_unstale":"2023-10-08T15:40:23.710031+0000","last_undegraded":"2023-10-08T15:40:23.710031+0000","last_fullsized":"2023-10-08T15:40:23.710031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.706704+0000","last_change":"2023-10-08T15:40:22.692944+0000","last_active":"2023-10-08T15:40:23.706704+0000","last_peered":"2023-10-08T15:40:23.706704+0000","last_clean":"2023-10-08T15:40:23.706704+0000","last_became_active":"2023-10-08T15:40:22.692741+0000","last_became_peered":"2023-10-08T15:40:22.692741+0000","last_unstale":"2023-10-08T15:40:23.706704+0000","last_undegraded":"2023-10-08T15:40:23.706704+0000","last_fullsized":"2023-10-08T15:40:23.706704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701648+0000","last_change":"2023-10-08T15:40:23.701472+0000","last_active":"2023-10-08T15:40:23.701648+0000","last_peered":"2023-10-08T15:40:23.701648+0000","last_clean":"2023-10-08T15:40:23.701648+0000","last_became_active":"2023-10-08T15:40:23.701256+0000","last_became_peered":"2023-10-08T15:40:23.701256+0000","last_unstale":"2023-10-08T15:40:23.701648+0000","last_undegraded":"2023-10-08T15:40:23.701648+0000","last_fullsized":"2023-10-08T15:40:23.701648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707703+0000","last_change":"2023-10-08T15:40:22.696237+0000","last_active":"2023-10-08T15:40:23.707703+0000","last_peered":"2023-10-08T15:40:23.707703+0000","last_clean":"2023-10-08T15:40:23.707703+0000","last_became_active":"2023-10-08T15:40:22.695953+0000","last_became_peered":"2023-10-08T15:40:22.695953+0000","last_unstale":"2023-10-08T15:40:23.707703+0000","last_undegraded":"2023-10-08T15:40:23.707703+0000","last_fullsized":"2023-10-08T15:40:23.707703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:40.912548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708134+0000","last_change":"2023-10-08T15:40:23.708069+0000","last_active":"2023-10-08T15:40:23.708134+0000","last_peered":"2023-10-08T15:40:23.708134+0000","last_clean":"2023-10-08T15:40:23.708134+0000","last_became_active":"2023-10-08T15:40:23.707605+0000","last_became_peered":"2023-10-08T15:40:23.707605+0000","last_unstale":"2023-10-08T15:40:23.708134+0000","last_undegraded":"2023-10-08T15:40:23.708134+0000","last_fullsized":"2023-10-08T15:40:23.708134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689446+0000","last_change":"2023-10-08T15:40:22.695667+0000","last_active":"2023-10-08T15:40:23.689446+0000","last_peered":"2023-10-08T15:40:23.689446+0000","last_clean":"2023-10-08T15:40:23.689446+0000","last_became_active":"2023-10-08T15:40:22.695439+0000","last_became_peered":"2023-10-08T15:40:22.695439+0000","last_unstale":"2023-10-08T15:40:23.689446+0000","last_undegraded":"2023-10-08T15:40:23.689446+0000","last_fullsized":"2023-10-08T15:40:23.689446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699711+0000","last_change":"2023-10-08T15:40:23.699438+0000","last_active":"2023-10-08T15:40:23.699711+0000","last_peered":"2023-10-08T15:40:23.699711+0000","last_clean":"2023-10-08T15:40:23.699711+0000","last_became_active":"2023-10-08T15:40:23.697150+0000","last_became_peered":"2023-10-08T15:40:23.697150+0000","last_unstale":"2023-10-08T15:40:23.699711+0000","last_undegraded":"2023-10-08T15:40:23.699711+0000","last_fullsized":"2023-10-08T15:40:23.699711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690287+0000","last_change":"2023-10-08T15:40:22.698283+0000","last_active":"2023-10-08T15:40:23.690287+0000","last_peered":"2023-10-08T15:40:23.690287+0000","last_clean":"2023-10-08T15:40:23.690287+0000","last_became_active":"2023-10-08T15:40:22.697621+0000","last_became_peered":"2023-10-08T15:40:22.697621+0000","last_unstale":"2023-10-08T15:40:23.690287+0000","last_undegraded":"2023-10-08T15:40:23.690287+0000","last_fullsized":"2023-10-08T15:40:23.690287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708554+0000","last_change":"2023-10-08T15:40:23.708442+0000","last_active":"2023-10-08T15:40:23.708554+0000","last_peered":"2023-10-08T15:40:23.708554+0000","last_clean":"2023-10-08T15:40:23.708554+0000","last_became_active":"2023-10-08T15:40:23.708184+0000","last_became_peered":"2023-10-08T15:40:23.708184+0000","last_unstale":"2023-10-08T15:40:23.708554+0000","last_undegraded":"2023-10-08T15:40:23.708554+0000","last_fullsized":"2023-10-08T15:40:23.708554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693436+0000","last_change":"2023-10-08T15:40:23.693350+0000","last_active":"2023-10-08T15:40:23.693436+0000","last_peered":"2023-10-08T15:40:23.693436+0000","last_clean":"2023-10-08T15:40:23.693436+0000","last_became_active":"2023-10-08T15:40:23.693126+0000","last_became_peered":"2023-10-08T15:40:23.693126+0000","last_unstale":"2023-10-08T15:40:23.693436+0000","last_undegraded":"2023-10-08T15:40:23.693436+0000","last_fullsized":"2023-10-08T15:40:23.693436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690921+0000","last_change":"2023-10-08T15:40:22.698673+0000","last_active":"2023-10-08T15:40:23.690921+0000","last_peered":"2023-10-08T15:40:23.690921+0000","last_clean":"2023-10-08T15:40:23.690921+0000","last_became_active":"2023-10-08T15:40:22.698433+0000","last_became_peered":"2023-10-08T15:40:22.698433+0000","last_unstale":"2023-10-08T15:40:23.690921+0000","last_undegraded":"2023-10-08T15:40:23.690921+0000","last_fullsized":"2023-10-08T15:40:23.690921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694799+0000","last_change":"2023-10-08T15:40:23.694732+0000","last_active":"2023-10-08T15:40:23.694799+0000","last_peered":"2023-10-08T15:40:23.694799+0000","last_clean":"2023-10-08T15:40:23.694799+0000","last_became_active":"2023-10-08T15:40:23.694463+0000","last_became_peered":"2023-10-08T15:40:23.694463+0000","last_unstale":"2023-10-08T15:40:23.694799+0000","last_undegraded":"2023-10-08T15:40:23.694799+0000","last_fullsized":"2023-10-08T15:40:23.694799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690975+0000","last_change":"2023-10-08T15:40:22.701412+0000","last_active":"2023-10-08T15:40:23.690975+0000","last_peered":"2023-10-08T15:40:23.690975+0000","last_clean":"2023-10-08T15:40:23.690975+0000","last_became_active":"2023-10-08T15:40:22.701018+0000","last_became_peered":"2023-10-08T15:40:22.701018+0000","last_unstale":"2023-10-08T15:40:23.690975+0000","last_undegraded":"2023-10-08T15:40:23.690975+0000","last_fullsized":"2023-10-08T15:40:23.690975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692909+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:40:23.692909+0000","last_peered":"2023-10-08T15:40:23.692909+0000","last_clean":"2023-10-08T15:40:23.692909+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:40:23.692909+0000","last_undegraded":"2023-10-08T15:40:23.692909+0000","last_fullsized":"2023-10-08T15:40:23.692909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708661+0000","last_change":"2023-10-08T15:40:23.708609+0000","last_active":"2023-10-08T15:40:23.708661+0000","last_peered":"2023-10-08T15:40:23.708661+0000","last_clean":"2023-10-08T15:40:23.708661+0000","last_became_active":"2023-10-08T15:40:23.708135+0000","last_became_peered":"2023-10-08T15:40:23.708135+0000","last_unstale":"2023-10-08T15:40:23.708661+0000","last_undegraded":"2023-10-08T15:40:23.708661+0000","last_fullsized":"2023-10-08T15:40:23.708661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692107+0000","last_change":"2023-10-08T15:40:22.702091+0000","last_active":"2023-10-08T15:40:23.692107+0000","last_peered":"2023-10-08T15:40:23.692107+0000","last_clean":"2023-10-08T15:40:23.692107+0000","last_became_active":"2023-10-08T15:40:22.701729+0000","last_became_peered":"2023-10-08T15:40:22.701729+0000","last_unstale":"2023-10-08T15:40:23.692107+0000","last_undegraded":"2023-10-08T15:40:23.692107+0000","last_fullsized":"2023-10-08T15:40:23.692107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:00.869317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692213+0000","last_change":"2023-10-08T15:40:22.701958+0000","last_active":"2023-10-08T15:40:23.692213+0000","last_peered":"2023-10-08T15:40:23.692213+0000","last_clean":"2023-10-08T15:40:23.692213+0000","last_became_active":"2023-10-08T15:40:22.701237+0000","last_became_peered":"2023-10-08T15:40:22.701237+0000","last_unstale":"2023-10-08T15:40:23.692213+0000","last_undegraded":"2023-10-08T15:40:23.692213+0000","last_fullsized":"2023-10-08T15:40:23.692213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.696404+0000","last_change":"2023-10-08T15:40:23.696335+0000","last_active":"2023-10-08T15:40:23.696404+0000","last_peered":"2023-10-08T15:40:23.696404+0000","last_clean":"2023-10-08T15:40:23.696404+0000","last_became_active":"2023-10-08T15:40:23.696088+0000","last_became_peered":"2023-10-08T15:40:23.696088+0000","last_unstale":"2023-10-08T15:40:23.696404+0000","last_undegraded":"2023-10-08T15:40:23.696404+0000","last_fullsized":"2023-10-08T15:40:23.696404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T15:40:24.689606+0000","last_change":"2023-10-08T15:40:22.702336+0000","last_active":"2023-10-08T15:40:24.689606+0000","last_peered":"2023-10-08T15:40:24.689606+0000","last_clean":"2023-10-08T15:40:24.689606+0000","last_became_active":"2023-10-08T15:40:22.702088+0000","last_became_peered":"2023-10-08T15:40:22.702088+0000","last_unstale":"2023-10-08T15:40:24.689606+0000","last_undegraded":"2023-10-08T15:40:24.689606+0000","last_fullsized":"2023-10-08T15:40:24.689606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711086+0000","last_change":"2023-10-08T15:40:23.711013+0000","last_active":"2023-10-08T15:40:23.711086+0000","last_peered":"2023-10-08T15:40:23.711086+0000","last_clean":"2023-10-08T15:40:23.711086+0000","last_became_active":"2023-10-08T15:40:23.710775+0000","last_became_peered":"2023-10-08T15:40:23.710775+0000","last_unstale":"2023-10-08T15:40:23.711086+0000","last_undegraded":"2023-10-08T15:40:23.711086+0000","last_fullsized":"2023-10-08T15:40:23.711086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705898+0000","last_change":"2023-10-08T15:40:22.699798+0000","last_active":"2023-10-08T15:40:23.705898+0000","last_peered":"2023-10-08T15:40:23.705898+0000","last_clean":"2023-10-08T15:40:23.705898+0000","last_became_active":"2023-10-08T15:40:22.699567+0000","last_became_peered":"2023-10-08T15:40:22.699567+0000","last_unstale":"2023-10-08T15:40:23.705898+0000","last_undegraded":"2023-10-08T15:40:23.705898+0000","last_fullsized":"2023-10-08T15:40:23.705898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708191+0000","last_change":"2023-10-08T15:40:23.707901+0000","last_active":"2023-10-08T15:40:23.708191+0000","last_peered":"2023-10-08T15:40:23.708191+0000","last_clean":"2023-10-08T15:40:23.708191+0000","last_became_active":"2023-10-08T15:40:23.707456+0000","last_became_peered":"2023-10-08T15:40:23.707456+0000","last_unstale":"2023-10-08T15:40:23.708191+0000","last_undegraded":"2023-10-08T15:40:23.708191+0000","last_fullsized":"2023-10-08T15:40:23.708191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693777+0000","last_change":"2023-10-08T15:40:22.701044+0000","last_active":"2023-10-08T15:40:23.693777+0000","last_peered":"2023-10-08T15:40:23.693777+0000","last_clean":"2023-10-08T15:40:23.693777+0000","last_became_active":"2023-10-08T15:40:22.700575+0000","last_became_peered":"2023-10-08T15:40:22.700575+0000","last_unstale":"2023-10-08T15:40:23.693777+0000","last_undegraded":"2023-10-08T15:40:23.693777+0000","last_fullsized":"2023-10-08T15:40:23.693777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702957+0000","last_change":"2023-10-08T15:40:23.702405+0000","last_active":"2023-10-08T15:40:23.702957+0000","last_peered":"2023-10-08T15:40:23.702957+0000","last_clean":"2023-10-08T15:40:23.702957+0000","last_became_active":"2023-10-08T15:40:23.702039+0000","last_became_peered":"2023-10-08T15:40:23.702039+0000","last_unstale":"2023-10-08T15:40:23.702957+0000","last_undegraded":"2023-10-08T15:40:23.702957+0000","last_fullsized":"2023-10-08T15:40:23.702957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689542+0000","last_change":"2023-10-08T15:40:22.700842+0000","last_active":"2023-10-08T15:40:23.689542+0000","last_peered":"2023-10-08T15:40:23.689542+0000","last_clean":"2023-10-08T15:40:23.689542+0000","last_became_active":"2023-10-08T15:40:22.700609+0000","last_became_peered":"2023-10-08T15:40:22.700609+0000","last_unstale":"2023-10-08T15:40:23.689542+0000","last_undegraded":"2023-10-08T15:40:23.689542+0000","last_fullsized":"2023-10-08T15:40:23.689542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693774+0000","last_change":"2023-10-08T15:40:23.693701+0000","last_active":"2023-10-08T15:40:23.693774+0000","last_peered":"2023-10-08T15:40:23.693774+0000","last_clean":"2023-10-08T15:40:23.693774+0000","last_became_active":"2023-10-08T15:40:23.693469+0000","last_became_peered":"2023-10-08T15:40:23.693469+0000","last_unstale":"2023-10-08T15:40:23.693774+0000","last_undegraded":"2023-10-08T15:40:23.693774+0000","last_fullsized":"2023-10-08T15:40:23.693774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689145+0000","last_change":"2023-10-08T15:40:22.700304+0000","last_active":"2023-10-08T15:40:23.689145+0000","last_peered":"2023-10-08T15:40:23.689145+0000","last_clean":"2023-10-08T15:40:23.689145+0000","last_became_active":"2023-10-08T15:40:22.700075+0000","last_became_peered":"2023-10-08T15:40:22.700075+0000","last_unstale":"2023-10-08T15:40:23.689145+0000","last_undegraded":"2023-10-08T15:40:23.689145+0000","last_fullsized":"2023-10-08T15:40:23.689145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709767+0000","last_change":"2023-10-08T15:40:23.709682+0000","last_active":"2023-10-08T15:40:23.709767+0000","last_peered":"2023-10-08T15:40:23.709767+0000","last_clean":"2023-10-08T15:40:23.709767+0000","last_became_active":"2023-10-08T15:40:23.709450+0000","last_became_peered":"2023-10-08T15:40:23.709450+0000","last_unstale":"2023-10-08T15:40:23.709767+0000","last_undegraded":"2023-10-08T15:40:23.709767+0000","last_fullsized":"2023-10-08T15:40:23.709767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707105+0000","last_change":"2023-10-08T15:40:22.699299+0000","last_active":"2023-10-08T15:40:23.707105+0000","last_peered":"2023-10-08T15:40:23.707105+0000","last_clean":"2023-10-08T15:40:23.707105+0000","last_became_active":"2023-10-08T15:40:22.699051+0000","last_became_peered":"2023-10-08T15:40:22.699051+0000","last_unstale":"2023-10-08T15:40:23.707105+0000","last_undegraded":"2023-10-08T15:40:23.707105+0000","last_fullsized":"2023-10-08T15:40:23.707105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699507+0000","last_change":"2023-10-08T15:40:23.699439+0000","last_active":"2023-10-08T15:40:23.699507+0000","last_peered":"2023-10-08T15:40:23.699507+0000","last_clean":"2023-10-08T15:40:23.699507+0000","last_became_active":"2023-10-08T15:40:23.699096+0000","last_became_peered":"2023-10-08T15:40:23.699096+0000","last_unstale":"2023-10-08T15:40:23.699507+0000","last_undegraded":"2023-10-08T15:40:23.699507+0000","last_fullsized":"2023-10-08T15:40:23.699507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.691509+0000","last_change":"2023-10-08T15:40:22.694836+0000","last_active":"2023-10-08T15:40:23.691509+0000","last_peered":"2023-10-08T15:40:23.691509+0000","last_clean":"2023-10-08T15:40:23.691509+0000","last_became_active":"2023-10-08T15:40:22.694608+0000","last_became_peered":"2023-10-08T15:40:22.694608+0000","last_unstale":"2023-10-08T15:40:23.691509+0000","last_undegraded":"2023-10-08T15:40:23.691509+0000","last_fullsized":"2023-10-08T15:40:23.691509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703621+0000","last_change":"2023-10-08T15:40:23.703118+0000","last_active":"2023-10-08T15:40:23.703621+0000","last_peered":"2023-10-08T15:40:23.703621+0000","last_clean":"2023-10-08T15:40:23.703621+0000","last_became_active":"2023-10-08T15:40:23.702720+0000","last_became_peered":"2023-10-08T15:40:23.702720+0000","last_unstale":"2023-10-08T15:40:23.703621+0000","last_undegraded":"2023-10-08T15:40:23.703621+0000","last_fullsized":"2023-10-08T15:40:23.703621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:47.802873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703205+0000","last_change":"2023-10-08T15:40:22.694954+0000","last_active":"2023-10-08T15:40:23.703205+0000","last_peered":"2023-10-08T15:40:23.703205+0000","last_clean":"2023-10-08T15:40:23.703205+0000","last_became_active":"2023-10-08T15:40:22.694720+0000","last_became_peered":"2023-10-08T15:40:22.694720+0000","last_unstale":"2023-10-08T15:40:23.703205+0000","last_undegraded":"2023-10-08T15:40:23.703205+0000","last_fullsized":"2023-10-08T15:40:23.703205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700201+0000","last_change":"2023-10-08T15:40:23.700137+0000","last_active":"2023-10-08T15:40:23.700201+0000","last_peered":"2023-10-08T15:40:23.700201+0000","last_clean":"2023-10-08T15:40:23.700201+0000","last_became_active":"2023-10-08T15:40:23.699832+0000","last_became_peered":"2023-10-08T15:40:23.699832+0000","last_unstale":"2023-10-08T15:40:23.700201+0000","last_undegraded":"2023-10-08T15:40:23.700201+0000","last_fullsized":"2023-10-08T15:40:23.700201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707215+0000","last_change":"2023-10-08T15:40:22.696186+0000","last_active":"2023-10-08T15:40:23.707215+0000","last_peered":"2023-10-08T15:40:23.707215+0000","last_clean":"2023-10-08T15:40:23.707215+0000","last_became_active":"2023-10-08T15:40:22.695949+0000","last_became_peered":"2023-10-08T15:40:22.695949+0000","last_unstale":"2023-10-08T15:40:23.707215+0000","last_undegraded":"2023-10-08T15:40:23.707215+0000","last_fullsized":"2023-10-08T15:40:23.707215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700110+0000","last_change":"2023-10-08T15:40:23.699621+0000","last_active":"2023-10-08T15:40:23.700110+0000","last_peered":"2023-10-08T15:40:23.700110+0000","last_clean":"2023-10-08T15:40:23.700110+0000","last_became_active":"2023-10-08T15:40:23.699275+0000","last_became_peered":"2023-10-08T15:40:23.699275+0000","last_unstale":"2023-10-08T15:40:23.700110+0000","last_undegraded":"2023-10-08T15:40:23.700110+0000","last_fullsized":"2023-10-08T15:40:23.700110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:25.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709672+0000","last_change":"2023-10-08T15:40:23.709581+0000","last_active":"2023-10-08T15:40:23.709672+0000","last_peered":"2023-10-08T15:40:23.709672+0000","last_clean":"2023-10-08T15:40:23.709672+0000","last_became_active":"2023-10-08T15:40:23.709337+0000","last_became_peered":"2023-10-08T15:40:23.709337+0000","last_unstale":"2023-10-08T15:40:23.709672+0000","last_undegraded":"2023-10-08T15:40:23.709672+0000","last_fullsized":"2023-10-08T15:40:23.709672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711931+0000","last_change":"2023-10-08T15:40:23.711865+0000","last_active":"2023-10-08T15:40:23.711931+0000","last_peered":"2023-10-08T15:40:23.711931+0000","last_clean":"2023-10-08T15:40:23.711931+0000","last_became_active":"2023-10-08T15:40:23.711619+0000","last_became_peered":"2023-10-08T15:40:23.711619+0000","last_unstale":"2023-10-08T15:40:23.711931+0000","last_undegraded":"2023-10-08T15:40:23.711931+0000","last_fullsized":"2023-10-08T15:40:23.711931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.696945+0000","last_change":"2023-10-08T15:40:23.696703+0000","last_active":"2023-10-08T15:40:23.696945+0000","last_peered":"2023-10-08T15:40:23.696945+0000","last_clean":"2023-10-08T15:40:23.696945+0000","last_became_active":"2023-10-08T15:40:23.696465+0000","last_became_peered":"2023-10-08T15:40:23.696465+0000","last_unstale":"2023-10-08T15:40:23.696945+0000","last_undegraded":"2023-10-08T15:40:23.696945+0000","last_fullsized":"2023-10-08T15:40:23.696945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:21.202497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707466+0000","last_change":"2023-10-08T15:40:23.707367+0000","last_active":"2023-10-08T15:40:23.707466+0000","last_peered":"2023-10-08T15:40:23.707466+0000","last_clean":"2023-10-08T15:40:23.707466+0000","last_became_active":"2023-10-08T15:40:23.706468+0000","last_became_peered":"2023-10-08T15:40:23.706468+0000","last_unstale":"2023-10-08T15:40:23.707466+0000","last_undegraded":"2023-10-08T15:40:23.707466+0000","last_fullsized":"2023-10-08T15:40:23.707466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703465+0000","last_change":"2023-10-08T15:40:23.703030+0000","last_active":"2023-10-08T15:40:23.703465+0000","last_peered":"2023-10-08T15:40:23.703465+0000","last_clean":"2023-10-08T15:40:23.703465+0000","last_became_active":"2023-10-08T15:40:23.702048+0000","last_became_peered":"2023-10-08T15:40:23.702048+0000","last_unstale":"2023-10-08T15:40:23.703465+0000","last_undegraded":"2023-10-08T15:40:23.703465+0000","last_fullsized":"2023-10-08T15:40:23.703465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693260+0000","last_change":"2023-10-08T15:40:23.693188+0000","last_active":"2023-10-08T15:40:23.693260+0000","last_peered":"2023-10-08T15:40:23.693260+0000","last_clean":"2023-10-08T15:40:23.693260+0000","last_became_active":"2023-10-08T15:40:23.692944+0000","last_became_peered":"2023-10-08T15:40:23.692944+0000","last_unstale":"2023-10-08T15:40:23.693260+0000","last_undegraded":"2023-10-08T15:40:23.693260+0000","last_fullsized":"2023-10-08T15:40:23.693260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701609+0000","last_change":"2023-10-08T15:40:23.701502+0000","last_active":"2023-10-08T15:40:23.701609+0000","last_peered":"2023-10-08T15:40:23.701609+0000","last_clean":"2023-10-08T15:40:23.701609+0000","last_became_active":"2023-10-08T15:40:23.701163+0000","last_became_peered":"2023-10-08T15:40:23.701163+0000","last_unstale":"2023-10-08T15:40:23.701609+0000","last_undegraded":"2023-10-08T15:40:23.701609+0000","last_fullsized":"2023-10-08T15:40:23.701609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705950+0000","last_change":"2023-10-08T15:40:23.705746+0000","last_active":"2023-10-08T15:40:23.705950+0000","last_peered":"2023-10-08T15:40:23.705950+0000","last_clean":"2023-10-08T15:40:23.705950+0000","last_became_active":"2023-10-08T15:40:23.705532+0000","last_became_peered":"2023-10-08T15:40:23.705532+0000","last_unstale":"2023-10-08T15:40:23.705950+0000","last_undegraded":"2023-10-08T15:40:23.705950+0000","last_fullsized":"2023-10-08T15:40:23.705950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699729+0000","last_change":"2023-10-08T15:40:23.699584+0000","last_active":"2023-10-08T15:40:23.699729+0000","last_peered":"2023-10-08T15:40:23.699729+0000","last_clean":"2023-10-08T15:40:23.699729+0000","last_became_active":"2023-10-08T15:40:23.697371+0000","last_became_peered":"2023-10-08T15:40:23.697371+0000","last_unstale":"2023-10-08T15:40:23.699729+0000","last_undegraded":"2023-10-08T15:40:23.699729+0000","last_fullsized":"2023-10-08T15:40:23.699729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703480+0000","last_change":"2023-10-08T15:40:23.703199+0000","last_active":"2023-10-08T15:40:23.703480+0000","last_peered":"2023-10-08T15:40:23.703480+0000","last_clean":"2023-10-08T15:40:23.703480+0000","last_became_active":"2023-10-08T15:40:23.702381+0000","last_became_peered":"2023-10-08T15:40:23.702381+0000","last_unstale":"2023-10-08T15:40:23.703480+0000","last_undegraded":"2023-10-08T15:40:23.703480+0000","last_fullsized":"2023-10-08T15:40:23.703480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708427+0000","last_change":"2023-10-08T15:40:23.704911+0000","last_active":"2023-10-08T15:40:23.708427+0000","last_peered":"2023-10-08T15:40:23.708427+0000","last_clean":"2023-10-08T15:40:23.708427+0000","last_became_active":"2023-10-08T15:40:23.702946+0000","last_became_peered":"2023-10-08T15:40:23.702946+0000","last_unstale":"2023-10-08T15:40:23.708427+0000","last_undegraded":"2023-10-08T15:40:23.708427+0000","last_fullsized":"2023-10-08T15:40:23.708427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711664+0000","last_change":"2023-10-08T15:40:23.711593+0000","last_active":"2023-10-08T15:40:23.711664+0000","last_peered":"2023-10-08T15:40:23.711664+0000","last_clean":"2023-10-08T15:40:23.711664+0000","last_became_active":"2023-10-08T15:40:23.711030+0000","last_became_peered":"2023-10-08T15:40:23.711030+0000","last_unstale":"2023-10-08T15:40:23.711664+0000","last_undegraded":"2023-10-08T15:40:23.711664+0000","last_fullsized":"2023-10-08T15:40:23.711664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704150+0000","last_change":"2023-10-08T15:40:23.704080+0000","last_active":"2023-10-08T15:40:23.704150+0000","last_peered":"2023-10-08T15:40:23.704150+0000","last_clean":"2023-10-08T15:40:23.704150+0000","last_became_active":"2023-10-08T15:40:23.703850+0000","last_became_peered":"2023-10-08T15:40:23.703850+0000","last_unstale":"2023-10-08T15:40:23.704150+0000","last_undegraded":"2023-10-08T15:40:23.704150+0000","last_fullsized":"2023-10-08T15:40:23.704150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]}],"pool_statfs":[]}} 2023-10-08T15:40:32.936 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T15:40:32.937 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T15:40:32.937 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T15:40:32.937 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T15:40:32.938 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T15:40:33.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.090+0000 7f04984ff700 1 Processor -- start 2023-10-08T15:40:33.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.090+0000 7f04984ff700 1 -- start start 2023-10-08T15:40:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f04984ff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0490157870 0x7f049015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f04984ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f049015a620 0x7f049015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f04984ff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015d580 0x7f0490158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f04984ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049015cbb0 con 0x7f049015a620 2023-10-08T15:40:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f04984ff700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049015bfa0 con 0x7f0490157870 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f04984ff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049015c280 con 0x7f049015d580 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f0495a9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f049015a620 0x7f049015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f0495a9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f049015a620 0x7f049015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33502/0 (socket says 172.21.15.29:33502) 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f0495a9a700 1 -- 172.21.15.29:0/1665778438 learned_addr learned my addr 172.21.15.29:0/1665778438 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f049629b700 1 --2- 172.21.15.29:0/1665778438 >> v2:172.21.15.183:3300/0 conn(0x7f0490157870 0x7f049015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.091+0000 7f0496a9c700 1 --2- 172.21.15.29:0/1665778438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015d580 0x7f0490158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495a9a700 1 -- 172.21.15.29:0/1665778438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015d580 msgr2=0x7f0490158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495a9a700 1 --2- 172.21.15.29:0/1665778438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015d580 0x7f0490158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495a9a700 1 -- 172.21.15.29:0/1665778438 >> v2:172.21.15.183:3300/0 conn(0x7f0490157870 msgr2=0x7f049015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495a9a700 1 --2- 172.21.15.29:0/1665778438 >> v2:172.21.15.183:3300/0 conn(0x7f0490157870 0x7f049015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495a9a700 1 -- 172.21.15.29:0/1665778438 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049015c560 con 0x7f049015a620 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f049629b700 1 --2- 172.21.15.29:0/1665778438 >> v2:172.21.15.183:3300/0 conn(0x7f0490157870 0x7f049015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495a9a700 1 --2- 172.21.15.29:0/1665778438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015a620 0x7f049015d040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0490069d80 tx=0x7f0484009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d190700a7d1929fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495299700 1 -- 172.21.15.29:0/1665778438 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400b860 con 0x7f049015a620 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495299700 1 -- 172.21.15.29:0/1665778438 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048400b9c0 con 0x7f049015a620 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f0495299700 1 -- 172.21.15.29:0/1665778438 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400bd60 con 0x7f049015a620 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f04984ff700 1 -- 172.21.15.29:0/1665778438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015a620 msgr2=0x7f049015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f04984ff700 1 --2- 172.21.15.29:0/1665778438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015a620 0x7f049015d040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0490069d80 tx=0x7f0484009250 comp rx=0 tx=0).stop 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f04984ff700 1 -- 172.21.15.29:0/1665778438 shutdown_connections 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f04984ff700 1 --2- 172.21.15.29:0/1665778438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015d580 0x7f0490158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f04984ff700 1 --2- 172.21.15.29:0/1665778438 >> v2:172.21.15.183:3300/0 conn(0x7f0490157870 0x7f049015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f04984ff700 1 --2- 172.21.15.29:0/1665778438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015a620 0x7f049015d040 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f04984ff700 1 -- 172.21.15.29:0/1665778438 >> 172.21.15.29:0/1665778438 conn(0x7f0490068ce0 msgr2=0x7f04900690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:33.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.092+0000 7f04984ff700 1 -- 172.21.15.29:0/1665778438 shutdown_connections 2023-10-08T15:40:33.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.093+0000 7f04984ff700 1 -- 172.21.15.29:0/1665778438 wait complete. 2023-10-08T15:40:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f04984ff700 1 Processor -- start 2023-10-08T15:40:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f04984ff700 1 -- start start 2023-10-08T15:40:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f04984ff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0490157870 0x7f049014b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f04984ff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015a620 0x7f049014a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f04984ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015d580 0x7f04900d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f04984ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900d0370 con 0x7f049015d580 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f04984ff700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900cf760 con 0x7f0490157870 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f04984ff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900cfa40 con 0x7f049015a620 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f0496a9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015d580 0x7f04900d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f0496a9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015d580 0x7f04900d0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33506/0 (socket says 172.21.15.29:33506) 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f0496a9c700 1 -- 172.21.15.29:0/131623421 learned_addr learned my addr 172.21.15.29:0/131623421 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f049629b700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0490157870 0x7f049014b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.094+0000 7f0495a9a700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015a620 0x7f049014a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f0496a9c700 1 -- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015a620 msgr2=0x7f049014a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f0496a9c700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015a620 0x7f049014a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f0496a9c700 1 -- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0490157870 msgr2=0x7f049014b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f0496a9c700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0490157870 0x7f049014b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f0496a9c700 1 -- 172.21.15.29:0/131623421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04840094f0 con 0x7f049015d580 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f0495a9a700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015a620 0x7f049014a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f0496a9c700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015d580 0x7f04900d0c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f048800d860 tx=0x7f0488008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f048e7fc700 1 -- 172.21.15.29:0/131623421 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880125f0 con 0x7f049015d580 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f048e7fc700 1 -- 172.21.15.29:0/131623421 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488012750 con 0x7f049015d580 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04900cfd20 con 0x7f049015d580 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f048e7fc700 1 -- 172.21.15.29:0/131623421 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488012af0 con 0x7f049015d580 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.095+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049014bb20 con 0x7f049015d580 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.096+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049004c3c0 con 0x7f049015d580 2023-10-08T15:40:33.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.097+0000 7f048e7fc700 1 -- 172.21.15.29:0/131623421 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f048801e460 con 0x7f049015d580 2023-10-08T15:40:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.097+0000 7f048e7fc700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f047c066f30 0x7f047c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.097+0000 7f048e7fc700 1 -- 172.21.15.29:0/131623421 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0488084ab0 con 0x7f049015d580 2023-10-08T15:40:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.097+0000 7f049629b700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f047c066f30 0x7f047c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.098+0000 7f049629b700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f047c066f30 0x7f047c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0480007740 tx=0x7f04800099d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.101+0000 7f048e7fc700 1 -- 172.21.15.29:0/131623421 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0488051d20 con 0x7f049015d580 2023-10-08T15:40:33.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.355+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f049015c840 con 0x7f049015d580 2023-10-08T15:40:33.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.358+0000 7f048e7fc700 1 -- 172.21.15.29:0/131623421 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+163705 (secure 0 0 0) 0x7f0488055340 con 0x7f049015d580 2023-10-08T15:40:33.360 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:33.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f047c066f30 msgr2=0x7f047c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f047c066f30 0x7f047c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0480007740 tx=0x7f04800099d0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015d580 msgr2=0x7f04900d0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015d580 0x7f04900d0c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f048800d860 tx=0x7f0488008040 comp rx=0 tx=0).stop 2023-10-08T15:40:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 shutdown_connections 2023-10-08T15:40:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f047c066f30 0x7f047c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049015d580 0x7f04900d0c30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0490157870 0x7f049014b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 --2- 172.21.15.29:0/131623421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f049015a620 0x7f049014a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 >> 172.21.15.29:0/131623421 conn(0x7f0490068ce0 msgr2=0x7f04901595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 shutdown_connections 2023-10-08T15:40:33.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.360+0000 7f04984ff700 1 -- 172.21.15.29:0/131623421 wait complete. 2023-10-08T15:40:33.374 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":86000},{"type":"v1","addr":"172.21.15.183:6833","nonce":86000}]},"active_addr":"172.21.15.183:6833/86000","active_change":"2023-10-08T15:40:12.294543+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":3272057347}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":1698929607}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":670001382}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":1433598009}]}]} 2023-10-08T15:40:33.378 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T15:40:33.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T15:40:33.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:33.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.497+0000 7f1c3824c700 1 Processor -- start 2023-10-08T15:40:33.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.498+0000 7f1c3824c700 1 -- start start 2023-10-08T15:40:33.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c3824c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 0x7f1c3015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c3824c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3015cbb0 con 0x7f1c30157870 2023-10-08T15:40:33.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c3824c700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3015bfa0 con 0x7f1c3015d580 2023-10-08T15:40:33.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c3824c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3015bdb0 con 0x7f1c3015a620 2023-10-08T15:40:33.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c35fe8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1c30157870 0x7f1c3015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43226/0 (socket says 172.21.15.29:43226) 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c35fe8700 1 -- 172.21.15.29:0/3456331336 learned_addr learned my addr 172.21.15.29:0/3456331336 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c357e7700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 0x7f1c3015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816627032 0 0) 0x7f1c3015cbb0 con 0x7f1c30157870 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c18003570 con 0x7f1c30157870 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318699581 0 0) 0x7f1c3015bfa0 con 0x7f1c3015d580 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c3015cbb0 con 0x7f1c3015d580 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609877430 0 0) 0x7f1c18003570 con 0x7f1c30157870 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 msgr2=0x7f1c3015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 0x7f1c3015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 >> v1:172.21.15.183:6789/0 conn(0x7f1c3015d580 legacy=0x7f1c30158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3015c280 con 0x7f1c30157870 2023-10-08T15:40:33.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f1c200017f0 con 0x7f1c30157870 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c357e7700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 0x7f1c3015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 >> v1:172.21.15.29:6789/0 conn(0x7f1c30157870 legacy=0x7f1c3015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c18003c20 0x7f1c18004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18004810 0x7f1c18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 0x7f1c180051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800bbb0 con 0x7f1c18003c20 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800bd20 con 0x7f1c18004810 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800bee0 con 0x7f1c3015a620 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.499+0000 7f1c35fe8700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c18003c20 0x7f1c18004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c357e7700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18004810 0x7f1c18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c367e9700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 0x7f1c180051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c35fe8700 1 -- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 msgr2=0x7f1c180051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c35fe8700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 0x7f1c180051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c35fe8700 1 -- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18004810 msgr2=0x7f1c18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c35fe8700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18004810 0x7f1c18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c35fe8700 1 -- 172.21.15.29:0/3456331336 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24009420 con 0x7f1c18003c20 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c367e9700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c3015a620 0x7f1c180051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c35fe8700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c18003c20 0x7f1c18004010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000a820 tx=0x7f1c200020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1171b1a9b8c76b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200070f0 con 0x7f1c18003c20 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20007270 con 0x7f1c18003c20 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.500+0000 7f1c34fe6700 1 -- 172.21.15.29:0/3456331336 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20007630 con 0x7f1c18003c20 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.501+0000 7f1c3824c700 1 -- 172.21.15.29:0/3456331336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c18003c20 msgr2=0x7f1c18004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.501+0000 7f1c3824c700 1 --2- 172.21.15.29:0/3456331336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c18003c20 0x7f1c18004010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000a820 tx=0x7f1c200020c0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.501+0000 7f1c367e9700 1 -- 172.21.15.29:0/3456331336 reap_dead start 2023-10-08T15:40:33.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.501+0000 7f1c3824c700 1 -- 172.21.15.29:0/3456331336 shutdown_connections 2023-10-08T15:40:33.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.501+0000 7f1c3824c700 1 -- 172.21.15.29:0/3456331336 >> 172.21.15.29:0/3456331336 conn(0x7f1c30068ce0 msgr2=0x7f1c300690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:33.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.501+0000 7f1c3824c700 1 -- 172.21.15.29:0/3456331336 shutdown_connections 2023-10-08T15:40:33.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.501+0000 7f1c3824c700 1 -- 172.21.15.29:0/3456331336 wait complete. 2023-10-08T15:40:33.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.502+0000 7f1c3824c700 1 Processor -- start 2023-10-08T15:40:33.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.502+0000 7f1c3824c700 1 -- start start 2023-10-08T15:40:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.502+0000 7f1c3824c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18003c20 0x7f1c300b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.502+0000 7f1c3824c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c30151930 0x7f1c300b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.502+0000 7f1c3824c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c300b0b50 0x7f1c3014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.502+0000 7f1c3824c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300b0ff0 con 0x7f1c300b0b50 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.502+0000 7f1c3824c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3016e110 con 0x7f1c18003c20 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.502+0000 7f1c3824c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300b1a70 con 0x7f1c30151930 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c300b0b50 0x7f1c3014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c300b0b50 0x7f1c3014b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33520/0 (socket says 172.21.15.29:33520) 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 -- 172.21.15.29:0/3615945394 learned_addr learned my addr 172.21.15.29:0/3615945394 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c35fe8700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18003c20 0x7f1c300b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c357e7700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c30151930 0x7f1c300b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 -- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c30151930 msgr2=0x7f1c300b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c30151930 0x7f1c300b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 -- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18003c20 msgr2=0x7f1c300b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18003c20 0x7f1c300b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 -- 172.21.15.29:0/3615945394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300b11d0 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c367e9700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c300b0b50 0x7f1c3014b3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c3006b4b0 tx=0x7f1c28009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c2dffb700 1 -- 172.21.15.29:0/3615945394 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28018070 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c2dffb700 1 -- 172.21.15.29:0/3615945394 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2800ee50 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c2dffb700 1 -- 172.21.15.29:0/3615945394 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28006a90 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.503+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c300b14b0 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.504+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c300b2090 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.504+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c300b2220 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.505+0000 7f1c2dffb700 1 -- 172.21.15.29:0/3615945394 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c28007030 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.505+0000 7f1c2dffb700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c1c066f30 0x7f1c1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.505+0000 7f1c2dffb700 1 -- 172.21.15.29:0/3615945394 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c28083f80 con 0x7f1c300b0b50 2023-10-08T15:40:33.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.505+0000 7f1c35fe8700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c1c066f30 0x7f1c1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.506+0000 7f1c35fe8700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c1c066f30 0x7f1c1c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000a820 tx=0x7f1c20016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.510+0000 7f1c2dffb700 1 -- 172.21.15.29:0/3615945394 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c280511f0 con 0x7f1c300b0b50 2023-10-08T15:40:33.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.703+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c3004c3c0 con 0x7f1c300b0b50 2023-10-08T15:40:33.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.704+0000 7f1c2dffb700 1 -- 172.21.15.29:0/3615945394 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f1c28054810 con 0x7f1c300b0b50 2023-10-08T15:40:33.705 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:33.705 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:33.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c1c066f30 msgr2=0x7f1c1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c1c066f30 0x7f1c1c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000a820 tx=0x7f1c20016000 comp rx=0 tx=0).stop 2023-10-08T15:40:33.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c300b0b50 msgr2=0x7f1c3014b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c300b0b50 0x7f1c3014b3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c3006b4b0 tx=0x7f1c28009040 comp rx=0 tx=0).stop 2023-10-08T15:40:33.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 shutdown_connections 2023-10-08T15:40:33.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c1c066f30 0x7f1c1c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c300b0b50 0x7f1c3014b3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c18003c20 0x7f1c300b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 --2- 172.21.15.29:0/3615945394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c30151930 0x7f1c300b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 >> 172.21.15.29:0/3615945394 conn(0x7f1c30068ce0 msgr2=0x7f1c3015e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:33.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 shutdown_connections 2023-10-08T15:40:33.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.706+0000 7f1c3824c700 1 -- 172.21.15.29:0/3615945394 wait complete. 2023-10-08T15:40:33.719 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T15:40:33.719 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:33.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.838+0000 7f7632a0a700 1 Processor -- start 2023-10-08T15:40:33.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.838+0000 7f7632a0a700 1 -- start start 2023-10-08T15:40:33.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.838+0000 7f7632a0a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c157870 0x7f762c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.838+0000 7f7632a0a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f762c15a620 0x7f762c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.838+0000 7f7632a0a700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c15cbb0 con 0x7f762c15d580 2023-10-08T15:40:33.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.838+0000 7f7632a0a700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c15bfa0 con 0x7f762c15a620 2023-10-08T15:40:33.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.838+0000 7f7632a0a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c15c280 con 0x7f762c157870 2023-10-08T15:40:33.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762b7fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f762c15a620 0x7f762c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762bfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c157870 0x7f762c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f7630fa7700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f762c15d580 0x7f762c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54256/0 (socket says 172.21.15.29:54256) 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f7630fa7700 1 -- 172.21.15.29:0/3813827451 learned_addr learned my addr 172.21.15.29:0/3813827451 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762affd700 1 -- 172.21.15.29:0/3813827451 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176469709 0 0) 0x7f762c15cbb0 con 0x7f762c15d580 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762affd700 1 -- 172.21.15.29:0/3813827451 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7618003570 con 0x7f762c15d580 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762bfff700 1 -- 172.21.15.29:0/3813827451 >> v2:172.21.15.183:3300/0 conn(0x7f762c15a620 msgr2=0x7f762c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762bfff700 1 --2- 172.21.15.29:0/3813827451 >> v2:172.21.15.183:3300/0 conn(0x7f762c15a620 0x7f762c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762bfff700 1 -- 172.21.15.29:0/3813827451 >> v1:172.21.15.183:6789/0 conn(0x7f762c15d580 legacy=0x7f762c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762bfff700 1 -- 172.21.15.29:0/3813827451 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c15c560 con 0x7f762c157870 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762b7fe700 1 --2- 172.21.15.29:0/3813827451 >> v2:172.21.15.183:3300/0 conn(0x7f762c15a620 0x7f762c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.839+0000 7f762bfff700 1 --2- 172.21.15.29:0/3813827451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c157870 0x7f762c15b6a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f761c0098e0 tx=0x7f761c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f31c7b29dceb96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f762affd700 1 -- 172.21.15.29:0/3813827451 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c011630 con 0x7f762c157870 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f762affd700 1 -- 172.21.15.29:0/3813827451 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c011790 con 0x7f762c157870 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f762affd700 1 -- 172.21.15.29:0/3813827451 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c011b30 con 0x7f762c157870 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f7632a0a700 1 -- 172.21.15.29:0/3813827451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c157870 msgr2=0x7f762c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3813827451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c157870 0x7f762c15b6a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f761c0098e0 tx=0x7f761c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f7632a0a700 1 -- 172.21.15.29:0/3813827451 shutdown_connections 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3813827451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c157870 0x7f762c15b6a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3813827451 >> v2:172.21.15.183:3300/0 conn(0x7f762c15a620 0x7f762c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f7632a0a700 1 -- 172.21.15.29:0/3813827451 >> 172.21.15.29:0/3813827451 conn(0x7f762c068ce0 msgr2=0x7f762c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f7632a0a700 1 -- 172.21.15.29:0/3813827451 shutdown_connections 2023-10-08T15:40:33.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.840+0000 7f7632a0a700 1 -- 172.21.15.29:0/3813827451 wait complete. 2023-10-08T15:40:33.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.841+0000 7f7632a0a700 1 Processor -- start 2023-10-08T15:40:33.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.841+0000 7f7632a0a700 1 -- start start 2023-10-08T15:40:33.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f7632a0a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f762c157870 0x7f762c143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f7632a0a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c15a620 0x7f762c0b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f7632a0a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f762c15d580 0x7f762c0b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f7632a0a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c143ea0 con 0x7f762c157870 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f7632a0a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0cf2b0 con 0x7f762c15d580 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f7632a0a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0cfe30 con 0x7f762c15a620 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f762bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f762c157870 0x7f762c143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f762bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f762c157870 0x7f762c143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33526/0 (socket says 172.21.15.29:33526) 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.842+0000 7f762bfff700 1 -- 172.21.15.29:0/3246328223 learned_addr learned my addr 172.21.15.29:0/3246328223 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f762b7fe700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c15a620 0x7f762c0b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f7630fa7700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f762c15d580 0x7f762c0b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f762bfff700 1 -- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c15a620 msgr2=0x7f762c0b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f762bfff700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c15a620 0x7f762c0b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f762bfff700 1 -- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f762c15d580 msgr2=0x7f762c0b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f762bfff700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f762c15d580 0x7f762c0b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f762bfff700 1 -- 172.21.15.29:0/3246328223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614009420 con 0x7f762c157870 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f762bfff700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f762c157870 0x7f762c143960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f761c009ed0 tx=0x7f761c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f7623fff700 1 -- 172.21.15.29:0/3246328223 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c011b10 con 0x7f762c157870 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f7623fff700 1 -- 172.21.15.29:0/3246328223 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c0253f0 con 0x7f762c157870 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c009420 con 0x7f762c157870 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f7623fff700 1 -- 172.21.15.29:0/3246328223 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c025790 con 0x7f762c157870 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.843+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c0cf7e0 con 0x7f762c157870 2023-10-08T15:40:33.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.844+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c1570d0 con 0x7f762c157870 2023-10-08T15:40:33.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.844+0000 7f7623fff700 1 -- 172.21.15.29:0/3246328223 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f761c025b40 con 0x7f762c157870 2023-10-08T15:40:33.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.845+0000 7f7623fff700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f760c066f30 0x7f760c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:33.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.845+0000 7f7623fff700 1 -- 172.21.15.29:0/3246328223 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f761c085d50 con 0x7f762c157870 2023-10-08T15:40:33.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.845+0000 7f762b7fe700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f760c066f30 0x7f760c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:33.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.845+0000 7f762b7fe700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f760c066f30 0x7f760c0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f762c0b2cb0 tx=0x7f7614008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:33.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:33.849+0000 7f7623fff700 1 -- 172.21.15.29:0/3246328223 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f761c089030 con 0x7f762c157870 2023-10-08T15:40:34.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.042+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f762c14ce40 con 0x7f762c157870 2023-10-08T15:40:34.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.043+0000 7f7623fff700 1 -- 172.21.15.29:0/3246328223 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f761c052fc0 con 0x7f762c157870 2023-10-08T15:40:34.043 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:34.043 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f760c066f30 msgr2=0x7f760c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f760c066f30 0x7f760c0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f762c0b2cb0 tx=0x7f7614008040 comp rx=0 tx=0).stop 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f762c157870 msgr2=0x7f762c143960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f762c157870 0x7f762c143960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f761c009ed0 tx=0x7f761c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 shutdown_connections 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f760c066f30 0x7f760c0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f762c15d580 0x7f762c0b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f762c157870 0x7f762c143960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 --2- 172.21.15.29:0/3246328223 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f762c15a620 0x7f762c0b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 >> 172.21.15.29:0/3246328223 conn(0x7f762c068ce0 msgr2=0x7f762c15aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 shutdown_connections 2023-10-08T15:40:34.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.045+0000 7f7632a0a700 1 -- 172.21.15.29:0/3246328223 wait complete. 2023-10-08T15:40:34.058 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T15:40:34.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T15:40:34.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T15:40:34.060 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T15:40:34.060 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T15:40:34.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T15:40:34.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T15:40:34.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T15:40:34.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.261+0000 7f3a5d04d700 1 Processor -- start 2023-10-08T15:40:34.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.262+0000 7f3a5d04d700 1 -- start start 2023-10-08T15:40:34.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5d04d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a5815e1d0 0x7f3a58161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5d04d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a580a7da0 0x7f3a58162430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5d04d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a5815e5a0 0x7f3a58162970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5d04d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580b2bf0 con 0x7f3a5815e1d0 2023-10-08T15:40:34.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5d04d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580b0420 con 0x7f3a5815e5a0 2023-10-08T15:40:34.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5d04d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580b0140 con 0x7f3a580a7da0 2023-10-08T15:40:34.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5759e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a5815e5a0 0x7f3a58162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5759e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a5815e5a0 0x7f3a58162970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56398/0 (socket says 172.21.15.29:56398) 2023-10-08T15:40:34.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5759e700 1 -- 172.21.15.29:0/4131151482 learned_addr learned my addr 172.21.15.29:0/4131151482 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.263+0000 7f3a5659c700 1 --2- 172.21.15.29:0/4131151482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a580a7da0 0x7f3a58162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.264+0000 7f3a5759e700 1 -- 172.21.15.29:0/4131151482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a580a7da0 msgr2=0x7f3a58162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.264+0000 7f3a5759e700 1 --2- 172.21.15.29:0/4131151482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a580a7da0 0x7f3a58162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.264+0000 7f3a5759e700 1 -- 172.21.15.29:0/4131151482 >> v2:172.21.15.29:3300/0 conn(0x7f3a5815e1d0 msgr2=0x7f3a58161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.264+0000 7f3a5759e700 1 --2- 172.21.15.29:0/4131151482 >> v2:172.21.15.29:3300/0 conn(0x7f3a5815e1d0 0x7f3a58161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.264+0000 7f3a5759e700 1 -- 172.21.15.29:0/4131151482 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580b2530 con 0x7f3a5815e5a0 2023-10-08T15:40:34.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.267+0000 7f3a5759e700 1 --2- 172.21.15.29:0/4131151482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5815e5a0 0x7f3a58162970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a58063da0 tx=0x7f3a50009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc6954ecdd20bdd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.268+0000 7fcb0dd25700 1 Processor -- start 2023-10-08T15:40:34.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.268+0000 7f6fd1632700 1 Processor -- start 2023-10-08T15:40:34.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.268+0000 7fcb0dd25700 1 -- start start 2023-10-08T15:40:34.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb0dd25700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb08156a50 0x7fcb080c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb0dd25700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcb08156e20 0x7fcb08067b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb0dd25700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb080c87d0 con 0x7fcb080c91a0 2023-10-08T15:40:34.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb0dd25700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb08068d10 con 0x7fcb08156a50 2023-10-08T15:40:34.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb0dd25700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0806e650 con 0x7fcb08156e20 2023-10-08T15:40:34.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb07fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcb080c91a0 0x7fcb080adab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43234/0 (socket says 172.21.15.29:43234) 2023-10-08T15:40:34.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb07fff700 1 -- 172.21.15.29:0/3794136472 learned_addr learned my addr 172.21.15.29:0/3794136472 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb06ffd700 1 --2- 172.21.15.29:0/3794136472 >> v2:172.21.15.183:3300/0 conn(0x7fcb08156e20 0x7fcb08067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fe2b1170700 1 Processor -- start 2023-10-08T15:40:34.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fe2b1170700 1 -- start start 2023-10-08T15:40:34.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb06ffd700 1 -- 172.21.15.29:0/3794136472 >> v2:172.21.15.29:3300/0 conn(0x7fcb08156a50 msgr2=0x7fcb080c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb06ffd700 1 --2- 172.21.15.29:0/3794136472 >> v2:172.21.15.29:3300/0 conn(0x7fcb08156a50 0x7fcb080c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb06ffd700 1 -- 172.21.15.29:0/3794136472 >> v1:172.21.15.29:6789/0 conn(0x7fcb080c91a0 legacy=0x7fcb080adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7fcb06ffd700 1 -- 172.21.15.29:0/3794136472 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08068750 con 0x7fcb08156e20 2023-10-08T15:40:34.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.268+0000 7f6fd1632700 1 -- start start 2023-10-08T15:40:34.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7f6fd1632700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6fcc15e2b0 0x7f6fcc0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7f6fd1632700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6fcc0b2e00 0x7f6fcc162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7f6fd1632700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0af3f0 con 0x7f6fcc15e680 2023-10-08T15:40:34.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7f6fd1632700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0af6d0 con 0x7f6fcc0b2e00 2023-10-08T15:40:34.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.269+0000 7f6fd1632700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0af9b0 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fca7fc700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6fcc15e680 0x7f6fcc161f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54262/0 (socket says 172.21.15.29:54262) 2023-10-08T15:40:34.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fca7fc700 1 -- 172.21.15.29:0/734569036 learned_addr learned my addr 172.21.15.29:0/734569036 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fcaffd700 1 --2- 172.21.15.29:0/734569036 >> v2:172.21.15.183:3300/0 conn(0x7f6fcc15e2b0 0x7f6fcc0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fcb7fe700 1 --2- 172.21.15.29:0/734569036 >> v2:172.21.15.29:3300/0 conn(0x7f6fcc0b2e00 0x7f6fcc162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fc9ffb700 1 -- 172.21.15.29:0/734569036 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463761829 0 0) 0x7f6fcc0af3f0 con 0x7f6fcc15e680 2023-10-08T15:40:34.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fc9ffb700 1 -- 172.21.15.29:0/734569036 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb4003570 con 0x7f6fcc15e680 2023-10-08T15:40:34.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7fe2b1170700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe2ac1577d0 0x7fe2ac0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7fe2b1170700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe2ac06ac30 0x7fe2ac15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7fe2b1170700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac15c360 con 0x7fe2ac157ba0 2023-10-08T15:40:34.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7fe2b1170700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac15b790 con 0x7fe2ac06ac30 2023-10-08T15:40:34.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7fe2b1170700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac15ba30 con 0x7fe2ac1577d0 2023-10-08T15:40:34.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fcaffd700 1 -- 172.21.15.29:0/734569036 >> v2:172.21.15.29:3300/0 conn(0x7f6fcc0b2e00 msgr2=0x7f6fcc162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fcaffd700 1 --2- 172.21.15.29:0/734569036 >> v2:172.21.15.29:3300/0 conn(0x7f6fcc0b2e00 0x7f6fcc162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fcaffd700 1 -- 172.21.15.29:0/734569036 >> v1:172.21.15.183:6789/0 conn(0x7f6fcc15e680 legacy=0x7f6fcc161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7f6fcaffd700 1 -- 172.21.15.29:0/734569036 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0b2600 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7fe2ab59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe2ac06ac30 0x7fe2ac15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7fe2aa59c700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fe2ac157ba0 0x7fe2ac06a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54266/0 (socket says 172.21.15.29:54266) 2023-10-08T15:40:34.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.270+0000 7fe2aa59c700 1 -- 172.21.15.29:0/755000789 learned_addr learned my addr 172.21.15.29:0/755000789 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe71656f700 1 Processor -- start 2023-10-08T15:40:34.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe71656f700 1 -- start start 2023-10-08T15:40:34.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe2ab59e700 1 -- 172.21.15.29:0/755000789 >> v2:172.21.15.183:3300/0 conn(0x7fe2ac1577d0 msgr2=0x7fe2ac0cd770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T15:40:34.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe2ab59e700 1 --2- 172.21.15.29:0/755000789 >> v2:172.21.15.183:3300/0 conn(0x7fe2ac1577d0 0x7fe2ac0cd770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe2ab59e700 1 -- 172.21.15.29:0/755000789 >> v1:172.21.15.183:6789/0 conn(0x7fe2ac157ba0 legacy=0x7fe2ac06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe2ab59e700 1 -- 172.21.15.29:0/755000789 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac15bd10 con 0x7fe2ac06ac30 2023-10-08T15:40:34.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7f3a55d9b700 1 -- 172.21.15.29:0/4131151482 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000e070 con 0x7f3a5815e5a0 2023-10-08T15:40:34.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7f6fcaffd700 1 --2- 172.21.15.29:0/734569036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fcc15e2b0 0x7f6fcc0affa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc069480 tx=0x7f6fbc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d26f8a5de92a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7f3a55d9b700 1 -- 172.21.15.29:0/4131151482 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5000ba20 con 0x7f3a5815e5a0 2023-10-08T15:40:34.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7f3a55d9b700 1 -- 172.21.15.29:0/4131151482 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500092e0 con 0x7f3a5815e5a0 2023-10-08T15:40:34.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7f6fc9ffb700 1 -- 172.21.15.29:0/734569036 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc011630 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe2ab59e700 1 --2- 172.21.15.29:0/755000789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2ac06ac30 0x7fe2ac15c7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0b6dc0 tx=0x7fe2a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc23f62c4961c322 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe2a9d9b700 1 -- 172.21.15.29:0/755000789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400e070 con 0x7fe2ac06ac30 2023-10-08T15:40:34.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7f6fc9ffb700 1 -- 172.21.15.29:0/734569036 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc0117b0 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7f6fc9ffb700 1 -- 172.21.15.29:0/734569036 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc011b70 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fcb06ffd700 1 --2- 172.21.15.29:0/3794136472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb08156e20 0x7fcb08067b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb08067ac0 tx=0x7fcaf800b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33da5a0b3932a250 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe2a9d9b700 1 -- 172.21.15.29:0/755000789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a400bc30 con 0x7fe2ac06ac30 2023-10-08T15:40:34.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.271+0000 7fe2a9d9b700 1 -- 172.21.15.29:0/755000789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4012430 con 0x7fe2ac06ac30 2023-10-08T15:40:34.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fcb067fc700 1 -- 172.21.15.29:0/3794136472 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800db70 con 0x7fcb08156e20 2023-10-08T15:40:34.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fcb067fc700 1 -- 172.21.15.29:0/3794136472 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800dcd0 con 0x7fcb08156e20 2023-10-08T15:40:34.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fcb067fc700 1 -- 172.21.15.29:0/3794136472 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80196b0 con 0x7fcb08156e20 2023-10-08T15:40:34.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f245aaaa700 1 Processor -- start 2023-10-08T15:40:34.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f6fd1632700 1 -- 172.21.15.29:0/734569036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fcc15e2b0 msgr2=0x7f6fcc0affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f6fd1632700 1 --2- 172.21.15.29:0/734569036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fcc15e2b0 0x7f6fcc0affa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc069480 tx=0x7f6fbc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f3a5d04d700 1 -- 172.21.15.29:0/4131151482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5815e5a0 msgr2=0x7f3a58162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f3a5d04d700 1 --2- 172.21.15.29:0/4131151482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5815e5a0 0x7f3a58162970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a58063da0 tx=0x7f3a50009840 comp rx=0 tx=0).stop 2023-10-08T15:40:34.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f245aaaa700 1 -- start start 2023-10-08T15:40:34.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe2b1170700 1 -- 172.21.15.29:0/755000789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2ac06ac30 msgr2=0x7fe2ac15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe2b1170700 1 --2- 172.21.15.29:0/755000789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2ac06ac30 0x7fe2ac15c7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0b6dc0 tx=0x7fe2a4009780 comp rx=0 tx=0).stop 2023-10-08T15:40:34.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe71656f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7100ccf10 0x7fe7100c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe71656f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe71006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe71656f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100ab5c0 con 0x7fe71015e9b0 2023-10-08T15:40:34.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe71656f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7100aa9b0 con 0x7fe7100ccf10 2023-10-08T15:40:34.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe71656f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100aac90 con 0x7fe71006f1c0 2023-10-08T15:40:34.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f3a5d04d700 1 -- 172.21.15.29:0/4131151482 shutdown_connections 2023-10-08T15:40:34.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f3a5d04d700 1 --2- 172.21.15.29:0/4131151482 >> v2:172.21.15.29:3300/0 conn(0x7f3a5815e1d0 0x7f3a58161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f3a5d04d700 1 --2- 172.21.15.29:0/4131151482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5815e5a0 0x7f3a58162970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f3a5d04d700 1 --2- 172.21.15.29:0/4131151482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a580a7da0 0x7f3a58162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7f3a5d04d700 1 -- 172.21.15.29:0/4131151482 >> 172.21.15.29:0/4131151482 conn(0x7f3a580cd1e0 msgr2=0x7f3a580cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe714b0c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe71006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe714b0c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe71006d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:45870/0 (socket says 172.21.15.29:45870) 2023-10-08T15:40:34.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.272+0000 7fe714b0c700 1 -- 172.21.15.29:0/63407891 learned_addr learned my addr 172.21.15.29:0/63407891 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe70ffff700 1 --2- 172.21.15.29:0/63407891 >> v2:172.21.15.29:3300/0 conn(0x7fe7100ccf10 0x7fe7100c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f3a5d04d700 1 -- 172.21.15.29:0/4131151482 shutdown_connections 2023-10-08T15:40:34.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f3a5d04d700 1 -- 172.21.15.29:0/4131151482 wait complete. 2023-10-08T15:40:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe2b1170700 1 -- 172.21.15.29:0/755000789 shutdown_connections 2023-10-08T15:40:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe2b1170700 1 --2- 172.21.15.29:0/755000789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2ac06ac30 0x7fe2ac15c7f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe2b1170700 1 --2- 172.21.15.29:0/755000789 >> v2:172.21.15.183:3300/0 conn(0x7fe2ac1577d0 0x7fe2ac0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe2b1170700 1 -- 172.21.15.29:0/755000789 >> 172.21.15.29:0/755000789 conn(0x7fe2ac068ce0 msgr2=0x7fe2ac0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe714b0c700 1 -- 172.21.15.29:0/63407891 >> v2:172.21.15.29:3300/0 conn(0x7fe7100ccf10 msgr2=0x7fe7100c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe714b0c700 1 --2- 172.21.15.29:0/63407891 >> v2:172.21.15.29:3300/0 conn(0x7fe7100ccf10 0x7fe7100c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe714b0c700 1 -- 172.21.15.29:0/63407891 >> v1:172.21.15.29:6789/0 conn(0x7fe71015e9b0 legacy=0x7fe71006eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe714b0c700 1 -- 172.21.15.29:0/63407891 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100aaf70 con 0x7fe71006f1c0 2023-10-08T15:40:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f6fd1632700 1 -- 172.21.15.29:0/734569036 shutdown_connections 2023-10-08T15:40:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f6fd1632700 1 --2- 172.21.15.29:0/734569036 >> v2:172.21.15.29:3300/0 conn(0x7f6fcc0b2e00 0x7f6fcc162670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f6fd1632700 1 --2- 172.21.15.29:0/734569036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fcc15e2b0 0x7f6fcc0affa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f6fd1632700 1 -- 172.21.15.29:0/734569036 >> 172.21.15.29:0/734569036 conn(0x7f6fcc0cd1e0 msgr2=0x7f6fcc0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fcb0dd25700 1 -- 172.21.15.29:0/3794136472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb08156e20 msgr2=0x7fcb08067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fcb0dd25700 1 --2- 172.21.15.29:0/3794136472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb08156e20 0x7fcb08067b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb08067ac0 tx=0x7fcaf800b430 comp rx=0 tx=0).stop 2023-10-08T15:40:34.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fcb0dd25700 1 -- 172.21.15.29:0/3794136472 shutdown_connections 2023-10-08T15:40:34.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fcb0dd25700 1 --2- 172.21.15.29:0/3794136472 >> v2:172.21.15.29:3300/0 conn(0x7fcb08156a50 0x7fcb080c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fcb0dd25700 1 --2- 172.21.15.29:0/3794136472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb08156e20 0x7fcb08067b70 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb08067ac0 tx=0x7fcaf800b430 comp rx=0 tx=0).stop 2023-10-08T15:40:34.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fcb0dd25700 1 -- 172.21.15.29:0/3794136472 >> 172.21.15.29:0/3794136472 conn(0x7fcb0806a250 msgr2=0x7fcb0806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f6fd1632700 1 -- 172.21.15.29:0/734569036 shutdown_connections 2023-10-08T15:40:34.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f6fd1632700 1 -- 172.21.15.29:0/734569036 wait complete. 2023-10-08T15:40:34.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe2b1170700 1 -- 172.21.15.29:0/755000789 shutdown_connections 2023-10-08T15:40:34.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe714b0c700 1 --2- 172.21.15.29:0/63407891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe71006d3b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe7040099b0 tx=0x7fe704009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c138797dc3494c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f245aaaa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2454159e10 0x7f24540b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f245aaaa700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245415db80 con 0x7f245415a1e0 2023-10-08T15:40:34.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f245aaaa700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245415de60 con 0x7f24540cde50 2023-10-08T15:40:34.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f245aaaa700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245415e800 con 0x7f2454159e10 2023-10-08T15:40:34.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7f474ffff700 1 Processor -- start 2023-10-08T15:40:34.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fcb0dd25700 1 -- 172.21.15.29:0/3794136472 shutdown_connections 2023-10-08T15:40:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7fe70effd700 1 -- 172.21.15.29:0/63407891 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704009ea0 con 0x7fe71006f1c0 2023-10-08T15:40:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f2459047700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f24540cde50 0x7f24540cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54268/0 (socket says 172.21.15.29:54268) 2023-10-08T15:40:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f2459047700 1 -- 172.21.15.29:0/260240558 learned_addr learned my addr 172.21.15.29:0/260240558 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f2458846700 1 --2- 172.21.15.29:0/260240558 >> v2:172.21.15.29:3300/0 conn(0x7f2454159e10 0x7f24540b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f24537fe700 1 -- 172.21.15.29:0/260240558 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460813052 0 0) 0x7f245415de60 con 0x7f24540cde50 2023-10-08T15:40:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f24537fe700 1 -- 172.21.15.29:0/260240558 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f243c003570 con 0x7f24540cde50 2023-10-08T15:40:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.273+0000 7fe2b1170700 1 -- 172.21.15.29:0/755000789 wait complete. 2023-10-08T15:40:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7f3a5d04d700 1 Processor -- start 2023-10-08T15:40:34.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7f6fd1632700 1 Processor -- start 2023-10-08T15:40:34.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7fcb0dd25700 1 -- 172.21.15.29:0/3794136472 wait complete. 2023-10-08T15:40:34.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7fcb0dd25700 1 Processor -- start 2023-10-08T15:40:34.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7fcb0dd25700 1 -- start start 2023-10-08T15:40:34.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7f6fd1632700 1 -- start start 2023-10-08T15:40:34.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7fe70effd700 1 -- 172.21.15.29:0/63407891 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400b860 con 0x7fe71006f1c0 2023-10-08T15:40:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7fe70effd700 1 -- 172.21.15.29:0/63407891 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400bc00 con 0x7fe71006f1c0 2023-10-08T15:40:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7fe2b1170700 1 Processor -- start 2023-10-08T15:40:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7fe2b1170700 1 -- start start 2023-10-08T15:40:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f2458846700 1 -- 172.21.15.29:0/260240558 >> v1:172.21.15.183:6789/0 conn(0x7f24540cde50 legacy=0x7f24540cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f2458846700 1 -- 172.21.15.29:0/260240558 >> v1:172.21.15.29:6789/0 conn(0x7f245415a1e0 legacy=0x7f24540cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f2458846700 1 -- 172.21.15.29:0/260240558 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245415e140 con 0x7f2454159e10 2023-10-08T15:40:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7f2458846700 1 --2- 172.21.15.29:0/260240558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2454159e10 0x7f24540b2d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24480098e0 tx=0x7f24480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c41f7d54d49c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7f24537fe700 1 -- 172.21.15.29:0/260240558 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800b640 con 0x7f2454159e10 2023-10-08T15:40:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7f24537fe700 1 -- 172.21.15.29:0/260240558 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244800b7a0 con 0x7f2454159e10 2023-10-08T15:40:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f24537fe700 1 -- 172.21.15.29:0/260240558 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800bb40 con 0x7f2454159e10 2023-10-08T15:40:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.274+0000 7f474ffff700 1 -- start start 2023-10-08T15:40:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f474ffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4748053e30 0x7f47480de1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f474ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f47480338f0 0x7f4748033d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f474ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4748006290 con 0x7f47480dde20 2023-10-08T15:40:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f474ffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4748054c90 con 0x7f47480338f0 2023-10-08T15:40:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f474ffff700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4748034d90 con 0x7f4748053e30 2023-10-08T15:40:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f474effd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f47480dde20 0x7f4748050340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43268/0 (socket says 172.21.15.29:43268) 2023-10-08T15:40:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f474effd700 1 -- 172.21.15.29:0/3120508220 learned_addr learned my addr 172.21.15.29:0/3120508220 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f6fd1632700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6fcc0b2e00 0x7f6fcc09a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f6fd1632700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fcc15e2b0 0x7f6fcc098fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f6fd1632700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fcc15e680 0x7f6fcc1617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f6fd1632700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc098810 con 0x7f6fcc0b2e00 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fd1632700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc09a2d0 con 0x7f6fcc15e680 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fd1632700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc161ce0 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.275+0000 7f3a5d04d700 1 -- start start 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5d04d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a580a7da0 0x7f3a5815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5d04d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5815e1d0 0x7f3a580aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5d04d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a5815e5a0 0x7f3a5813d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5d04d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815c390 con 0x7f3a5815e1d0 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5d04d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815b7c0 con 0x7f3a580a7da0 2023-10-08T15:40:34.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5d04d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815ba60 con 0x7f3a5815e5a0 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5815e1d0 0x7f3a580aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5815e1d0 0x7f3a580aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33598/0 (socket says 172.21.15.29:33598) 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5659c700 1 -- 172.21.15.29:0/2800021799 learned_addr learned my addr 172.21.15.29:0/2800021799 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a5759e700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a5815e5a0 0x7f3a5813d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7f3a56d9d700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a580a7da0 0x7f3a5815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a5759e700 1 -- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a580a7da0 msgr2=0x7f3a5815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a5759e700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a580a7da0 0x7f3a5815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a5759e700 1 -- 172.21.15.29:0/2800021799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5815e1d0 msgr2=0x7f3a580aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a5759e700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a5815e1d0 0x7f3a580aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a5759e700 1 -- 172.21.15.29:0/2800021799 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50009ae0 con 0x7f3a5815e5a0 2023-10-08T15:40:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7fe71656f700 1 -- 172.21.15.29:0/63407891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 msgr2=0x7fe71006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.276+0000 7fe71656f700 1 --2- 172.21.15.29:0/63407891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe71006d3b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe7040099b0 tx=0x7fe704009250 comp rx=0 tx=0).stop 2023-10-08T15:40:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fca7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fcc15e2b0 0x7f6fcc098fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fcaffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6fcc0b2e00 0x7f6fcc09a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fca7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fcc15e2b0 0x7f6fcc098fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:45886/0 (socket says 172.21.15.29:45886) 2023-10-08T15:40:34.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fca7fc700 1 -- 172.21.15.29:0/785269585 learned_addr learned my addr 172.21.15.29:0/785269585 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb0dd25700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb080c91a0 0x7fcb080b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb0dd25700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb08156a50 0x7fcb0816d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb0dd25700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb080c6d80 0x7fcb080c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb0dd25700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080aae70 con 0x7fcb08156a50 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb0dd25700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080abcd0 con 0x7fcb080c6d80 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb0dd25700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080ab0c0 con 0x7fcb080c91a0 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb06ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb08156a50 0x7fcb0816d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb06ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb08156a50 0x7fcb0816d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33624/0 (socket says 172.21.15.29:33624) 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb06ffd700 1 -- 172.21.15.29:0/714347742 learned_addr learned my addr 172.21.15.29:0/714347742 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb07fff700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb080c6d80 0x7fcb080c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fcb7fe700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fcc15e680 0x7f6fcc1617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb077fe700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb080c91a0 0x7fcb080b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a5759e700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a5815e5a0 0x7f3a5813d570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a50015000 tx=0x7f3a50018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f245aaaa700 1 -- 172.21.15.29:0/260240558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2454159e10 msgr2=0x7f24540b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f245aaaa700 1 --2- 172.21.15.29:0/260240558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2454159e10 0x7f24540b2d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24480098e0 tx=0x7f24480091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f474e7fc700 1 --2- 172.21.15.29:0/3120508220 >> v2:172.21.15.183:3300/0 conn(0x7f4748053e30 0x7f47480de1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a3effd700 1 -- 172.21.15.29:0/2800021799 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50008d20 con 0x7f3a5815e5a0 2023-10-08T15:40:34.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a3effd700 1 -- 172.21.15.29:0/2800021799 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a50008e80 con 0x7f3a5815e5a0 2023-10-08T15:40:34.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f3a3effd700 1 -- 172.21.15.29:0/2800021799 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5003e670 con 0x7f3a5815e5a0 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb07fff700 1 -- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb080c91a0 msgr2=0x7fcb080b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb07fff700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb080c91a0 0x7fcb080b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb07fff700 1 -- 172.21.15.29:0/714347742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb08156a50 msgr2=0x7fcb0816d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb07fff700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb08156a50 0x7fcb0816d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fca7fc700 1 -- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fcc15e680 msgr2=0x7f6fcc1617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fca7fc700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6fcc15e680 0x7f6fcc1617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fca7fc700 1 -- 172.21.15.29:0/785269585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6fcc0b2e00 msgr2=0x7f6fcc09a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fca7fc700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6fcc0b2e00 0x7f6fcc09a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f6fca7fc700 1 -- 172.21.15.29:0/785269585 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc009420 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fcb07fff700 1 -- 172.21.15.29:0/714347742 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf800b6d0 con 0x7fcb080c6d80 2023-10-08T15:40:34.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f245aaaa700 1 -- 172.21.15.29:0/260240558 shutdown_connections 2023-10-08T15:40:34.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f245aaaa700 1 --2- 172.21.15.29:0/260240558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2454159e10 0x7f24540b2d20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f474dffb700 1 -- 172.21.15.29:0/3120508220 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852610046 0 0) 0x7f4748006290 con 0x7f47480dde20 2023-10-08T15:40:34.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f245aaaa700 1 -- 172.21.15.29:0/260240558 >> 172.21.15.29:0/260240558 conn(0x7f2454067660 msgr2=0x7f2454067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7f474dffb700 1 -- 172.21.15.29:0/3120508220 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4738003570 con 0x7f47480dde20 2023-10-08T15:40:34.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f4755819700 1 --2- 172.21.15.29:0/3120508220 >> v2:172.21.15.29:3300/0 conn(0x7f47480338f0 0x7f4748033d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f245aaaa700 1 -- 172.21.15.29:0/260240558 shutdown_connections 2023-10-08T15:40:34.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f6fca7fc700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fcc15e2b0 0x7f6fcc098fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400cd30 tx=0x7f6fc4001b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fcb07fff700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb080c6d80 0x7fcb080c71c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000cb90 tx=0x7fcb00001960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f474e7fc700 1 -- 172.21.15.29:0/3120508220 >> v2:172.21.15.29:3300/0 conn(0x7f47480338f0 msgr2=0x7f4748033d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f474e7fc700 1 --2- 172.21.15.29:0/3120508220 >> v2:172.21.15.29:3300/0 conn(0x7f47480338f0 0x7f4748033d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f474e7fc700 1 -- 172.21.15.29:0/3120508220 >> v1:172.21.15.29:6789/0 conn(0x7f47480dde20 legacy=0x7f4748050340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f474e7fc700 1 -- 172.21.15.29:0/3120508220 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4748034270 con 0x7f4748053e30 2023-10-08T15:40:34.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400ce90 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fcaef7fe700 1 -- 172.21.15.29:0/714347742 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000a7e0 con 0x7fcb080c6d80 2023-10-08T15:40:34.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fcaef7fe700 1 -- 172.21.15.29:0/714347742 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0000a960 con 0x7fcb080c6d80 2023-10-08T15:40:34.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb080ab3a0 con 0x7fcb080c6d80 2023-10-08T15:40:34.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fcaef7fe700 1 -- 172.21.15.29:0/714347742 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000ad20 con 0x7fcb080c6d80 2023-10-08T15:40:34.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc400aac0 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400ae80 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc0996c0 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc099c80 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb080ab960 con 0x7fcb080c6d80 2023-10-08T15:40:34.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5815bd40 con 0x7f3a5815e5a0 2023-10-08T15:40:34.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a580af1e0 con 0x7f3a5815e5a0 2023-10-08T15:40:34.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe71656f700 1 -- 172.21.15.29:0/63407891 shutdown_connections 2023-10-08T15:40:34.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe71656f700 1 --2- 172.21.15.29:0/63407891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe71006d3b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe71656f700 1 --2- 172.21.15.29:0/63407891 >> v2:172.21.15.29:3300/0 conn(0x7fe7100ccf10 0x7fe7100c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe71656f700 1 -- 172.21.15.29:0/63407891 >> 172.21.15.29:0/63407891 conn(0x7fe710070700 msgr2=0x7fe710070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2b1170700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2ac06ac30 0x7fe2ac14cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2b1170700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2ac1577d0 0x7fe2ac14dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2b1170700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2ac157ba0 0x7fe2ac14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2b1170700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac14da90 con 0x7fe2ac1577d0 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2b1170700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0b1030 con 0x7fe2ac06ac30 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2b1170700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac15edb0 con 0x7fe2ac157ba0 2023-10-08T15:40:34.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2aad9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2ac06ac30 0x7fe2ac14cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2aad9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2ac06ac30 0x7fe2ac14cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56458/0 (socket says 172.21.15.29:56458) 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2aad9d700 1 -- 172.21.15.29:0/2836780544 learned_addr learned my addr 172.21.15.29:0/2836780544 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.277+0000 7fe2aa59c700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2ac1577d0 0x7fe2ac14dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fe2aad9d700 1 -- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2ac157ba0 msgr2=0x7fe2ac14e4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fe2aad9d700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2ac157ba0 0x7fe2ac14e4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fe2aad9d700 1 -- 172.21.15.29:0/2836780544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2ac1577d0 msgr2=0x7fe2ac14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fe2aad9d700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2ac1577d0 0x7fe2ac14dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fe2aad9d700 1 -- 172.21.15.29:0/2836780544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009a20 con 0x7fe2ac06ac30 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7fe2aad9d700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2ac06ac30 0x7fe2ac14cf50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b600 tx=0x7fe29c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00f510 con 0x7fe2ac06ac30 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c00f690 con 0x7fe2ac06ac30 2023-10-08T15:40:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ac0b12d0 con 0x7fe2ac06ac30 2023-10-08T15:40:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00fa50 con 0x7fe2ac06ac30 2023-10-08T15:40:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.279+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac15f110 con 0x7fe2ac06ac30 2023-10-08T15:40:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.278+0000 7f245aaaa700 1 -- 172.21.15.29:0/260240558 wait complete. 2023-10-08T15:40:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.280+0000 7f245aaaa700 1 Processor -- start 2023-10-08T15:40:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.280+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2ac04c3c0 con 0x7fe2ac06ac30 2023-10-08T15:40:34.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.280+0000 7f474e7fc700 1 --2- 172.21.15.29:0/3120508220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4748053e30 0x7f47480de1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f474800dba0 tx=0x7f474400a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1424b52e9b538141 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.280+0000 7f245aaaa700 1 -- start start 2023-10-08T15:40:34.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.280+0000 7fcaef7fe700 1 -- 172.21.15.29:0/714347742 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb00007300 con 0x7fcb080c6d80 2023-10-08T15:40:34.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.280+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fcc04c3c0 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fc4007300 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f474dffb700 1 -- 172.21.15.29:0/3120508220 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400c970 con 0x7f4748053e30 2023-10-08T15:40:34.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f474dffb700 1 -- 172.21.15.29:0/3120508220 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474400cad0 con 0x7f4748053e30 2023-10-08T15:40:34.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f474dffb700 1 -- 172.21.15.29:0/3120508220 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400ce70 con 0x7f4748053e30 2023-10-08T15:40:34.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7fcaef7fe700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcaf4067000 0x7fcaf40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7fcaef7fe700 1 -- 172.21.15.29:0/714347742 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb00084520 con 0x7fcb080c6d80 2023-10-08T15:40:34.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7fcb077fe700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcaf4067000 0x7fcaf40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f6fb2ffd700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6fb8066f30 0x7f6fb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6fc4084910 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f6fcaffd700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6fb8066f30 0x7f6fb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f6fb2ffd700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.29:6816/86359,v1:172.21.15.29:6817/86359] conn(0x7f6fb806ef50 0x7f6fb8071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 --> [v2:172.21.15.29:6816/86359,v1:172.21.15.29:6817/86359] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fb8071a10 con 0x7f6fb806ef50 2023-10-08T15:40:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f3a3effd700 1 -- 172.21.15.29:0/2800021799 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a50003040 con 0x7f3a5815e5a0 2023-10-08T15:40:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f3a3effd700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a44067080 0x7f3a44069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f3a3effd700 1 -- 172.21.15.29:0/2800021799 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a500a7dc0 con 0x7f3a5815e5a0 2023-10-08T15:40:34.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f3a56d9d700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a44067080 0x7f3a44069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f6fcb7fe700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.29:6816/86359,v1:172.21.15.29:6817/86359] conn(0x7f6fb806ef50 0x7f6fb8071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fc4051c00 con 0x7f6fcc15e2b0 2023-10-08T15:40:34.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7fcb077fe700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcaf4067000 0x7fcaf40694b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009b40 tx=0x7fcafc0090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe29c01a400 con 0x7fe2ac06ac30 2023-10-08T15:40:34.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f6fcb7fe700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.29:6816/86359,v1:172.21.15.29:6817/86359] conn(0x7f6fb806ef50 0x7f6fb8071360 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f3a56d9d700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a44067080 0x7f3a44069530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c006fd0 tx=0x7f3a4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f6fcaffd700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6fb8066f30 0x7f6fb80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc069480 tx=0x7f6fbc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f474ffff700 1 -- 172.21.15.29:0/3120508220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4748053e30 msgr2=0x7f47480de1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f474ffff700 1 --2- 172.21.15.29:0/3120508220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4748053e30 0x7f47480de1f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f474800dba0 tx=0x7f474400a330 comp rx=0 tx=0).stop 2023-10-08T15:40:34.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f245aaaa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24540cde50 0x7f24541572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f245aaaa700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2454159e10 0x7f24540c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f245aaaa700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f245415a1e0 0x7f24540c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f245aaaa700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2454157820 con 0x7f24540cde50 2023-10-08T15:40:34.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f245aaaa700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540c91a0 con 0x7f2454159e10 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.281+0000 7f245aaaa700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24540c9480 con 0x7f245415a1e0 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f2458846700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24540cde50 0x7f24541572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f2458846700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24540cde50 0x7f24541572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33646/0 (socket says 172.21.15.29:33646) 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f2458846700 1 -- 172.21.15.29:0/3909685160 learned_addr learned my addr 172.21.15.29:0/3909685160 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f2458846700 1 -- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f245415a1e0 msgr2=0x7f24540c5f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f2458846700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f245415a1e0 0x7f24540c5f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f2458846700 1 -- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2454159e10 msgr2=0x7f24540c5a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f2458846700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2454159e10 0x7f24540c5a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f2458846700 1 -- 172.21.15.29:0/3909685160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448009420 con 0x7f24540cde50 2023-10-08T15:40:34.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f474ffff700 1 -- 172.21.15.29:0/3120508220 shutdown_connections 2023-10-08T15:40:34.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f474ffff700 1 --2- 172.21.15.29:0/3120508220 >> v2:172.21.15.29:3300/0 conn(0x7f47480338f0 0x7f4748033d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f474ffff700 1 --2- 172.21.15.29:0/3120508220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4748053e30 0x7f47480de1f0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f474800dba0 tx=0x7f474400a330 comp rx=0 tx=0).stop 2023-10-08T15:40:34.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7f474ffff700 1 -- 172.21.15.29:0/3120508220 >> 172.21.15.29:0/3120508220 conn(0x7f4748051840 msgr2=0x7f4748051c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f2458846700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24540cde50 0x7f24541572e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2454089c80 tx=0x7f2448017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fcb0dd25700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6800/86585,v1:172.21.15.183:6801/86585] conn(0x7fcb080b18d0 0x7fcb080b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 --> [v2:172.21.15.183:6800/86585,v1:172.21.15.183:6801/86585] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb0804c3c0 con 0x7fcb080b18d0 2023-10-08T15:40:34.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.282+0000 7fe292ffd700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe298066f30 0x7fe2980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe29c083fd0 con 0x7fe2ac06ac30 2023-10-08T15:40:34.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe2aa59c700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe298066f30 0x7fe2980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe292ffd700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6819/86587,v1:172.21.15.183:6821/86587] conn(0x7fe29806f140 0x7fe298071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 --> [v2:172.21.15.183:6819/86587,v1:172.21.15.183:6821/86587] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe298071c00 con 0x7fe29806f140 2023-10-08T15:40:34.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe29c0865f0 con 0x7fe2ac06ac30 2023-10-08T15:40:34.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244801f070 con 0x7f24540cde50 2023-10-08T15:40:34.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f3a5d04d700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.29:6800/86356,v1:172.21.15.29:6801/86356] conn(0x7f3a5813dab0 0x7f3a5805e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 --> [v2:172.21.15.29:6800/86356,v1:172.21.15.29:6801/86356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a5815bbd0 con 0x7f3a5813dab0 2023-10-08T15:40:34.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24540c9760 con 0x7f24540cde50 2023-10-08T15:40:34.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fcb06ffd700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6800/86585,v1:172.21.15.183:6801/86585] conn(0x7fcb080b18d0 0x7fcb080b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24540ce920 con 0x7f24540cde50 2023-10-08T15:40:34.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2448000bc0 con 0x7f24540cde50 2023-10-08T15:40:34.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448025420 con 0x7f24540cde50 2023-10-08T15:40:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f3a5659c700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.29:6800/86356,v1:172.21.15.29:6801/86356] conn(0x7f3a5813dab0 0x7f3a5805e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe71656f700 1 -- 172.21.15.29:0/63407891 shutdown_connections 2023-10-08T15:40:34.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f474ffff700 1 -- 172.21.15.29:0/3120508220 shutdown_connections 2023-10-08T15:40:34.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe2ab59e700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6819/86587,v1:172.21.15.183:6821/86587] conn(0x7fe29806f140 0x7fe298071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe2aa59c700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe298066f30 0x7fe2980693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac171d50 tx=0x7fe2a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 <== osd.2 v2:172.21.15.29:6816/86359 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f6fb8071a10 con 0x7f6fb806ef50 2023-10-08T15:40:34.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.284+0000 7fcb06ffd700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6800/86585,v1:172.21.15.183:6801/86585] conn(0x7fcb080b18d0 0x7fcb080b1ca0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.284+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2434000fd0 con 0x7f24540cde50 2023-10-08T15:40:34.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.284+0000 7fcaef7fe700 1 -- 172.21.15.29:0/714347742 <== osd.6 v2:172.21.15.183:6800/86585 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fcb0804c3c0 con 0x7fcb080b18d0 2023-10-08T15:40:34.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.283+0000 7fe71656f700 1 -- 172.21.15.29:0/63407891 wait complete. 2023-10-08T15:40:34.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.285+0000 7fe71656f700 1 Processor -- start 2023-10-08T15:40:34.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.285+0000 7f3a5659c700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.29:6800/86356,v1:172.21.15.29:6801/86356] conn(0x7f3a5813dab0 0x7f3a5805e080 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.285+0000 7f3a3effd700 1 -- 172.21.15.29:0/2800021799 <== osd.0 v2:172.21.15.29:6800/86356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f3a5815bbd0 con 0x7f3a5813dab0 2023-10-08T15:40:34.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.285+0000 7fe71656f700 1 -- start start 2023-10-08T15:40:34.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7fe71656f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe7100b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7fe71656f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7100ccf10 0x7fe7100b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7fe71656f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe71015e9b0 0x7fe710171f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7fe71656f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100acc90 con 0x7fe7100ccf10 2023-10-08T15:40:34.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7fe71656f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71015bec0 con 0x7fe71015e9b0 2023-10-08T15:40:34.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7fe71656f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100b1860 con 0x7fe71006f1c0 2023-10-08T15:40:34.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.285+0000 7fe2ab59e700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6819/86587,v1:172.21.15.183:6821/86587] conn(0x7fe29806f140 0x7fe298071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 <== osd.4 v2:172.21.15.183:6819/86587 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fe298071c00 con 0x7fe29806f140 2023-10-08T15:40:34.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.285+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2448023070 con 0x7f24540cde50 2023-10-08T15:40:34.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f2450ff9700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2440066f60 0x7f2440069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2448085af0 con 0x7f24540cde50 2023-10-08T15:40:34.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f2453fff700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2440066f60 0x7f2440069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f2450ff9700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6816/86596,v1:172.21.15.183:6817/86596] conn(0x7f244006f170 0x7f2440071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 --> [v2:172.21.15.183:6816/86596,v1:172.21.15.183:6817/86596] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2440071c30 con 0x7f244006f170 2023-10-08T15:40:34.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f244808b1d0 con 0x7f24540cde50 2023-10-08T15:40:34.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.284+0000 7f474ffff700 1 -- 172.21.15.29:0/3120508220 wait complete. 2023-10-08T15:40:34.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f474ffff700 1 Processor -- start 2023-10-08T15:40:34.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f474ffff700 1 -- start start 2023-10-08T15:40:34.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7fe70f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7100ccf10 0x7fe7100b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe70f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7100ccf10 0x7fe7100b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33648/0 (socket says 172.21.15.29:33648) 2023-10-08T15:40:34.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe70f7fe700 1 -- 172.21.15.29:0/280753297 learned_addr learned my addr 172.21.15.29:0/280753297 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe70ffff700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe7100b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe714b0c700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe71015e9b0 0x7fe710171f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.286+0000 7f2459047700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6816/86596,v1:172.21.15.183:6817/86596] conn(0x7f244006f170 0x7f2440071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe714b0c700 1 -- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 msgr2=0x7fe7100b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe714b0c700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe71006f1c0 0x7fe7100b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe714b0c700 1 -- 172.21.15.29:0/280753297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7100ccf10 msgr2=0x7fe7100b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe714b0c700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7100ccf10 0x7fe7100b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe714b0c700 1 -- 172.21.15.29:0/280753297 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040094f0 con 0x7fe71015e9b0 2023-10-08T15:40:34.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7f474ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47480338f0 0x7f47480fec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7f474ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47480dde20 0x7f474804c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7fe714b0c700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe71015e9b0 0x7fe710171f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe7100c3850 tx=0x7fe704017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7f474ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47480ff150 0x7f4748035ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7f474ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474804d350 con 0x7f47480338f0 2023-10-08T15:40:34.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7f474ffff700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474804d630 con 0x7f47480ff150 2023-10-08T15:40:34.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.287+0000 7f474ffff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474804d910 con 0x7f47480dde20 2023-10-08T15:40:34.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7fe6f7fff700 1 -- 172.21.15.29:0/280753297 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400b9d0 con 0x7fe71015e9b0 2023-10-08T15:40:34.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7fe6f7fff700 1 -- 172.21.15.29:0/280753297 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400bb30 con 0x7fe71015e9b0 2023-10-08T15:40:34.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7fe6f7fff700 1 -- 172.21.15.29:0/280753297 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704025650 con 0x7fe71015e9b0 2023-10-08T15:40:34.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47480ff150 0x7f4748035ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47480ff150 0x7f4748035ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56478/0 (socket says 172.21.15.29:56478) 2023-10-08T15:40:34.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 -- 172.21.15.29:0/970056369 learned_addr learned my addr 172.21.15.29:0/970056369 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f474e7fc700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47480dde20 0x7f474804c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f474effd700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47480338f0 0x7f47480fec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7100b2450 con 0x7fe71015e9b0 2023-10-08T15:40:34.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7100ac6d0 con 0x7fe71015e9b0 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 -- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47480dde20 msgr2=0x7f474804c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47480dde20 0x7f474804c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 -- 172.21.15.29:0/970056369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47480338f0 msgr2=0x7f47480fec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47480338f0 0x7f47480fec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 -- 172.21.15.29:0/970056369 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474400a5d0 con 0x7f47480ff150 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.288+0000 7f4755819700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47480ff150 0x7f4748035ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f475004cf20 tx=0x7f475006a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.289+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475004c490 con 0x7f47480ff150 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.289+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475006b360 con 0x7f47480ff150 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.289+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475006b4d0 con 0x7f47480ff150 2023-10-08T15:40:34.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.289+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474804dbf0 con 0x7f47480ff150 2023-10-08T15:40:34.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.289+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474804cdd0 con 0x7f47480ff150 2023-10-08T15:40:34.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.290+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f474804d7a0 con 0x7f47480ff150 2023-10-08T15:40:34.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.290+0000 7fe6f7fff700 1 -- 172.21.15.29:0/280753297 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe704023070 con 0x7fe71015e9b0 2023-10-08T15:40:34.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.291+0000 7fe6f7fff700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6fc0670b0 0x7fe6fc069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.291+0000 7fe6f7fff700 1 -- 172.21.15.29:0/280753297 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe704085a40 con 0x7fe71015e9b0 2023-10-08T15:40:34.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.291+0000 7fe70ffff700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6fc0670b0 0x7fe6fc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.291+0000 7fe70ffff700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6fc0670b0 0x7fe6fc069560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe70800f570 tx=0x7fe70800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.292+0000 7f3053f6f700 1 Processor -- start 2023-10-08T15:40:34.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.292+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f475008e020 con 0x7f47480ff150 2023-10-08T15:40:34.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.292+0000 7f3053f6f700 1 -- start start 2023-10-08T15:40:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.292+0000 7f4736ffd700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f473c066f30 0x7f473c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.292+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47500fc180 con 0x7f47480ff150 2023-10-08T15:40:34.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.293+0000 7f474effd700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f473c066f30 0x7f473c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.293+0000 7f4736ffd700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6808/86586,v1:172.21.15.183:6809/86586] conn(0x7f473c06f140 0x7f473c071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.293+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 --> [v2:172.21.15.183:6808/86586,v1:172.21.15.183:6809/86586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f473c071c00 con 0x7f473c06f140 2023-10-08T15:40:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.293+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47500fc520 con 0x7f47480ff150 2023-10-08T15:40:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.293+0000 7f474e7fc700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6808/86586,v1:172.21.15.183:6809/86586] conn(0x7f473c06f140 0x7f473c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.293+0000 7f474effd700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f473c066f30 0x7f473c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4740002ee0 tx=0x7f4740007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.293+0000 7f474e7fc700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6808/86586,v1:172.21.15.183:6809/86586] conn(0x7f473c06f140 0x7f473c071550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.293+0000 7f3053f6f700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f304c06a530 0x7f304c0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f3053f6f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f304c0ad9b0 0x7f304c0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f3053f6f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c067ba0 con 0x7f304c1568d0 2023-10-08T15:40:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f3053f6f700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c15aa90 con 0x7f304c06a530 2023-10-08T15:40:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f3053f6f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c067870 con 0x7f304c0ad9b0 2023-10-08T15:40:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f305150a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f304c06a530 0x7f304c0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f3051d0b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f304c1568d0 0x7f304c069e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43274/0 (socket says 172.21.15.29:43274) 2023-10-08T15:40:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f3051d0b700 1 -- 172.21.15.29:0/2317380064 learned_addr learned my addr 172.21.15.29:0/2317380064 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f305250c700 1 --2- 172.21.15.29:0/2317380064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f304c0ad9b0 0x7f304c0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f305150a700 1 -- 172.21.15.29:0/2317380064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f304c0ad9b0 msgr2=0x7f304c0c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f305150a700 1 --2- 172.21.15.29:0/2317380064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f304c0ad9b0 0x7f304c0c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f305150a700 1 -- 172.21.15.29:0/2317380064 >> v1:172.21.15.29:6789/0 conn(0x7f304c1568d0 legacy=0x7f304c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f305150a700 1 -- 172.21.15.29:0/2317380064 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0c8ca0 con 0x7f304c06a530 2023-10-08T15:40:34.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.294+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 <== osd.7 v2:172.21.15.183:6808/86586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f473c071c00 con 0x7f473c06f140 2023-10-08T15:40:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.292+0000 7f2453fff700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2440066f60 0x7f2440069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2444000f60 tx=0x7f2444007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.295+0000 7fe71656f700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.29:6808/86358,v1:172.21.15.29:6809/86358] conn(0x7fe71006e310 0x7fe7100ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.295+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 --> [v2:172.21.15.29:6808/86358,v1:172.21.15.29:6809/86358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7100ab250 con 0x7fe71006e310 2023-10-08T15:40:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.296+0000 7f2459047700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6816/86596,v1:172.21.15.183:6817/86596] conn(0x7f244006f170 0x7f2440071580 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.296+0000 7fe70f7fe700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.29:6808/86358,v1:172.21.15.29:6809/86358] conn(0x7fe71006e310 0x7fe7100ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.296+0000 7fe70f7fe700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.29:6808/86358,v1:172.21.15.29:6809/86358] conn(0x7fe71006e310 0x7fe7100ad320 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.296+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 <== osd.5 v2:172.21.15.183:6816/86596 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f2440071c30 con 0x7f244006f170 2023-10-08T15:40:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.297+0000 7fe6f7fff700 1 -- 172.21.15.29:0/280753297 <== osd.1 v2:172.21.15.29:6808/86358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fe7100ab250 con 0x7fe71006e310 2023-10-08T15:40:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.309+0000 7f305150a700 1 --2- 172.21.15.29:0/2317380064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f304c06a530 0x7f304c0c8090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30400098e0 tx=0x7f30400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e58f3dd8a82e205 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.309+0000 7f3050d09700 1 -- 172.21.15.29:0/2317380064 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000b640 con 0x7f304c06a530 2023-10-08T15:40:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.309+0000 7f3050d09700 1 -- 172.21.15.29:0/2317380064 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304000b7a0 con 0x7f304c06a530 2023-10-08T15:40:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.309+0000 7f3050d09700 1 -- 172.21.15.29:0/2317380064 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000bb40 con 0x7f304c06a530 2023-10-08T15:40:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.310+0000 7f3053f6f700 1 -- 172.21.15.29:0/2317380064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f304c06a530 msgr2=0x7f304c0c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.310+0000 7f3053f6f700 1 --2- 172.21.15.29:0/2317380064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f304c06a530 0x7f304c0c8090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30400098e0 tx=0x7f30400091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.310+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 --> [v2:172.21.15.183:6808/86586,v1:172.21.15.183:6809/86586] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47480054d0 con 0x7f473c06f140 2023-10-08T15:40:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.310+0000 7f4736ffd700 1 -- 172.21.15.29:0/970056369 <== osd.7 v2:172.21.15.183:6808/86586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47480054d0 con 0x7f473c06f140 2023-10-08T15:40:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.310+0000 7f3053f6f700 1 -- 172.21.15.29:0/2317380064 shutdown_connections 2023-10-08T15:40:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.310+0000 7f3053f6f700 1 --2- 172.21.15.29:0/2317380064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f304c0ad9b0 0x7f304c0c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.310+0000 7f3053f6f700 1 --2- 172.21.15.29:0/2317380064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f304c06a530 0x7f304c0c8090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.310+0000 7f3053f6f700 1 -- 172.21.15.29:0/2317380064 >> 172.21.15.29:0/2317380064 conn(0x7f304c0cda50 msgr2=0x7f304c0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.311+0000 7f3053f6f700 1 -- 172.21.15.29:0/2317380064 shutdown_connections 2023-10-08T15:40:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.311+0000 7f3053f6f700 1 -- 172.21.15.29:0/2317380064 wait complete. 2023-10-08T15:40:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.312+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 --> [v2:172.21.15.29:6816/86359,v1:172.21.15.29:6817/86359] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6fcc15ed40 con 0x7f6fb806ef50 2023-10-08T15:40:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.312+0000 7f3053f6f700 1 Processor -- start 2023-10-08T15:40:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.312+0000 7f3053f6f700 1 -- start start 2023-10-08T15:40:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 --> [v2:172.21.15.183:6819/86587,v1:172.21.15.183:6821/86587] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2ac15bff0 con 0x7fe29806f140 2023-10-08T15:40:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 --> [v2:172.21.15.183:6800/86585,v1:172.21.15.183:6801/86585] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb08068a30 con 0x7fcb080b18d0 2023-10-08T15:40:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7fe292ffd700 1 -- 172.21.15.29:0/2836780544 <== osd.4 v2:172.21.15.183:6819/86587 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2ac15bff0 con 0x7fe29806f140 2023-10-08T15:40:34.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7f3053f6f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f304c06a530 0x7f304c155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7fcaef7fe700 1 -- 172.21.15.29:0/714347742 <== osd.6 v2:172.21.15.183:6800/86585 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb08068a30 con 0x7fcb080b18d0 2023-10-08T15:40:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7f3053f6f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f304c0ad9b0 0x7f304c0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7f3053f6f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f304c1568d0 0x7f304c1400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7f3053f6f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c13def0 con 0x7f304c1568d0 2023-10-08T15:40:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7f3053f6f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c157ab0 con 0x7f304c06a530 2023-10-08T15:40:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.313+0000 7f3053f6f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c157210 con 0x7f304c0ad9b0 2023-10-08T15:40:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f305250c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f304c1568d0 0x7f304c1400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f305250c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f304c1568d0 0x7f304c1400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33664/0 (socket says 172.21.15.29:33664) 2023-10-08T15:40:34.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f305250c700 1 -- 172.21.15.29:0/1851612261 learned_addr learned my addr 172.21.15.29:0/1851612261 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f6fb2ffd700 1 -- 172.21.15.29:0/785269585 <== osd.2 v2:172.21.15.29:6816/86359 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6fcc15ed40 con 0x7f6fb806ef50 2023-10-08T15:40:34.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f3051d0b700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f304c06a530 0x7f304c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 --> [v2:172.21.15.29:6800/86356,v1:172.21.15.29:6801/86356] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a580b2810 con 0x7f3a5813dab0 2023-10-08T15:40:34.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6819/86587,v1:172.21.15.183:6821/86587] conn(0x7fe29806f140 msgr2=0x7fe298071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6819/86587,v1:172.21.15.183:6821/86587] conn(0x7fe29806f140 0x7fe298071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f305250c700 1 -- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f304c0ad9b0 msgr2=0x7f304c0cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f305250c700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f304c0ad9b0 0x7f304c0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f305250c700 1 -- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f304c06a530 msgr2=0x7f304c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f305250c700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f304c06a530 0x7f304c155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f305250c700 1 -- 172.21.15.29:0/1851612261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040009420 con 0x7f304c1568d0 2023-10-08T15:40:34.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe298066f30 msgr2=0x7fe2980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe298066f30 0x7fe2980693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac171d50 tx=0x7fe2a0009040 comp rx=0 tx=0).stop 2023-10-08T15:40:34.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2ac06ac30 msgr2=0x7fe2ac14cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 --2- 172.21.15.29:0/2836780544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2ac06ac30 0x7fe2ac14cf50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b600 tx=0x7fe29c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2ab59e700 1 -- 172.21.15.29:0/2836780544 reap_dead start 2023-10-08T15:40:34.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6808/86586,v1:172.21.15.183:6809/86586] conn(0x7f473c06f140 msgr2=0x7f473c071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f474ffff700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6808/86586,v1:172.21.15.183:6809/86586] conn(0x7f473c06f140 0x7f473c071550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f473c066f30 msgr2=0x7f473c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f474ffff700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f473c066f30 0x7f473c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4740002ee0 tx=0x7f4740007a60 comp rx=0 tx=0).stop 2023-10-08T15:40:34.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47480ff150 msgr2=0x7f4748035ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f474ffff700 1 --2- 172.21.15.29:0/970056369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47480ff150 0x7f4748035ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f475004cf20 tx=0x7f475006a040 comp rx=0 tx=0).stop 2023-10-08T15:40:34.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6800/86585,v1:172.21.15.183:6801/86585] conn(0x7fcb080b18d0 msgr2=0x7fcb080b1ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fcb0dd25700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6800/86585,v1:172.21.15.183:6801/86585] conn(0x7fcb080b18d0 0x7fcb080b1ca0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 shutdown_connections 2023-10-08T15:40:34.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 >> 172.21.15.29:0/2836780544 conn(0x7fe2ac068ce0 msgr2=0x7fe2ac158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 shutdown_connections 2023-10-08T15:40:34.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7fe2b1170700 1 -- 172.21.15.29:0/2836780544 wait complete. 2023-10-08T15:40:34.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 >> [v2:172.21.15.29:6816/86359,v1:172.21.15.29:6817/86359] conn(0x7f6fb806ef50 msgr2=0x7f6fb8071360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.314+0000 7f6fd1632700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.29:6816/86359,v1:172.21.15.29:6817/86359] conn(0x7f6fb806ef50 0x7f6fb8071360 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6fb8066f30 msgr2=0x7f6fb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fd1632700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6fb8066f30 0x7f6fb80693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc069480 tx=0x7f6fbc017000 comp rx=0 tx=0).stop 2023-10-08T15:40:34.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fcc15e2b0 msgr2=0x7f6fcc098fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fd1632700 1 --2- 172.21.15.29:0/785269585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6fcc15e2b0 0x7f6fcc098fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400cd30 tx=0x7f6fc4001b10 comp rx=0 tx=0).stop 2023-10-08T15:40:34.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f305250c700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f304c1568d0 0x7f304c1400a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3044009ef0 tx=0x7f304400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fcb7fe700 1 -- 172.21.15.29:0/785269585 reap_dead start 2023-10-08T15:40:34.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 shutdown_connections 2023-10-08T15:40:34.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 >> 172.21.15.29:0/785269585 conn(0x7f6fcc0cd1e0 msgr2=0x7f6fcc149560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 shutdown_connections 2023-10-08T15:40:34.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f6fd1632700 1 -- 172.21.15.29:0/785269585 wait complete. 2023-10-08T15:40:34.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400cc50 con 0x7f304c1568d0 2023-10-08T15:40:34.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400f040 con 0x7f304c1568d0 2023-10-08T15:40:34.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c1574f0 con 0x7f304c1568d0 2023-10-08T15:40:34.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c158620 con 0x7f304c1568d0 2023-10-08T15:40:34.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.315+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440135c0 con 0x7f304c1568d0 2023-10-08T15:40:34.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.317+0000 7f4755819700 1 -- 172.21.15.29:0/970056369 reap_dead start 2023-10-08T15:40:34.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.317+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 shutdown_connections 2023-10-08T15:40:34.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.317+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 >> 172.21.15.29:0/970056369 conn(0x7f4748051840 msgr2=0x7f4748007100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.317+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 shutdown_connections 2023-10-08T15:40:34.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.317+0000 7f474ffff700 1 -- 172.21.15.29:0/970056369 wait complete. 2023-10-08T15:40:34.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.317+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f302c000fd0 con 0x7f304c1568d0 2023-10-08T15:40:34.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.318+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3044013970 con 0x7f304c1568d0 2023-10-08T15:40:34.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.318+0000 7f303dffb700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3030066f30 0x7f30300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.318+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3044088b70 con 0x7f304c1568d0 2023-10-08T15:40:34.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.318+0000 7f3051d0b700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3030066f30 0x7f30300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.319+0000 7f303dffb700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.29:6822/86379,v1:172.21.15.29:6824/86379] conn(0x7f303006f140 0x7f3030071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.319+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 --> [v2:172.21.15.29:6822/86379,v1:172.21.15.29:6824/86379] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3030071c00 con 0x7f303006f140 2023-10-08T15:40:34.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.319+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f304408d240 con 0x7f304c1568d0 2023-10-08T15:40:34.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.319+0000 7f305150a700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.29:6822/86379,v1:172.21.15.29:6824/86379] conn(0x7f303006f140 0x7f3030071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.319+0000 7f3051d0b700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3030066f30 0x7f30300693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3048000c00 tx=0x7f3048009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.319+0000 7f305150a700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.29:6822/86379,v1:172.21.15.29:6824/86379] conn(0x7f303006f140 0x7f3030071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.320+0000 7f3a3effd700 1 -- 172.21.15.29:0/2800021799 <== osd.0 v2:172.21.15.29:6800/86356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a580b2810 con 0x7f3a5813dab0 2023-10-08T15:40:34.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.320+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 <== osd.3 v2:172.21.15.29:6822/86379 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f3030071c00 con 0x7f303006f140 2023-10-08T15:40:34.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.320+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcaf4067000 msgr2=0x7fcaf40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.320+0000 7fcb0dd25700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcaf4067000 0x7fcaf40694b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009b40 tx=0x7fcafc0090f0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.320+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb080c6d80 msgr2=0x7fcb080c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.320+0000 7fcb0dd25700 1 --2- 172.21.15.29:0/714347742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb080c6d80 0x7fcb080c71c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000cb90 tx=0x7fcb00001960 comp rx=0 tx=0).stop 2023-10-08T15:40:34.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.321+0000 7fcb07fff700 1 -- 172.21.15.29:0/714347742 reap_dead start 2023-10-08T15:40:34.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.321+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 shutdown_connections 2023-10-08T15:40:34.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.321+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 >> 172.21.15.29:0/714347742 conn(0x7fcb0806a250 msgr2=0x7fcb08070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.323+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 shutdown_connections 2023-10-08T15:40:34.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.323+0000 7fcb0dd25700 1 -- 172.21.15.29:0/714347742 wait complete. 2023-10-08T15:40:34.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.324+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 --> [v2:172.21.15.183:6816/86596,v1:172.21.15.183:6817/86596] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2434002d30 con 0x7f244006f170 2023-10-08T15:40:34.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.324+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 --> [v2:172.21.15.29:6808/86358,v1:172.21.15.29:6809/86358] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe710069f30 con 0x7fe71006e310 2023-10-08T15:40:34.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.325+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 >> [v2:172.21.15.29:6800/86356,v1:172.21.15.29:6801/86356] conn(0x7f3a5813dab0 msgr2=0x7f3a5805e080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.325+0000 7f3a5d04d700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.29:6800/86356,v1:172.21.15.29:6801/86356] conn(0x7f3a5813dab0 0x7f3a5805e080 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.325+0000 7fe6f7fff700 1 -- 172.21.15.29:0/280753297 <== osd.1 v2:172.21.15.29:6808/86358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe710069f30 con 0x7fe71006e310 2023-10-08T15:40:34.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.325+0000 7f2450ff9700 1 -- 172.21.15.29:0/3909685160 <== osd.5 v2:172.21.15.183:6816/86596 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2434002d30 con 0x7f244006f170 2023-10-08T15:40:34.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.325+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 >> [v2:172.21.15.29:6808/86358,v1:172.21.15.29:6809/86358] conn(0x7fe71006e310 msgr2=0x7fe7100ad320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.325+0000 7fe71656f700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.29:6808/86358,v1:172.21.15.29:6809/86358] conn(0x7fe71006e310 0x7fe7100ad320 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.325+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6816/86596,v1:172.21.15.183:6817/86596] conn(0x7f244006f170 msgr2=0x7f2440071580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.325+0000 7f245aaaa700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6816/86596,v1:172.21.15.183:6817/86596] conn(0x7f244006f170 0x7f2440071580 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2440066f60 msgr2=0x7f2440069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f245aaaa700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2440066f60 0x7f2440069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2444000f60 tx=0x7f2444007b40 comp rx=0 tx=0).stop 2023-10-08T15:40:34.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24540cde50 msgr2=0x7f24541572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f245aaaa700 1 --2- 172.21.15.29:0/3909685160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24540cde50 0x7f24541572e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2454089c80 tx=0x7f2448017000 comp rx=0 tx=0).stop 2023-10-08T15:40:34.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f2459047700 1 -- 172.21.15.29:0/3909685160 reap_dead start 2023-10-08T15:40:34.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 shutdown_connections 2023-10-08T15:40:34.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 >> 172.21.15.29:0/3909685160 conn(0x7f2454067660 msgr2=0x7f245415a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 shutdown_connections 2023-10-08T15:40:34.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.326+0000 7f245aaaa700 1 -- 172.21.15.29:0/3909685160 wait complete. 2023-10-08T15:40:34.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.327+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a44067080 msgr2=0x7f3a44069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.327+0000 7f3a5d04d700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a44067080 0x7f3a44069530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c006fd0 tx=0x7f3a4c008040 comp rx=0 tx=0).stop 2023-10-08T15:40:34.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.327+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a5815e5a0 msgr2=0x7f3a5813d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.327+0000 7f3a5d04d700 1 --2- 172.21.15.29:0/2800021799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a5815e5a0 0x7f3a5813d570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a50015000 tx=0x7f3a50018000 comp rx=0 tx=0).stop 2023-10-08T15:40:34.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.327+0000 7f3a5759e700 1 -- 172.21.15.29:0/2800021799 reap_dead start 2023-10-08T15:40:34.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6fc0670b0 msgr2=0x7fe6fc069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe71656f700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6fc0670b0 0x7fe6fc069560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe70800f570 tx=0x7fe70800b040 comp rx=0 tx=0).stop 2023-10-08T15:40:34.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe71015e9b0 msgr2=0x7fe710171f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe71656f700 1 --2- 172.21.15.29:0/280753297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe71015e9b0 0x7fe710171f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe7100c3850 tx=0x7fe704017000 comp rx=0 tx=0).stop 2023-10-08T15:40:34.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe714b0c700 1 -- 172.21.15.29:0/280753297 reap_dead start 2023-10-08T15:40:34.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 shutdown_connections 2023-10-08T15:40:34.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 >> 172.21.15.29:0/280753297 conn(0x7fe710070700 msgr2=0x7fe7100ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 shutdown_connections 2023-10-08T15:40:34.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.328+0000 7fe71656f700 1 -- 172.21.15.29:0/280753297 wait complete. 2023-10-08T15:40:34.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.330+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 shutdown_connections 2023-10-08T15:40:34.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.330+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 >> 172.21.15.29:0/2800021799 conn(0x7f3a580cd1e0 msgr2=0x7f3a580b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.330+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 shutdown_connections 2023-10-08T15:40:34.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.330+0000 7f3a5d04d700 1 -- 172.21.15.29:0/2800021799 wait complete. 2023-10-08T15:40:34.371 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:34.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T15:40:34.373 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:34.373 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T15:40:34.374 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:34.374 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T15:40:34.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.343+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 --> [v2:172.21.15.29:6822/86379,v1:172.21.15.29:6824/86379] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f302c002d30 con 0x7f303006f140 2023-10-08T15:40:34.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.343+0000 7f303dffb700 1 -- 172.21.15.29:0/1851612261 <== osd.3 v2:172.21.15.29:6822/86379 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f302c002d30 con 0x7f303006f140 2023-10-08T15:40:34.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 >> [v2:172.21.15.29:6822/86379,v1:172.21.15.29:6824/86379] conn(0x7f303006f140 msgr2=0x7f3030071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.29:6822/86379,v1:172.21.15.29:6824/86379] conn(0x7f303006f140 0x7f3030071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3030066f30 msgr2=0x7f30300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3030066f30 0x7f30300693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3048000c00 tx=0x7f3048009040 comp rx=0 tx=0).stop 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f304c1568d0 msgr2=0x7f304c1400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 --2- 172.21.15.29:0/1851612261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f304c1568d0 0x7f304c1400a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3044009ef0 tx=0x7f304400b040 comp rx=0 tx=0).stop 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f305250c700 1 -- 172.21.15.29:0/1851612261 reap_dead start 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 shutdown_connections 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 >> 172.21.15.29:0/1851612261 conn(0x7f304c0cda50 msgr2=0x7f304c160cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 shutdown_connections 2023-10-08T15:40:34.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.344+0000 7f3053f6f700 1 -- 172.21.15.29:0/1851612261 wait complete. 2023-10-08T15:40:34.377 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:34.377 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T15:40:34.378 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:34.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T15:40:34.379 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:34.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T15:40:34.380 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:34.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T15:40:34.381 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:34.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T15:40:34.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.617+0000 7f1cc3db2700 1 Processor -- start 2023-10-08T15:40:34.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.617+0000 7f1cc3db2700 1 -- start start 2023-10-08T15:40:34.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f437a401700 1 Processor -- start 2023-10-08T15:40:34.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f437a401700 1 -- start start 2023-10-08T15:40:34.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437a401700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f437406d4c0 0x7f43740bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437a401700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f43740ac1a0 0x7f43740ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437a401700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43740acb40 con 0x7f43740bf970 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437a401700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740c7960 con 0x7f437406d4c0 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437a401700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740c7c40 con 0x7f43740ac1a0 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f4373fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f43740bf970 0x7f437406ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54294/0 (socket says 172.21.15.29:54294) 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f4373fff700 1 -- 172.21.15.29:0/2745409939 learned_addr learned my addr 172.21.15.29:0/2745409939 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437899e700 1 --2- 172.21.15.29:0/2745409939 >> v2:172.21.15.183:3300/0 conn(0x7f43740ac1a0 0x7f43740ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437899e700 1 -- 172.21.15.29:0/2745409939 >> v2:172.21.15.29:3300/0 conn(0x7f437406d4c0 msgr2=0x7f43740bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437899e700 1 --2- 172.21.15.29:0/2745409939 >> v2:172.21.15.29:3300/0 conn(0x7f437406d4c0 0x7f43740bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437899e700 1 -- 172.21.15.29:0/2745409939 >> v1:172.21.15.183:6789/0 conn(0x7f43740bf970 legacy=0x7f437406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f437899e700 1 -- 172.21.15.29:0/2745409939 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740c7f20 con 0x7f43740ac1a0 2023-10-08T15:40:34.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.621+0000 7f437899e700 1 --2- 172.21.15.29:0/2745409939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740ac1a0 0x7f43740ac600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43680098e0 tx=0x7f43680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=223b02161721062 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f1cc3db2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc0ad870 0x7f1cbc0adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f1cc3db2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc15a500 con 0x7f1cbc15a080 2023-10-08T15:40:34.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f1cc3db2700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0accd0 con 0x7f1cbc06eab0 2023-10-08T15:40:34.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f1cc3db2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc15afe0 con 0x7f1cbc0ad870 2023-10-08T15:40:34.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f1cc234f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc0ad870 0x7f1cbc0adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f1cc1b4e700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f1cbc06eab0 0x7f1cbc06ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54280/0 (socket says 172.21.15.29:54280) 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.618+0000 7f1cc1b4e700 1 -- 172.21.15.29:0/1850571758 learned_addr learned my addr 172.21.15.29:0/1850571758 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc0b4c700 1 -- 172.21.15.29:0/1850571758 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713245579 0 0) 0x7f1cbc0accd0 con 0x7f1cbc06eab0 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc0b4c700 1 -- 172.21.15.29:0/1850571758 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca8003570 con 0x7f1cbc06eab0 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc234f700 1 -- 172.21.15.29:0/1850571758 >> v1:172.21.15.183:6789/0 conn(0x7f1cbc06eab0 legacy=0x7f1cbc06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc234f700 1 -- 172.21.15.29:0/1850571758 >> v1:172.21.15.29:6789/0 conn(0x7f1cbc15a080 legacy=0x7f1cbc0ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc234f700 1 -- 172.21.15.29:0/1850571758 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc0ae400 con 0x7f1cbc0ad870 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc234f700 1 --2- 172.21.15.29:0/1850571758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc0ad870 0x7f1cbc0adcd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009e90 tx=0x7f1cb4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738556c29ff25a76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc0b4c700 1 -- 172.21.15.29:0/1850571758 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400e070 con 0x7f1cbc0ad870 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc0b4c700 1 -- 172.21.15.29:0/1850571758 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb400bc80 con 0x7f1cbc0ad870 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7f1cc0b4c700 1 -- 172.21.15.29:0/1850571758 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4012430 con 0x7f1cbc0ad870 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1850571758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc0ad870 msgr2=0x7f1cbc0adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f1cc3db2700 1 --2- 172.21.15.29:0/1850571758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc0ad870 0x7f1cbc0adcd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009e90 tx=0x7f1cb4009780 comp rx=0 tx=0).stop 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1850571758 shutdown_connections 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f1cc3db2700 1 --2- 172.21.15.29:0/1850571758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc0ad870 0x7f1cbc0adcd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1850571758 >> 172.21.15.29:0/1850571758 conn(0x7f1cbc0cd1e0 msgr2=0x7f1cbc0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1850571758 shutdown_connections 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.621+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1850571758 wait complete. 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.622+0000 7f1cc3db2700 1 Processor -- start 2023-10-08T15:40:34.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.622+0000 7f1cc3db2700 1 -- start start 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc3db2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc06eab0 0x7f1cbc099590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc3db2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cbc0ad870 0x7f1cbc0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc3db2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cbc15a080 0x7f1cbc14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc3db2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc09a1f0 con 0x7f1cbc15a080 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc3db2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc14eb00 con 0x7f1cbc0ad870 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc3db2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc14ede0 con 0x7f1cbc06eab0 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc134d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cbc0ad870 0x7f1cbc0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc1b4e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc06eab0 0x7f1cbc099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc134d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cbc0ad870 0x7f1cbc0b0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56512/0 (socket says 172.21.15.29:56512) 2023-10-08T15:40:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc134d700 1 -- 172.21.15.29:0/1964919895 learned_addr learned my addr 172.21.15.29:0/1964919895 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f1cc1b4e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc06eab0 0x7f1cbc099590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:45958/0 (socket says 172.21.15.29:45958) 2023-10-08T15:40:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7fe586c1b700 1 Processor -- start 2023-10-08T15:40:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.619+0000 7fe586c1b700 1 -- start start 2023-10-08T15:40:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7fe586c1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccaf0 0x7fe5800883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7fe586c1b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5800ccec0 0x7fe5800888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7fe586c1b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe5800af910 0x7fe5800afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7fe586c1b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580088e30 con 0x7fe5800ccec0 2023-10-08T15:40:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7fe586c1b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5800c6eb0 con 0x7fe5800af910 2023-10-08T15:40:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.620+0000 7fe586c1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800b1270 con 0x7fe5800ccaf0 2023-10-08T15:40:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.622+0000 7f220f696700 1 Processor -- start 2023-10-08T15:40:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.622+0000 7f220f696700 1 -- start start 2023-10-08T15:40:34.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f220f696700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f22081561e0 0x7f22080a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f220f696700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f220815ac10 0x7f22080c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f220f696700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22080c2770 con 0x7f22081565b0 2023-10-08T15:40:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f220f696700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080ccb90 con 0x7f22081561e0 2023-10-08T15:40:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.623+0000 7f220f696700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080ccdf0 con 0x7f220815ac10 2023-10-08T15:40:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f220cc31700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f22081565b0 0x7f22080cc480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43296/0 (socket says 172.21.15.29:43296) 2023-10-08T15:40:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe57ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5800ccec0 0x7fe5800888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f220cc31700 1 -- 172.21.15.29:0/2032516746 learned_addr learned my addr 172.21.15.29:0/2032516746 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f220dc33700 1 --2- 172.21.15.29:0/2032516746 >> v2:172.21.15.183:3300/0 conn(0x7f220815ac10 0x7f22080c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f220d432700 1 --2- 172.21.15.29:0/2032516746 >> v2:172.21.15.29:3300/0 conn(0x7f22081561e0 0x7f22080a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe57ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5800ccec0 0x7fe5800888f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33688/0 (socket says 172.21.15.29:33688) 2023-10-08T15:40:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe57ffff700 1 -- 172.21.15.29:0/3004152311 learned_addr learned my addr 172.21.15.29:0/3004152311 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe5851b8700 1 --2- 172.21.15.29:0/3004152311 >> v2:172.21.15.183:3300/0 conn(0x7fe5800af910 0x7fe5800afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe5849b7700 1 --2- 172.21.15.29:0/3004152311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccaf0 0x7fe5800883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f21fffff700 1 -- 172.21.15.29:0/2032516746 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563547207 0 0) 0x7f22080c2770 con 0x7f22081565b0 2023-10-08T15:40:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f21fffff700 1 -- 172.21.15.29:0/2032516746 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f4003570 con 0x7f22081565b0 2023-10-08T15:40:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f4372ffd700 1 -- 172.21.15.29:0/2745409939 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368009e80 con 0x7f43740ac1a0 2023-10-08T15:40:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f4372ffd700 1 -- 172.21.15.29:0/2745409939 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436800b760 con 0x7f43740ac1a0 2023-10-08T15:40:34.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f4372ffd700 1 -- 172.21.15.29:0/2745409939 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800bb00 con 0x7f43740ac1a0 2023-10-08T15:40:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f02b6c1b700 1 Processor -- start 2023-10-08T15:40:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe57ffff700 1 -- 172.21.15.29:0/3004152311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccaf0 msgr2=0x7fe5800883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe57ffff700 1 --2- 172.21.15.29:0/3004152311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccaf0 0x7fe5800883b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe57ffff700 1 -- 172.21.15.29:0/3004152311 >> v2:172.21.15.183:3300/0 conn(0x7fe5800af910 msgr2=0x7fe5800afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe57ffff700 1 --2- 172.21.15.29:0/3004152311 >> v2:172.21.15.183:3300/0 conn(0x7fe5800af910 0x7fe5800afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f220d432700 1 -- 172.21.15.29:0/2032516746 >> v2:172.21.15.183:3300/0 conn(0x7f220815ac10 msgr2=0x7f22080c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f21fffff700 1 -- 172.21.15.29:0/2032516746 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4016455425 0 0) 0x7f21f4003570 con 0x7f22081565b0 2023-10-08T15:40:34.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7fe57ffff700 1 -- 172.21.15.29:0/3004152311 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800b0660 con 0x7fe5800ccec0 2023-10-08T15:40:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f02b6c1b700 1 -- start start 2023-10-08T15:40:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f1cc134d700 1 -- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc06eab0 msgr2=0x7f1cbc099590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f1cc134d700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc06eab0 0x7f1cbc099590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f1cc134d700 1 -- 172.21.15.29:0/1964919895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cbc15a080 msgr2=0x7f1cbc14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f1cc134d700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cbc15a080 0x7f1cbc14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.624+0000 7f1cc134d700 1 -- 172.21.15.29:0/1964919895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4009a20 con 0x7f1cbc0ad870 2023-10-08T15:40:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7fe57ffff700 1 --2- 172.21.15.29:0/3004152311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800ccec0 0x7fe5800888f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5800695f0 tx=0x7fe56c005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cb8ea998da5b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7fe57f7fe700 1 -- 172.21.15.29:0/3004152311 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c00e070 con 0x7fe5800ccec0 2023-10-08T15:40:34.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7fe57f7fe700 1 -- 172.21.15.29:0/3004152311 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c00b690 con 0x7fe5800ccec0 2023-10-08T15:40:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7fe57f7fe700 1 -- 172.21.15.29:0/3004152311 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c00ba50 con 0x7fe5800ccec0 2023-10-08T15:40:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f220d432700 1 --2- 172.21.15.29:0/2032516746 >> v2:172.21.15.183:3300/0 conn(0x7f220815ac10 0x7f22080c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f220d432700 1 -- 172.21.15.29:0/2032516746 >> v1:172.21.15.29:6789/0 conn(0x7f22081565b0 legacy=0x7f22080cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f220d432700 1 -- 172.21.15.29:0/2032516746 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080c2120 con 0x7f22081561e0 2023-10-08T15:40:34.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f220dc33700 1 --2- 172.21.15.29:0/2032516746 >> v2:172.21.15.183:3300/0 conn(0x7f220815ac10 0x7f22080c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:34.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f0bf2b27700 1 Processor -- start 2023-10-08T15:40:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f437a401700 1 -- 172.21.15.29:0/2745409939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740ac1a0 msgr2=0x7f43740ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f437a401700 1 --2- 172.21.15.29:0/2745409939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740ac1a0 0x7f43740ac600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43680098e0 tx=0x7f43680091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f437a401700 1 -- 172.21.15.29:0/2745409939 shutdown_connections 2023-10-08T15:40:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f437a401700 1 --2- 172.21.15.29:0/2745409939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740ac1a0 0x7f43740ac600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f437a401700 1 --2- 172.21.15.29:0/2745409939 >> v2:172.21.15.29:3300/0 conn(0x7f437406d4c0 0x7f43740bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f437a401700 1 -- 172.21.15.29:0/2745409939 >> 172.21.15.29:0/2745409939 conn(0x7f4374067660 msgr2=0x7f4374067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f220d432700 1 --2- 172.21.15.29:0/2032516746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22081561e0 0x7f22080a9db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22080c4220 tx=0x7f21f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402bbc586e06c1db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02b6c1b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f02b00b0cd0 0x7f02b00cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02b6c1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b015b820 0x7f02b00ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02b6c1b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b00c9450 con 0x7f02b00b10a0 2023-10-08T15:40:34.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02b6c1b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00ce960 con 0x7f02b00b0cd0 2023-10-08T15:40:34.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02b6c1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00cc520 con 0x7f02b015b820 2023-10-08T15:40:34.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.625+0000 7f0bf2b27700 1 -- start start 2023-10-08T15:40:34.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 -- 172.21.15.29:0/3004152311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800ccec0 msgr2=0x7fe5800888f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 --2- 172.21.15.29:0/3004152311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800ccec0 0x7fe5800888f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5800695f0 tx=0x7fe56c005bf0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f437a401700 1 -- 172.21.15.29:0/2745409939 shutdown_connections 2023-10-08T15:40:34.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02b49b7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f02b00b0cd0 0x7f02b00cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02affff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f02b00b10a0 0x7f02b00ce250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43306/0 (socket says 172.21.15.29:43306) 2023-10-08T15:40:34.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02b49b7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f02b00b0cd0 0x7f02b00cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56520/0 (socket says 172.21.15.29:56520) 2023-10-08T15:40:34.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02affff700 1 -- 172.21.15.29:0/3037821866 learned_addr learned my addr 172.21.15.29:0/3037821866 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 -- 172.21.15.29:0/3004152311 shutdown_connections 2023-10-08T15:40:34.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 --2- 172.21.15.29:0/3004152311 >> v2:172.21.15.183:3300/0 conn(0x7fe5800af910 0x7fe5800afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 --2- 172.21.15.29:0/3004152311 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccaf0 0x7fe5800883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 --2- 172.21.15.29:0/3004152311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800ccec0 0x7fe5800888f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 -- 172.21.15.29:0/3004152311 >> 172.21.15.29:0/3004152311 conn(0x7fe580070700 msgr2=0x7fe580070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f21fffff700 1 -- 172.21.15.29:0/2032516746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204001470 con 0x7f22081561e0 2023-10-08T15:40:34.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f21fffff700 1 -- 172.21.15.29:0/2032516746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f8011420 con 0x7f22081561e0 2023-10-08T15:40:34.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f21fffff700 1 -- 172.21.15.29:0/2032516746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f80117c0 con 0x7f22081561e0 2023-10-08T15:40:34.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 -- 172.21.15.29:0/3004152311 shutdown_connections 2023-10-08T15:40:34.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7fe586c1b700 1 -- 172.21.15.29:0/3004152311 wait complete. 2023-10-08T15:40:34.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f1cc134d700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cbc0ad870 0x7f1cbc0b0140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800dac0 tx=0x7f1cb800b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f437a401700 1 -- 172.21.15.29:0/2745409939 wait complete. 2023-10-08T15:40:34.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.626+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931080440 0 0) 0x7f02b00c9450 con 0x7f02b00b10a0 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a0003570 con 0x7f02b00b10a0 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311495886 0 0) 0x7f02a0003570 con 0x7f02b00b10a0 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b015b820 msgr2=0x7f02b00ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b015b820 0x7f02b00ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 >> v2:172.21.15.183:3300/0 conn(0x7f02b00b0cd0 msgr2=0x7f02b00cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 --2- 172.21.15.29:0/3037821866 >> v2:172.21.15.183:3300/0 conn(0x7f02b00b0cd0 0x7f02b00cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00cc910 con 0x7f02b00b10a0 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f029c001470 con 0x7f02b00b10a0 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 >> v1:172.21.15.29:6789/0 conn(0x7f02b00b10a0 legacy=0x7f02b00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a0003ae0 0x7f02a0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02a0004810 0x7f02a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02a00051c0 0x7f02a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00ce960 con 0x7f02a00051c0 2023-10-08T15:40:34.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00cc520 con 0x7f02a0003ae0 2023-10-08T15:40:34.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a000c1b0 con 0x7f02a0004810 2023-10-08T15:40:34.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f0bf2b27700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0bec0adb20 0x7f0bec0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f0bf2b27700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0bec0c89d0 0x7f0bec1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f0bf2b27700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec06e650 con 0x7f0bec0cab70 2023-10-08T15:40:34.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f0bf2b27700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec067cd0 con 0x7f0bec0c89d0 2023-10-08T15:40:34.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f0bf2b27700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec0679a0 con 0x7f0bec0adb20 2023-10-08T15:40:34.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f0bebfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0bec0cab70 0x7f0bec0c82c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43316/0 (socket says 172.21.15.29:43316) 2023-10-08T15:40:34.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f0bebfff700 1 -- 172.21.15.29:0/4178231088 learned_addr learned my addr 172.21.15.29:0/4178231088 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f220f696700 1 -- 172.21.15.29:0/2032516746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22081561e0 msgr2=0x7f22080a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f220f696700 1 --2- 172.21.15.29:0/2032516746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22081561e0 0x7f22080a9db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22080c4220 tx=0x7f21f80091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f0bf10c4700 1 --2- 172.21.15.29:0/4178231088 >> v2:172.21.15.29:3300/0 conn(0x7f0bec0c89d0 0x7f0bec1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f02b51b8700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02a00051c0 0x7f02a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f220f696700 1 -- 172.21.15.29:0/2032516746 shutdown_connections 2023-10-08T15:40:34.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f220f696700 1 --2- 172.21.15.29:0/2032516746 >> v2:172.21.15.183:3300/0 conn(0x7f220815ac10 0x7f22080c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f220f696700 1 --2- 172.21.15.29:0/2032516746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22081561e0 0x7f22080a9db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.627+0000 7f220f696700 1 -- 172.21.15.29:0/2032516746 >> 172.21.15.29:0/2032516746 conn(0x7f22080cd1e0 msgr2=0x7f22080cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0beb7fe700 1 -- 172.21.15.29:0/4178231088 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808842716 0 0) 0x7f0bec06e650 con 0x7f0bec0cab70 2023-10-08T15:40:34.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0beb7fe700 1 -- 172.21.15.29:0/4178231088 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd4003570 con 0x7f0bec0cab70 2023-10-08T15:40:34.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f02b51b8700 1 -- 172.21.15.29:0/3037821866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02a0004810 msgr2=0x7f02a0004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T15:40:34.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f02b51b8700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02a0004810 0x7f02a0004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f02b51b8700 1 -- 172.21.15.29:0/3037821866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a0003ae0 msgr2=0x7f02a0003ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:40:34.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f02b51b8700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a0003ae0 0x7f02a0003ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f02b51b8700 1 -- 172.21.15.29:0/3037821866 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00cc910 con 0x7f02a00051c0 2023-10-08T15:40:34.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f437a401700 1 Processor -- start 2023-10-08T15:40:34.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0bf10c4700 1 -- 172.21.15.29:0/4178231088 >> v2:172.21.15.183:3300/0 conn(0x7f0bec0adb20 msgr2=0x7f0bec0ca630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:40:34.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0bf10c4700 1 --2- 172.21.15.29:0/4178231088 >> v2:172.21.15.183:3300/0 conn(0x7f0bec0adb20 0x7f0bec0ca630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0bf10c4700 1 -- 172.21.15.29:0/4178231088 >> v1:172.21.15.29:6789/0 conn(0x7f0bec0cab70 legacy=0x7f0bec0c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0bf10c4700 1 -- 172.21.15.29:0/4178231088 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec0c8ea0 con 0x7f0bec0c89d0 2023-10-08T15:40:34.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7fe586c1b700 1 Processor -- start 2023-10-08T15:40:34.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f02b51b8700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02a00051c0 0x7f02a000ba60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009f40 tx=0x7f02a80095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217cd952914caeff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f220f696700 1 -- 172.21.15.29:0/2032516746 shutdown_connections 2023-10-08T15:40:34.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0bf10c4700 1 --2- 172.21.15.29:0/4178231088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 0x7f0bec1566d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0cd670 tx=0x7f0be4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bc5aef48fb953a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f220f696700 1 -- 172.21.15.29:0/2032516746 wait complete. 2023-10-08T15:40:34.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0beb7fe700 1 -- 172.21.15.29:0/4178231088 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400e070 con 0x7f0bec0c89d0 2023-10-08T15:40:34.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0beb7fe700 1 -- 172.21.15.29:0/4178231088 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400bb60 con 0x7f0bec0c89d0 2023-10-08T15:40:34.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f0beb7fe700 1 -- 172.21.15.29:0/4178231088 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4012430 con 0x7f0bec0c89d0 2023-10-08T15:40:34.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7f0bf2b27700 1 -- 172.21.15.29:0/4178231088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 msgr2=0x7f0bec1566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/4178231088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 0x7f0bec1566d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0cd670 tx=0x7f0be4009780 comp rx=0 tx=0).stop 2023-10-08T15:40:34.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7f0bf2b27700 1 -- 172.21.15.29:0/4178231088 shutdown_connections 2023-10-08T15:40:34.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/4178231088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 0x7f0bec1566d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/4178231088 >> v2:172.21.15.183:3300/0 conn(0x7f0bec0adb20 0x7f0bec0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7f0bf2b27700 1 -- 172.21.15.29:0/4178231088 >> 172.21.15.29:0/4178231088 conn(0x7f0bec06a250 msgr2=0x7f0bec06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7fe586c1b700 1 -- start start 2023-10-08T15:40:34.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7fe586c1b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800af910 0x7fe5800c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7fe586c1b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5800ccaf0 0x7fe5800bf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7fe586c1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccec0 0x7fe5800c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7fe586c1b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800c4820 con 0x7fe5800af910 2023-10-08T15:40:34.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7fe586c1b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800c3c10 con 0x7fe5800ccaf0 2023-10-08T15:40:34.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.629+0000 7fe586c1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800c3ef0 con 0x7fe5800ccec0 2023-10-08T15:40:34.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.628+0000 7f437a401700 1 -- start start 2023-10-08T15:40:34.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f437a401700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437406d4c0 0x7f43740b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f437a401700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43740ac1a0 0x7f43740c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f437a401700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740bf970 0x7f43740c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f437a401700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43740b1210 con 0x7f43740ac1a0 2023-10-08T15:40:34.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f437a401700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43740b14f0 con 0x7f43740bf970 2023-10-08T15:40:34.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f437a401700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740b17d0 con 0x7f437406d4c0 2023-10-08T15:40:34.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f0bf2b27700 1 -- 172.21.15.29:0/4178231088 shutdown_connections 2023-10-08T15:40:34.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f0bf2b27700 1 -- 172.21.15.29:0/4178231088 wait complete. 2023-10-08T15:40:34.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe57ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5800ccaf0 0x7fe5800bf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe57ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5800ccaf0 0x7fe5800bf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56524/0 (socket says 172.21.15.29:56524) 2023-10-08T15:40:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe57ffff700 1 -- 172.21.15.29:0/1308446106 learned_addr learned my addr 172.21.15.29:0/1308446106 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f437899e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740bf970 0x7f43740c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f4373fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437406d4c0 0x7f43740b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f4373fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437406d4c0 0x7f43740b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:45996/0 (socket says 172.21.15.29:45996) 2023-10-08T15:40:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f4373fff700 1 -- 172.21.15.29:0/2060485440 learned_addr learned my addr 172.21.15.29:0/2060485440 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f43737fe700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43740ac1a0 0x7f43740c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f43737fe700 1 -- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437406d4c0 msgr2=0x7f43740b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f43737fe700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437406d4c0 0x7f43740b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f43737fe700 1 -- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740bf970 msgr2=0x7f43740c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f43737fe700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740bf970 0x7f43740c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f43737fe700 1 -- 172.21.15.29:0/2060485440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009420 con 0x7f43740ac1a0 2023-10-08T15:40:34.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f43737fe700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43740ac1a0 0x7f43740c4b00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f436400b600 tx=0x7f43640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f1cb1ffb700 1 -- 172.21.15.29:0/1964919895 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8012980 con 0x7f1cbc0ad870 2023-10-08T15:40:34.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc14f0c0 con 0x7f1cbc0ad870 2023-10-08T15:40:34.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc14f680 con 0x7f1cbc0ad870 2023-10-08T15:40:34.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800bc20 con 0x7f02a00051c0 2023-10-08T15:40:34.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800bd80 con 0x7f02a00051c0 2023-10-08T15:40:34.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f02af7fe700 1 -- 172.21.15.29:0/3037821866 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800c680 con 0x7f02a00051c0 2023-10-08T15:40:34.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f02b6c1b700 1 -- 172.21.15.29:0/3037821866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02a00051c0 msgr2=0x7f02a000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f02b6c1b700 1 --2- 172.21.15.29:0/3037821866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02a00051c0 0x7f02a000ba60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009f40 tx=0x7f02a80095f0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f02b51b8700 1 -- 172.21.15.29:0/3037821866 reap_dead start 2023-10-08T15:40:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe5849b7700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800af910 0x7fe5800c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe5851b8700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccec0 0x7fe5800c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe5851b8700 1 -- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5800ccaf0 msgr2=0x7fe5800bf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe5851b8700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5800ccaf0 0x7fe5800bf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe5851b8700 1 -- 172.21.15.29:0/1308446106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800af910 msgr2=0x7fe5800c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe5851b8700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800af910 0x7fe5800c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7fe5851b8700 1 -- 172.21.15.29:0/1308446106 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c009690 con 0x7fe5800ccec0 2023-10-08T15:40:34.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7fe5851b8700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccec0 0x7fe5800c4cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe57800bfa0 tx=0x7fe57800b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7fe57cff9700 1 -- 172.21.15.29:0/1308446106 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578010070 con 0x7fe5800ccec0 2023-10-08T15:40:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f220f696700 1 Processor -- start 2023-10-08T15:40:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f220f696700 1 -- start start 2023-10-08T15:40:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.630+0000 7f1cb1ffb700 1 -- 172.21.15.29:0/1964919895 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb8012b00 con 0x7f1cbc0ad870 2023-10-08T15:40:34.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f1cb1ffb700 1 -- 172.21.15.29:0/1964919895 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80075b0 con 0x7f1cbc0ad870 2023-10-08T15:40:34.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f220f696700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22081561e0 0x7f2208149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f220f696700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22081565b0 0x7f22080c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f220f696700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f220815ac10 0x7f220806eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f220f696700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080addb0 con 0x7f220815ac10 2023-10-08T15:40:34.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f220f696700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080c6e10 con 0x7f22081565b0 2023-10-08T15:40:34.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f220f696700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080c70f0 con 0x7f22081561e0 2023-10-08T15:40:34.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f02b6c1b700 1 -- 172.21.15.29:0/3037821866 shutdown_connections 2023-10-08T15:40:34.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f02b6c1b700 1 -- 172.21.15.29:0/3037821866 >> 172.21.15.29:0/3037821866 conn(0x7f02b006fdc0 msgr2=0x7f02b006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f220815ac10 0x7f220806eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f220815ac10 0x7f220806eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33754/0 (socket says 172.21.15.29:33754) 2023-10-08T15:40:34.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 -- 172.21.15.29:0/942516099 learned_addr learned my addr 172.21.15.29:0/942516099 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220d432700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22081561e0 0x7f2208149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7fe57cff9700 1 -- 172.21.15.29:0/1308446106 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe578002e10 con 0x7fe5800ccec0 2023-10-08T15:40:34.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7fe57cff9700 1 -- 172.21.15.29:0/1308446106 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578014640 con 0x7fe5800ccec0 2023-10-08T15:40:34.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5800c41d0 con 0x7fe5800ccec0 2023-10-08T15:40:34.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5800c3920 con 0x7fe5800ccec0 2023-10-08T15:40:34.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 -- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22081561e0 msgr2=0x7f2208149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22081561e0 0x7f2208149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 -- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22081565b0 msgr2=0x7f22080c6330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T15:40:34.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22081565b0 0x7f22080c6330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 -- 172.21.15.29:0/942516099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8009420 con 0x7f220815ac10 2023-10-08T15:40:34.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f435bfff700 1 -- 172.21.15.29:0/2060485440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400f510 con 0x7f43740ac1a0 2023-10-08T15:40:34.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f435bfff700 1 -- 172.21.15.29:0/2060485440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436400f670 con 0x7f43740ac1a0 2023-10-08T15:40:34.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f435bfff700 1 -- 172.21.15.29:0/2060485440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400f9f0 con 0x7f43740ac1a0 2023-10-08T15:40:34.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5600052b0 con 0x7fe5800ccec0 2023-10-08T15:40:34.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f220dc33700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f220815ac10 0x7f220806eaf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f220000cef0 tx=0x7f2200007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43740b1ab0 con 0x7f43740ac1a0 2023-10-08T15:40:34.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.631+0000 7f0bf2b27700 1 Processor -- start 2023-10-08T15:40:34.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.633+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c0052b0 con 0x7f1cbc0ad870 2023-10-08T15:40:34.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.632+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43740c5040 con 0x7f43740ac1a0 2023-10-08T15:40:34.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.633+0000 7f1cb1ffb700 1 -- 172.21.15.29:0/1964919895 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cb8007960 con 0x7f1cbc0ad870 2023-10-08T15:40:34.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.633+0000 7f21fd7fa700 1 -- 172.21.15.29:0/942516099 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000add0 con 0x7f220815ac10 2023-10-08T15:40:34.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.633+0000 7f21fd7fa700 1 -- 172.21.15.29:0/942516099 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2200016420 con 0x7f220815ac10 2023-10-08T15:40:34.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.633+0000 7f21fd7fa700 1 -- 172.21.15.29:0/942516099 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000167e0 con 0x7f220815ac10 2023-10-08T15:40:34.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.633+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22080ad760 con 0x7f220815ac10 2023-10-08T15:40:34.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.633+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2208154c60 con 0x7f220815ac10 2023-10-08T15:40:34.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.634+0000 7f1cb1ffb700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ca0067000 0x7f1ca00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.634+0000 7f1cb1ffb700 1 -- 172.21.15.29:0/1964919895 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cb8088460 con 0x7f1cbc0ad870 2023-10-08T15:40:34.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.634+0000 7f1cc1b4e700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ca0067000 0x7f1ca00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7fe57cff9700 1 -- 172.21.15.29:0/1308446106 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe578003040 con 0x7fe5800ccec0 2023-10-08T15:40:34.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f02b6c1b700 1 -- 172.21.15.29:0/3037821866 shutdown_connections 2023-10-08T15:40:34.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f435bfff700 1 -- 172.21.15.29:0/2060485440 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f436401a400 con 0x7f43740ac1a0 2023-10-08T15:40:34.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43740b1fd0 con 0x7f43740ac1a0 2023-10-08T15:40:34.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e80052b0 con 0x7f220815ac10 2023-10-08T15:40:34.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f02b6c1b700 1 -- 172.21.15.29:0/3037821866 wait complete. 2023-10-08T15:40:34.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7fe57cff9700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe564067080 0x7fe564069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7fe5849b7700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe564067080 0x7fe564069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7fe57cff9700 1 -- 172.21.15.29:0/1308446106 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5780856e0 con 0x7fe5800ccec0 2023-10-08T15:40:34.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f435bfff700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4360067000 0x7f43600694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f435bfff700 1 -- 172.21.15.29:0/2060485440 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4364083ea0 con 0x7f43740ac1a0 2023-10-08T15:40:34.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f4373fff700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4360067000 0x7f43600694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f85aa51d700 1 Processor -- start 2023-10-08T15:40:34.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7fe5849b7700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe564067080 0x7fe564069530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe574007d90 tx=0x7fe574007190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f85aa51d700 1 -- start start 2023-10-08T15:40:34.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f0bf2b27700 1 -- start start 2023-10-08T15:40:34.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf2b27700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bec0adb20 0x7f0bec068160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf2b27700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 0x7f0bec0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf2b27700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bec0cab70 0x7f0bec0c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf2b27700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec159ba0 con 0x7f0bec0c89d0 2023-10-08T15:40:34.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf2b27700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec158f90 con 0x7f0bec0cab70 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf2b27700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec159270 con 0x7f0bec0adb20 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf10c4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bec0cab70 0x7f0bec0c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf08c3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bec0adb20 0x7f0bec068160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf10c4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bec0cab70 0x7f0bec0c4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56552/0 (socket says 172.21.15.29:56552) 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bf10c4700 1 -- 172.21.15.29:0/631427722 learned_addr learned my addr 172.21.15.29:0/631427722 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f0bebfff700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 0x7f0bec0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.635+0000 7f21fd7fa700 1 -- 172.21.15.29:0/942516099 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2200016bd0 con 0x7f220815ac10 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f21fd7fa700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21ec067000 0x7f21ec0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f21fd7fa700 1 -- 172.21.15.29:0/942516099 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2200012070 con 0x7f220815ac10 2023-10-08T15:40:34.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f4373fff700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4360067000 0x7f43600694b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f436c00e360 tx=0x7f436c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f0bf10c4700 1 -- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bec0adb20 msgr2=0x7f0bec068160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f0bf10c4700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bec0adb20 0x7f0bec068160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f0bf10c4700 1 -- 172.21.15.29:0/631427722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 msgr2=0x7f0bec0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f0bf10c4700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 0x7f0bec0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f0bf10c4700 1 -- 172.21.15.29:0/631427722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009a20 con 0x7f0bec0cab70 2023-10-08T15:40:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f220d432700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21ec067000 0x7f21ec0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.636+0000 7f1cc1b4e700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ca0067000 0x7f1ca00694b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007fd0 tx=0x7f1cac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f02b6c1b700 1 Processor -- start 2023-10-08T15:40:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7fa49d169700 1 Processor -- start 2023-10-08T15:40:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f0bf10c4700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bec0cab70 0x7f0bec0c4b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009fb0 tx=0x7f0be4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f02b6c1b700 1 -- start start 2023-10-08T15:40:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f220d432700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21ec067000 0x7f21ec0694b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21f80030c0 tx=0x7f21f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85aa51d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40ccf10 0x7f85a40c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85aa51d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85a415e9b0 0x7f85a406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85aa51d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a40ab5c0 con 0x7f85a40cd2e0 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85aa51d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a40aa9b0 con 0x7f85a415e9b0 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85aa51d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40aac90 con 0x7f85a40ccf10 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85a3fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40ccf10 0x7f85a40c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85a37fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85a415e9b0 0x7f85a406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85a8aba700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f85a40cd2e0 0x7f85a40c9310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54302/0 (socket says 172.21.15.29:54302) 2023-10-08T15:40:34.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85a37fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85a415e9b0 0x7f85a406eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56562/0 (socket says 172.21.15.29:56562) 2023-10-08T15:40:34.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85a8aba700 1 -- 172.21.15.29:0/3096640322 learned_addr learned my addr 172.21.15.29:0/3096640322 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:34.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7f85a3fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40ccf10 0x7f85a40c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:46034/0 (socket says 172.21.15.29:46034) 2023-10-08T15:40:34.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.637+0000 7fa49d169700 1 -- start start 2023-10-08T15:40:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a3fff700 1 -- 172.21.15.29:0/3096640322 >> v2:172.21.15.183:3300/0 conn(0x7f85a415e9b0 msgr2=0x7f85a406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a3fff700 1 --2- 172.21.15.29:0/3096640322 >> v2:172.21.15.183:3300/0 conn(0x7f85a415e9b0 0x7f85a406eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a3fff700 1 -- 172.21.15.29:0/3096640322 >> v1:172.21.15.183:6789/0 conn(0x7f85a40cd2e0 legacy=0x7f85a40c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a3fff700 1 -- 172.21.15.29:0/3096640322 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40aaf70 con 0x7f85a40ccf10 2023-10-08T15:40:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a37fe700 1 --2- 172.21.15.29:0/3096640322 >> v2:172.21.15.183:3300/0 conn(0x7f85a415e9b0 0x7f85a406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02b6c1b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a00051c0 0x7f02b0164750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02b6c1b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02b00b1920 0x7f02b00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a3fff700 1 --2- 172.21.15.29:0/3096640322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40ccf10 0x7f85a40c77d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f859c009e60 tx=0x7f859c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bfac7002a538878 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02b6c1b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b00b39c0 0x7f02b00b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02b6c1b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b014c8e0 con 0x7f02b00b1920 2023-10-08T15:40:34.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02b6c1b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b0164c90 con 0x7f02a00051c0 2023-10-08T15:40:34.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fe57cff9700 1 -- 172.21.15.29:0/1308446106 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5780529b0 con 0x7fe5800ccec0 2023-10-08T15:40:34.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fa49d169700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa49806d2e0 0x7fa4980c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fa49d169700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa49806d6b0 0x7fa4980c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fa49d169700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa498155b60 0x7fa498155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fa49d169700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4980c7930 con 0x7fa49806d2e0 2023-10-08T15:40:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fa49d169700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4980c8760 con 0x7fa498155b60 2023-10-08T15:40:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fa49d169700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980af6e0 con 0x7fa49806d6b0 2023-10-08T15:40:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02b6c1b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00b22d0 con 0x7f02b00b39c0 2023-10-08T15:40:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02affff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02b00b1920 0x7f02b00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02affff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02b00b1920 0x7f02b00b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33762/0 (socket says 172.21.15.29:33762) 2023-10-08T15:40:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02affff700 1 -- 172.21.15.29:0/2367595341 learned_addr learned my addr 172.21.15.29:0/2367595341 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f02b51b8700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b00b39c0 0x7f02b00b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a2ffd700 1 -- 172.21.15.29:0/3096640322 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c00e070 con 0x7f85a40ccf10 2023-10-08T15:40:34.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a2ffd700 1 -- 172.21.15.29:0/3096640322 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c00bb60 con 0x7f85a40ccf10 2023-10-08T15:40:34.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7f85a2ffd700 1 -- 172.21.15.29:0/3096640322 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c012430 con 0x7f85a40ccf10 2023-10-08T15:40:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fa49659c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa49806d6b0 0x7fa4980c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.638+0000 7fa49759e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa498155b60 0x7fa498155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49759e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa498155b60 0x7fa498155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56580/0 (socket says 172.21.15.29:56580) 2023-10-08T15:40:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49759e700 1 -- 172.21.15.29:0/2079565780 learned_addr learned my addr 172.21.15.29:0/2079565780 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49659c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa49806d6b0 0x7fa4980c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:46058/0 (socket says 172.21.15.29:46058) 2023-10-08T15:40:34.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa496d9d700 1 --2- 172.21.15.29:0/2079565780 >> v2:172.21.15.29:3300/0 conn(0x7fa49806d2e0 0x7fa4980c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f02b49b7700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a00051c0 0x7f02b0164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f02affff700 1 -- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b00b39c0 msgr2=0x7f02b00b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f02affff700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b00b39c0 0x7f02b00b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f02affff700 1 -- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a00051c0 msgr2=0x7f02b0164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f02affff700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a00051c0 0x7f02b0164750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f02affff700 1 -- 172.21.15.29:0/2367595341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0067660 con 0x7f02b00b1920 2023-10-08T15:40:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f02b51b8700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b00b39c0 0x7f02b00b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49759e700 1 -- 172.21.15.29:0/2079565780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa49806d6b0 msgr2=0x7fa4980c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49759e700 1 --2- 172.21.15.29:0/2079565780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa49806d6b0 0x7fa4980c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49759e700 1 -- 172.21.15.29:0/2079565780 >> v2:172.21.15.29:3300/0 conn(0x7fa49806d2e0 msgr2=0x7fa4980c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:34.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49759e700 1 --2- 172.21.15.29:0/2079565780 >> v2:172.21.15.29:3300/0 conn(0x7fa49806d2e0 0x7fa4980c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f0be8ff9700 1 -- 172.21.15.29:0/631427722 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4027470 con 0x7f0bec0cab70 2023-10-08T15:40:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f85aa51d700 1 -- 172.21.15.29:0/3096640322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40ccf10 msgr2=0x7f85a40c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f85aa51d700 1 --2- 172.21.15.29:0/3096640322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40ccf10 0x7f85a40c77d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f859c009e60 tx=0x7f859c009780 comp rx=0 tx=0).stop 2023-10-08T15:40:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f85aa51d700 1 -- 172.21.15.29:0/3096640322 shutdown_connections 2023-10-08T15:40:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f85aa51d700 1 --2- 172.21.15.29:0/3096640322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40ccf10 0x7f85a40c77d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f85aa51d700 1 --2- 172.21.15.29:0/3096640322 >> v2:172.21.15.183:3300/0 conn(0x7f85a415e9b0 0x7f85a406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f85aa51d700 1 -- 172.21.15.29:0/3096640322 >> 172.21.15.29:0/3096640322 conn(0x7f85a4070700 msgr2=0x7f85a4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f0be8ff9700 1 -- 172.21.15.29:0/631427722 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40275d0 con 0x7f0bec0cab70 2023-10-08T15:40:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f0be8ff9700 1 -- 172.21.15.29:0/631427722 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4027990 con 0x7f0bec0cab70 2023-10-08T15:40:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec159550 con 0x7f0bec0cab70 2023-10-08T15:40:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec158b20 con 0x7f0bec0cab70 2023-10-08T15:40:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7f85aa51d700 1 -- 172.21.15.29:0/3096640322 shutdown_connections 2023-10-08T15:40:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7f85aa51d700 1 -- 172.21.15.29:0/3096640322 wait complete. 2023-10-08T15:40:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.641+0000 7f1cb1ffb700 1 -- 172.21.15.29:0/1964919895 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cb8055750 con 0x7f1cbc0ad870 2023-10-08T15:40:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.641+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec158d60 con 0x7f0bec0cab70 2023-10-08T15:40:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.641+0000 7f0be8ff9700 1 -- 172.21.15.29:0/631427722 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0be4024070 con 0x7f0bec0cab70 2023-10-08T15:40:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.641+0000 7f0be8ff9700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.642+0000 7f0be8ff9700 1 -- 172.21.15.29:0/631427722 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0be4086b40 con 0x7f0bec0cab70 2023-10-08T15:40:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.642+0000 7f85aa51d700 1 Processor -- start 2023-10-08T15:40:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.642+0000 7f0bf08c3700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.642+0000 7f85aa51d700 1 -- start start 2023-10-08T15:40:34.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.642+0000 7f0bf08c3700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0bd8066f30 0x7f0bd80693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc006fd0 tx=0x7f0bdc000f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85aa51d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a40ccf10 0x7f85a415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85aa51d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40cd2e0 0x7f85a41724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85aa51d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85a415e9b0 0x7f85a40c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85aa51d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a4172a00 con 0x7f85a415e9b0 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85aa51d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40ac840 con 0x7f85a40ccf10 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85aa51d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a40ab950 con 0x7f85a40cd2e0 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a3fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a40ccf10 0x7f85a415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a37fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40cd2e0 0x7f85a41724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a3fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a40ccf10 0x7f85a415dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56584/0 (socket says 172.21.15.29:56584) 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a3fff700 1 -- 172.21.15.29:0/4113038705 learned_addr learned my addr 172.21.15.29:0/4113038705 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a8aba700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85a415e9b0 0x7f85a40c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a8aba700 1 -- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40cd2e0 msgr2=0x7f85a41724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a8aba700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40cd2e0 0x7f85a41724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a8aba700 1 -- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a40ccf10 msgr2=0x7f85a415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a8aba700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a40ccf10 0x7f85a415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a8aba700 1 -- 172.21.15.29:0/4113038705 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598009420 con 0x7f85a415e9b0 2023-10-08T15:40:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a3fff700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a40ccf10 0x7f85a415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a37fe700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40cd2e0 0x7f85a41724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7f85a8aba700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85a415e9b0 0x7f85a40c02f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f859400c560 tx=0x7f8594007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49759e700 1 -- 172.21.15.29:0/2079565780 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980c7b50 con 0x7fa498155b60 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa496d9d700 1 --2- 172.21.15.29:0/2079565780 >> v2:172.21.15.29:3300/0 conn(0x7fa49806d2e0 0x7fa4980c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa49759e700 1 --2- 172.21.15.29:0/2079565780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa498155b60 0x7fa498155fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa49806a620 tx=0x7fa490007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73cf577e13b68375 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa495d9b700 1 -- 172.21.15.29:0/2079565780 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa490013070 con 0x7fa498155b60 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa495d9b700 1 -- 172.21.15.29:0/2079565780 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49000e2e0 con 0x7fa498155b60 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7fa495d9b700 1 -- 172.21.15.29:0/2079565780 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49000ed20 con 0x7fa498155b60 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7fa49d169700 1 -- 172.21.15.29:0/2079565780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa498155b60 msgr2=0x7fa498155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7fa49d169700 1 --2- 172.21.15.29:0/2079565780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa498155b60 0x7fa498155fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa49806a620 tx=0x7fa490007e80 comp rx=0 tx=0).stop 2023-10-08T15:40:34.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7fa49d169700 1 -- 172.21.15.29:0/2079565780 shutdown_connections 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7fa49d169700 1 --2- 172.21.15.29:0/2079565780 >> v2:172.21.15.29:3300/0 conn(0x7fa49806d2e0 0x7fa4980c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7fa49d169700 1 --2- 172.21.15.29:0/2079565780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa498155b60 0x7fa498155fb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7fa49d169700 1 --2- 172.21.15.29:0/2079565780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa49806d6b0 0x7fa4980c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7fa49d169700 1 -- 172.21.15.29:0/2079565780 >> 172.21.15.29:0/2079565780 conn(0x7fa498070700 msgr2=0x7fa498070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.640+0000 7fa49d169700 1 -- 172.21.15.29:0/2079565780 shutdown_connections 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.641+0000 7fa49d169700 1 -- 172.21.15.29:0/2079565780 wait complete. 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7fa49d169700 1 Processor -- start 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.643+0000 7fa49d169700 1 -- start start 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa49d169700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa49806d2e0 0x7fa4980ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa49d169700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa49806d6b0 0x7fa4980aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa49d169700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa498155b60 0x7fa4980ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa49d169700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980c7790 con 0x7fa49806d2e0 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa49d169700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa498155000 con 0x7fa49806d6b0 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa49d169700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa498154430 con 0x7fa498155b60 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa49806d2e0 0x7fa4980ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa49806d2e0 0x7fa4980ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33792/0 (socket says 172.21.15.29:33792) 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 -- 172.21.15.29:0/1956372738 learned_addr learned my addr 172.21.15.29:0/1956372738 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa49759e700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa498155b60 0x7fa4980ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 -- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa498155b60 msgr2=0x7fa4980ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa498155b60 0x7fa4980ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 -- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa49806d6b0 msgr2=0x7fa4980aeeb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T15:40:34.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa49806d6b0 0x7fa4980aeeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:34.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 -- 172.21.15.29:0/1956372738 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480009420 con 0x7fa49806d2e0 2023-10-08T15:40:34.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.644+0000 7fa496d9d700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa49806d2e0 0x7fa4980ae970 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa48000ec80 tx=0x7fa4800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.639+0000 7f02affff700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02b00b1920 0x7f02b00b1d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f029c00cb40 tx=0x7f029c001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.646+0000 7f435bfff700 1 -- 172.21.15.29:0/2060485440 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43740b1fd0 con 0x7f43740ac1a0 2023-10-08T15:40:34.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.646+0000 7f0be8ff9700 1 -- 172.21.15.29:0/631427722 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0be4053db0 con 0x7f0bec0cab70 2023-10-08T15:40:34.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.652+0000 7f858bfff700 1 -- 172.21.15.29:0/4113038705 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594005b30 con 0x7f85a415e9b0 2023-10-08T15:40:34.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.652+0000 7f858bfff700 1 -- 172.21.15.29:0/4113038705 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594005cb0 con 0x7f85a415e9b0 2023-10-08T15:40:34.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.652+0000 7f858bfff700 1 -- 172.21.15.29:0/4113038705 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594007320 con 0x7f85a415e9b0 2023-10-08T15:40:34.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.652+0000 7f21fd7fa700 1 -- 172.21.15.29:0/942516099 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f220004e5a0 con 0x7f220815ac10 2023-10-08T15:40:34.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.653+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c009a20 con 0x7f85a415e9b0 2023-10-08T15:40:34.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.653+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a40abf10 con 0x7f85a415e9b0 2023-10-08T15:40:34.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.653+0000 7fa48effd700 1 -- 172.21.15.29:0/1956372738 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000c850 con 0x7fa49806d2e0 2023-10-08T15:40:34.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.653+0000 7fa48effd700 1 -- 172.21.15.29:0/1956372738 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000c9b0 con 0x7fa49806d2e0 2023-10-08T15:40:34.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.653+0000 7fa48effd700 1 -- 172.21.15.29:0/1956372738 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000cd30 con 0x7fa49806d2e0 2023-10-08T15:40:34.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.653+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa490005ea0 con 0x7fa49806d2e0 2023-10-08T15:40:34.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.653+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4981549b0 con 0x7fa49806d2e0 2023-10-08T15:40:34.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.655+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c0052b0 con 0x7fa49806d2e0 2023-10-08T15:40:34.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.655+0000 7f858bfff700 1 -- 172.21.15.29:0/4113038705 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f859401b3b0 con 0x7f85a415e9b0 2023-10-08T15:40:34.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.655+0000 7f858bfff700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8590067000 0x7f85900694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.655+0000 7f858bfff700 1 -- 172.21.15.29:0/4113038705 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8594083830 con 0x7f85a415e9b0 2023-10-08T15:40:34.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.656+0000 7f02acff9700 1 -- 172.21.15.29:0/2367595341 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c004b10 con 0x7f02b00b1920 2023-10-08T15:40:34.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.656+0000 7f02acff9700 1 -- 172.21.15.29:0/2367595341 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c004c90 con 0x7f02b00b1920 2023-10-08T15:40:34.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.656+0000 7f02acff9700 1 -- 172.21.15.29:0/2367595341 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c0073a0 con 0x7f02b00b1920 2023-10-08T15:40:34.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.656+0000 7fa48effd700 1 -- 172.21.15.29:0/1956372738 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa480013680 con 0x7fa49806d2e0 2023-10-08T15:40:34.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.656+0000 7fa48effd700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa478067000 0x7fa4780694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.656+0000 7fa48effd700 1 -- 172.21.15.29:0/1956372738 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4800847a0 con 0x7fa49806d2e0 2023-10-08T15:40:34.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.657+0000 7fa49659c700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa478067000 0x7fa4780694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.657+0000 7fa49659c700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa478067000 0x7fa4780694b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa498063cd0 tx=0x7fa4880091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.658+0000 7f85a3fff700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8590067000 0x7f85900694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.658+0000 7f85a3fff700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8590067000 0x7f85900694b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097c0 tx=0x7f859c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:34.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.662+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b0067f00 con 0x7f02b00b1920 2023-10-08T15:40:34.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.662+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b014cd10 con 0x7f02b00b1920 2023-10-08T15:40:34.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.662+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a40c7730 con 0x7f85a415e9b0 2023-10-08T15:40:34.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.664+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b0068090 con 0x7f02b00b1920 2023-10-08T15:40:34.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.665+0000 7fa48effd700 1 -- 172.21.15.29:0/1956372738 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa480055520 con 0x7fa49806d2e0 2023-10-08T15:40:34.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.674+0000 7f858bfff700 1 -- 172.21.15.29:0/4113038705 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8594017020 con 0x7f85a415e9b0 2023-10-08T15:40:34.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.676+0000 7f02acff9700 1 -- 172.21.15.29:0/2367595341 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f029c00a620 con 0x7f02b00b1920 2023-10-08T15:40:34.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.676+0000 7f02acff9700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0294066fb0 0x7f0294069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:34.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.677+0000 7f02acff9700 1 -- 172.21.15.29:0/2367595341 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f029c084340 con 0x7f02b00b1920 2023-10-08T15:40:34.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.678+0000 7f02b49b7700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0294066fb0 0x7f0294069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:34.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.686+0000 7f02acff9700 1 -- 172.21.15.29:0/2367595341 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f029c051610 con 0x7f02b00b1920 2023-10-08T15:40:34.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:34.686+0000 7f02b49b7700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0294066fb0 0x7f0294069460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009170 tx=0x7f02a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:35.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.038+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe560005830 con 0x7fe5800ccec0 2023-10-08T15:40:35.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.039+0000 7fe57cff9700 1 -- 172.21.15.29:0/1308446106 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe578055fd0 con 0x7fe5800ccec0 2023-10-08T15:40:35.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.040+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f43740b1fd0 con 0x7f43740ac1a0 2023-10-08T15:40:35.041 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-08T15:40:35.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.043+0000 7f435bfff700 1 -- 172.21.15.29:0/2060485440 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43740b1fd0 con 0x7f43740ac1a0 2023-10-08T15:40:35.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.042+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe564067080 msgr2=0x7fe564069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.043+0000 7fe586c1b700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe564067080 0x7fe564069530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe574007d90 tx=0x7fe574007190 comp rx=0 tx=0).stop 2023-10-08T15:40:35.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.043+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccec0 msgr2=0x7fe5800c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.043+0000 7fe586c1b700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccec0 0x7fe5800c4cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe57800bfa0 tx=0x7fe57800b9b0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.044 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-08T15:40:35.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.044+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 shutdown_connections 2023-10-08T15:40:35.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.044+0000 7fe586c1b700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe564067080 0x7fe564069530 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe574007d90 tx=0x7fe574007190 comp rx=0 tx=0).stop 2023-10-08T15:40:35.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.044+0000 7fe586c1b700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5800ccec0 0x7fe5800c4cb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.044+0000 7fe586c1b700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5800af910 0x7fe5800c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.044+0000 7fe586c1b700 1 --2- 172.21.15.29:0/1308446106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5800ccaf0 0x7fe5800bf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.044+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 >> 172.21.15.29:0/1308446106 conn(0x7fe580070700 msgr2=0x7fe5800b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:35.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.044+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 shutdown_connections 2023-10-08T15:40:35.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.044+0000 7fe586c1b700 1 -- 172.21.15.29:0/1308446106 wait complete. 2023-10-08T15:40:35.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.046+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4360067000 msgr2=0x7f43600694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.046+0000 7f437a401700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4360067000 0x7f43600694b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f436c00e360 tx=0x7f436c009040 comp rx=0 tx=0).stop 2023-10-08T15:40:35.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.046+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43740ac1a0 msgr2=0x7f43740c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.046+0000 7f437a401700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43740ac1a0 0x7f43740c4b00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f436400b600 tx=0x7f43640091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.048+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 shutdown_connections 2023-10-08T15:40:35.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.048+0000 7f437a401700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4360067000 0x7f43600694b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.048+0000 7f437a401700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43740bf970 0x7f43740c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.048+0000 7f437a401700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437406d4c0 0x7f43740b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.048+0000 7f437a401700 1 --2- 172.21.15.29:0/2060485440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43740ac1a0 0x7f43740c4b00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.048+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 >> 172.21.15.29:0/2060485440 conn(0x7f4374067660 msgr2=0x7f43740c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:35.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.048+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1c9c005830 con 0x7f1cbc0ad870 2023-10-08T15:40:35.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.049+0000 7f1cb1ffb700 1 -- 172.21.15.29:0/1964919895 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cb8016020 con 0x7f1cbc0ad870 2023-10-08T15:40:35.049 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-08T15:40:35.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.051+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f21e8005830 con 0x7f220815ac10 2023-10-08T15:40:35.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.051+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0bec04c3c0 con 0x7f0bec0cab70 2023-10-08T15:40:35.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.051+0000 7f21fd7fa700 1 -- 172.21.15.29:0/942516099 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2200052030 con 0x7f220815ac10 2023-10-08T15:40:35.052 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-08T15:40:35.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.052+0000 7f0be8ff9700 1 -- 172.21.15.29:0/631427722 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0be402c020 con 0x7f0bec0cab70 2023-10-08T15:40:35.053 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-08T15:40:35.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.052+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ca0067000 msgr2=0x7f1ca00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.052+0000 7f1cc3db2700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ca0067000 0x7f1ca00694b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007fd0 tx=0x7f1cac009040 comp rx=0 tx=0).stop 2023-10-08T15:40:35.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.052+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cbc0ad870 msgr2=0x7f1cbc0b0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.052+0000 7f1cc3db2700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cbc0ad870 0x7f1cbc0b0140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800dac0 tx=0x7f1cb800b430 comp rx=0 tx=0).stop 2023-10-08T15:40:35.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.052+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 shutdown_connections 2023-10-08T15:40:35.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.052+0000 7f1cc3db2700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ca0067000 0x7f1ca00694b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.052+0000 7f1cc3db2700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cbc15a080 0x7f1cbc14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.053+0000 7f1cc3db2700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cbc06eab0 0x7f1cbc099590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.053+0000 7f1cc3db2700 1 --2- 172.21.15.29:0/1964919895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cbc0ad870 0x7f1cbc0b0140 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.053+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 >> 172.21.15.29:0/1964919895 conn(0x7f1cbc0cd1e0 msgr2=0x7f1cbc06e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:35.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 shutdown_connections 2023-10-08T15:40:35.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 shutdown_connections 2023-10-08T15:40:35.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f1cc3db2700 1 -- 172.21.15.29:0/1964919895 wait complete. 2023-10-08T15:40:35.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21ec067000 msgr2=0x7f21ec0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f220f696700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21ec067000 0x7f21ec0694b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21f80030c0 tx=0x7f21f8016000 comp rx=0 tx=0).stop 2023-10-08T15:40:35.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f220815ac10 msgr2=0x7f220806eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f220f696700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f220815ac10 0x7f220806eaf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f220000cef0 tx=0x7f2200007860 comp rx=0 tx=0).stop 2023-10-08T15:40:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0bd8066f30 msgr2=0x7f0bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0bd8066f30 0x7f0bd80693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc006fd0 tx=0x7f0bdc000f90 comp rx=0 tx=0).stop 2023-10-08T15:40:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bec0cab70 msgr2=0x7f0bec0c4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.055+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bec0cab70 0x7f0bec0c4b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009fb0 tx=0x7f0be4019000 comp rx=0 tx=0).stop 2023-10-08T15:40:35.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.056+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 shutdown_connections 2023-10-08T15:40:35.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.056+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.056+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bec0cab70 0x7f0bec0c4b20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.056+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bec0adb20 0x7f0bec068160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.056+0000 7f0bf2b27700 1 --2- 172.21.15.29:0/631427722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0bec0c89d0 0x7f0bec0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.056+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 >> 172.21.15.29:0/631427722 conn(0x7f0bec06a250 msgr2=0x7f0bec0af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:35.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.057+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 shutdown_connections 2023-10-08T15:40:35.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.057+0000 7f0bf2b27700 1 -- 172.21.15.29:0/631427722 wait complete. 2023-10-08T15:40:35.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.058+0000 7f437a401700 1 -- 172.21.15.29:0/2060485440 wait complete. 2023-10-08T15:40:35.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.058+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa47c005830 con 0x7fa49806d2e0 2023-10-08T15:40:35.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.059+0000 7fa48effd700 1 -- 172.21.15.29:0/1956372738 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4800550b0 con 0x7fa49806d2e0 2023-10-08T15:40:35.059 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-08T15:40:35.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.061+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 shutdown_connections 2023-10-08T15:40:35.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.061+0000 7f220f696700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21ec067000 0x7f21ec0694b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.061+0000 7f220f696700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f220815ac10 0x7f220806eaf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.061+0000 7f220f696700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22081561e0 0x7f2208149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.061+0000 7f220f696700 1 --2- 172.21.15.29:0/942516099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22081565b0 0x7f22080c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.061+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 >> 172.21.15.29:0/942516099 conn(0x7f22080cd1e0 msgr2=0x7f2208063570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:35.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.062+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 shutdown_connections 2023-10-08T15:40:35.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.062+0000 7f220f696700 1 -- 172.21.15.29:0/942516099 wait complete. 2023-10-08T15:40:35.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.062+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa478067000 msgr2=0x7fa4780694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.062+0000 7fa49d169700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa478067000 0x7fa4780694b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa498063cd0 tx=0x7fa4880091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.062+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa49806d2e0 msgr2=0x7fa4980ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.062+0000 7fa49d169700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa49806d2e0 0x7fa4980ae970 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa48000ec80 tx=0x7fa4800091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-08T15:40:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.071+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 shutdown_connections 2023-10-08T15:40:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.071+0000 7fa49d169700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa478067000 0x7fa4780694b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.071+0000 7fa49d169700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa498155b60 0x7fa4980ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.071+0000 7fa49d169700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa49806d2e0 0x7fa4980ae970 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.071+0000 7fa49d169700 1 --2- 172.21.15.29:0/1956372738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa49806d6b0 0x7fa4980aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.071+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 >> 172.21.15.29:0/1956372738 conn(0x7fa498070700 msgr2=0x7fa498063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.071+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 shutdown_connections 2023-10-08T15:40:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.071+0000 7fa49d169700 1 -- 172.21.15.29:0/1956372738 wait complete. 2023-10-08T15:40:35.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-08T15:40:35.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-08T15:40:35.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-08T15:40:35.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.082+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f85a404c3c0 con 0x7f85a415e9b0 2023-10-08T15:40:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.082+0000 7f858bfff700 1 -- 172.21.15.29:0/4113038705 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8594083070 con 0x7f85a415e9b0 2023-10-08T15:40:35.083 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-08T15:40:35.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.083+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f02b004c3c0 con 0x7f02b00b1920 2023-10-08T15:40:35.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.083+0000 7f02acff9700 1 -- 172.21.15.29:0/2367595341 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f029c018020 con 0x7f02b00b1920 2023-10-08T15:40:35.084 INFO:teuthology.orchestra.run.smithi029.stdout:55834574853 2023-10-08T15:40:35.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-08T15:40:35.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8590067000 msgr2=0x7f85900694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8590067000 0x7f85900694b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097c0 tx=0x7f859c019000 comp rx=0 tx=0).stop 2023-10-08T15:40:35.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85a415e9b0 msgr2=0x7f85a40c02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85a415e9b0 0x7f85a40c02f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f859400c560 tx=0x7f8594007e40 comp rx=0 tx=0).stop 2023-10-08T15:40:35.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 shutdown_connections 2023-10-08T15:40:35.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8590067000 0x7f85900694b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85a415e9b0 0x7f85a40c02f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a40ccf10 0x7f85a415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 --2- 172.21.15.29:0/4113038705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a40cd2e0 0x7f85a41724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 >> 172.21.15.29:0/4113038705 conn(0x7f85a4070700 msgr2=0x7f85a40c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:35.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 shutdown_connections 2023-10-08T15:40:35.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.085+0000 7f85aa51d700 1 -- 172.21.15.29:0/4113038705 wait complete. 2023-10-08T15:40:35.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0294066fb0 msgr2=0x7f0294069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0294066fb0 0x7f0294069460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009170 tx=0x7f02a4008040 comp rx=0 tx=0).stop 2023-10-08T15:40:35.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02b00b1920 msgr2=0x7f02b00b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:35.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02b00b1920 0x7f02b00b1d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f029c00cb40 tx=0x7f029c001cf0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 shutdown_connections 2023-10-08T15:40:35.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0294066fb0 0x7f0294069460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02b00b39c0 0x7f02b00b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a00051c0 0x7f02b0164750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 --2- 172.21.15.29:0/2367595341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02b00b1920 0x7f02b00b1d90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:35.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 >> 172.21.15.29:0/2367595341 conn(0x7f02b006fdc0 msgr2=0x7f02b0150c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:35.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 shutdown_connections 2023-10-08T15:40:35.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:35.086+0000 7f02b6c1b700 1 -- 172.21.15.29:0/2367595341 wait complete. 2023-10-08T15:40:35.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-08T15:40:35.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-08T15:40:35.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-08T15:40:36.065 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T15:40:36.074 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T15:40:36.079 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T15:40:36.083 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T15:40:36.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T15:40:36.090 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T15:40:36.099 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T15:40:36.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T15:40:36.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.256+0000 7f5da71f3700 1 Processor -- start 2023-10-08T15:40:36.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.256+0000 7f5da71f3700 1 -- start start 2023-10-08T15:40:36.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.257+0000 7f5da71f3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.257+0000 7f5da71f3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5da00ccec0 0x7f5da00afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.257+0000 7f5da71f3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da00c6eb0 con 0x7f5da00ccaf0 2023-10-08T15:40:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.257+0000 7f5da71f3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da00b1270 con 0x7f5da00ccec0 2023-10-08T15:40:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.257+0000 7f5da71f3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da00b0390 con 0x7f5da0088ac0 2023-10-08T15:40:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.258+0000 7f5da4f8f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5da00ccaf0 0x7f5da00883b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43318/0 (socket says 172.21.15.29:43318) 2023-10-08T15:40:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.258+0000 7f5da4f8f700 1 -- 172.21.15.29:0/2974602600 learned_addr learned my addr 172.21.15.29:0/2974602600 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:36.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.258+0000 7f5da5790700 1 --2- 172.21.15.29:0/2974602600 >> v2:172.21.15.29:3300/0 conn(0x7f5da00ccec0 0x7f5da00afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.258+0000 7f5d9ffff700 1 --2- 172.21.15.29:0/2974602600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.260+0000 7f5da5790700 1 -- 172.21.15.29:0/2974602600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 msgr2=0x7f5da00af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.260+0000 7f5da5790700 1 --2- 172.21.15.29:0/2974602600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.260+0000 7f5da5790700 1 -- 172.21.15.29:0/2974602600 >> v1:172.21.15.29:6789/0 conn(0x7f5da00ccaf0 legacy=0x7f5da00883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.260+0000 7f5da5790700 1 -- 172.21.15.29:0/2974602600 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da00b0660 con 0x7f5da00ccec0 2023-10-08T15:40:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.260+0000 7f5da5790700 1 --2- 172.21.15.29:0/2974602600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 0x7f5da00afe50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007460 tx=0x7f5d94007200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae0398d625bae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.259+0000 7f5d9f7fe700 1 -- 172.21.15.29:0/2974602600 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093127498 0 0) 0x7f5da00c6eb0 con 0x7f5da00ccaf0 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.261+0000 7f5d9f7fe700 1 -- 172.21.15.29:0/2974602600 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d940092e0 con 0x7f5da00ccec0 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.261+0000 7f5d9f7fe700 1 -- 172.21.15.29:0/2974602600 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d94018850 con 0x7f5da00ccec0 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.261+0000 7f5d9f7fe700 1 -- 172.21.15.29:0/2974602600 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94018c10 con 0x7f5da00ccec0 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.262+0000 7f5da71f3700 1 -- 172.21.15.29:0/2974602600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 msgr2=0x7f5da00afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.262+0000 7f5da71f3700 1 --2- 172.21.15.29:0/2974602600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 0x7f5da00afe50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007460 tx=0x7f5d94007200 comp rx=0 tx=0).stop 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.262+0000 7f5da71f3700 1 -- 172.21.15.29:0/2974602600 shutdown_connections 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.262+0000 7f5da71f3700 1 --2- 172.21.15.29:0/2974602600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 0x7f5da00afe50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.262+0000 7f5da71f3700 1 --2- 172.21.15.29:0/2974602600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.262+0000 7f5da71f3700 1 -- 172.21.15.29:0/2974602600 >> 172.21.15.29:0/2974602600 conn(0x7f5da0070700 msgr2=0x7f5da0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.262+0000 7f5da71f3700 1 -- 172.21.15.29:0/2974602600 shutdown_connections 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.262+0000 7f5da71f3700 1 -- 172.21.15.29:0/2974602600 wait complete. 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.264+0000 7f5da71f3700 1 Processor -- start 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.264+0000 7f5da71f3700 1 -- start start 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.265+0000 7f5da71f3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.265+0000 7f5da71f3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da00ccaf0 0x7f5da018e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.265+0000 7f5da71f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 0x7f5da018e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.265+0000 7f5da71f3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da00a7460 con 0x7f5da00ccec0 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.265+0000 7f5da71f3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da00a6850 con 0x7f5da00ccaf0 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.265+0000 7f5da71f3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da00a6b30 con 0x7f5da0088ac0 2023-10-08T15:40:36.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.266+0000 7f5da4f8f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.266+0000 7f5da4f8f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00a9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:46100/0 (socket says 172.21.15.29:46100) 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.266+0000 7f5da4f8f700 1 -- 172.21.15.29:0/4145375676 learned_addr learned my addr 172.21.15.29:0/4145375676 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.266+0000 7f5d9ffff700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da00ccaf0 0x7f5da018e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.266+0000 7f5da5790700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 0x7f5da018e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.267+0000 7f5da4f8f700 1 -- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da00ccaf0 msgr2=0x7f5da018e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.267+0000 7f5da4f8f700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da00ccaf0 0x7f5da018e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.267+0000 7f5da4f8f700 1 -- 172.21.15.29:0/4145375676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 msgr2=0x7f5da018e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.267+0000 7f5da4f8f700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 0x7f5da018e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.267+0000 7f5da4f8f700 1 -- 172.21.15.29:0/4145375676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940094d0 con 0x7f5da0088ac0 2023-10-08T15:40:36.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.267+0000 7f5da4f8f700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00a9270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800ccc0 tx=0x7f5d98001a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.268+0000 7f5d9cff9700 1 -- 172.21.15.29:0/4145375676 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800a8e0 con 0x7f5da0088ac0 2023-10-08T15:40:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.268+0000 7f5d9cff9700 1 -- 172.21.15.29:0/4145375676 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9800aa40 con 0x7f5da0088ac0 2023-10-08T15:40:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.268+0000 7f5d9cff9700 1 -- 172.21.15.29:0/4145375676 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800ae00 con 0x7f5da0088ac0 2023-10-08T15:40:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.268+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da00a6e10 con 0x7f5da0088ac0 2023-10-08T15:40:36.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.268+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da00a97b0 con 0x7f5da0088ac0 2023-10-08T15:40:36.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.272+0000 7f5d9cff9700 1 -- 172.21.15.29:0/4145375676 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d98007300 con 0x7f5da0088ac0 2023-10-08T15:40:36.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.272+0000 7f5d9cff9700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d8c067080 0x7f5d8c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.273+0000 7f5d9cff9700 1 -- 172.21.15.29:0/4145375676 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d98084860 con 0x7f5da0088ac0 2023-10-08T15:40:36.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.273+0000 7f5d9ffff700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d8c067080 0x7f5d8c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.274+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d800052b0 con 0x7f5da0088ac0 2023-10-08T15:40:36.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.275+0000 7f5d9ffff700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d8c067080 0x7f5d8c069530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5da018d4d0 tx=0x7f5d9000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.280+0000 7f5d9cff9700 1 -- 172.21.15.29:0/4145375676 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d98051b30 con 0x7f5da0088ac0 2023-10-08T15:40:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.313+0000 7f389d59e700 1 Processor -- start 2023-10-08T15:40:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.313+0000 7f389d59e700 1 -- start start 2023-10-08T15:40:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.315+0000 7f389d59e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3898069560 0x7f38980cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.315+0000 7f389d59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980caba0 con 0x7f38980aec00 2023-10-08T15:40:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.315+0000 7f389d59e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3898069c70 con 0x7f38980cbe60 2023-10-08T15:40:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.315+0000 7f389d59e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980cc5d0 con 0x7f3898069560 2023-10-08T15:40:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.315+0000 7f38977fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3898069560 0x7f38980cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.315+0000 7f38977fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3898069560 0x7f38980cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56622/0 (socket says 172.21.15.29:56622) 2023-10-08T15:40:36.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.315+0000 7f38977fe700 1 -- 172.21.15.29:0/4123448610 learned_addr learned my addr 172.21.15.29:0/4123448610 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517526626 0 0) 0x7f38980caba0 con 0x7f38980aec00 2023-10-08T15:40:36.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3880003570 con 0x7f38980aec00 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323956442 0 0) 0x7f3898069c70 con 0x7f38980cbe60 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38980caba0 con 0x7f38980cbe60 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2758592400 0 0) 0x7f3880003570 con 0x7f38980aec00 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 >> v2:172.21.15.183:3300/0 conn(0x7f3898069560 msgr2=0x7f38980cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 --2- 172.21.15.29:0/4123448610 >> v2:172.21.15.183:3300/0 conn(0x7f3898069560 0x7f38980cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 >> v1:172.21.15.183:6789/0 conn(0x7f38980cbe60 legacy=0x7f3898088080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980cc2f0 con 0x7f38980aec00 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.316+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f38900017f0 con 0x7f38980aec00 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 >> v1:172.21.15.29:6789/0 conn(0x7f38980aec00 legacy=0x7f3898068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3895ffb700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3880006250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3895ffb700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38800068c0 0x7f3880008d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3895ffb700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3880009460 0x7f388000b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980cc5d0 con 0x7f3880003e50 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388000c1f0 con 0x7f38800068c0 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388000c3b0 con 0x7f3880009460 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3896ffd700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3880006250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3896ffd700 1 -- 172.21.15.29:0/4123448610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3880009460 msgr2=0x7f388000b910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3896ffd700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3880009460 0x7f388000b910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3896ffd700 1 -- 172.21.15.29:0/4123448610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38800068c0 msgr2=0x7f3880008d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f38967fc700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38800068c0 0x7f3880008d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3896ffd700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38800068c0 0x7f3880008d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f3896ffd700 1 -- 172.21.15.29:0/4123448610 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980cc2f0 con 0x7f3880003e50 2023-10-08T15:40:36.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.317+0000 7f38967fc700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38800068c0 0x7f3880008d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:36.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.318+0000 7f3896ffd700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3880006250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f389000c640 tx=0x7f3890002e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8960e17c49663c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.318+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890016070 con 0x7f3880003e50 2023-10-08T15:40:36.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.318+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890006ba0 con 0x7f3880003e50 2023-10-08T15:40:36.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.318+0000 7f3895ffb700 1 -- 172.21.15.29:0/4123448610 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890003130 con 0x7f3880003e50 2023-10-08T15:40:36.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.319+0000 7f389d59e700 1 -- 172.21.15.29:0/4123448610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 msgr2=0x7f3880006250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.319+0000 7f389d59e700 1 --2- 172.21.15.29:0/4123448610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3880006250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f389000c640 tx=0x7f3890002e20 comp rx=0 tx=0).stop 2023-10-08T15:40:36.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.319+0000 7f38977fe700 1 -- 172.21.15.29:0/4123448610 reap_dead start 2023-10-08T15:40:36.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.319+0000 7f34ed7a5700 1 Processor -- start 2023-10-08T15:40:36.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.320+0000 7f34ed7a5700 1 -- start start 2023-10-08T15:40:36.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.320+0000 7f389d59e700 1 -- 172.21.15.29:0/4123448610 shutdown_connections 2023-10-08T15:40:36.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.320+0000 7f389d59e700 1 -- 172.21.15.29:0/4123448610 >> 172.21.15.29:0/4123448610 conn(0x7f3898067660 msgr2=0x7f3898067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.320+0000 7f389d59e700 1 -- 172.21.15.29:0/4123448610 shutdown_connections 2023-10-08T15:40:36.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.320+0000 7f389d59e700 1 -- 172.21.15.29:0/4123448610 wait complete. 2023-10-08T15:40:36.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7fd1d79f1700 1 Processor -- start 2023-10-08T15:40:36.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7fd1d79f1700 1 -- start start 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34ed7a5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34e81569e0 0x7f34e8067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34ed7a5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34ed7a5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f34e806d330 0x7f34e80ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34ed7a5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e815a870 con 0x7f34e81569e0 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34ed7a5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80ac4d0 con 0x7f34e806d330 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34ed7a5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8068010 con 0x7f34e8067ba0 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34e7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34e81569e0 0x7f34e8067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34e7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34e81569e0 0x7f34e8067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33832/0 (socket says 172.21.15.29:33832) 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34e7fff700 1 -- 172.21.15.29:0/4180735706 learned_addr learned my addr 172.21.15.29:0/4180735706 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34ecfa4700 1 --2- 172.21.15.29:0/4180735706 >> v2:172.21.15.183:3300/0 conn(0x7f34e806d330 0x7f34e80ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.321+0000 7f34e77fe700 1 --2- 172.21.15.29:0/4180735706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f34e7fff700 1 -- 172.21.15.29:0/4180735706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 msgr2=0x7f34e806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f34e7fff700 1 --2- 172.21.15.29:0/4180735706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e806cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f34e7fff700 1 -- 172.21.15.29:0/4180735706 >> v2:172.21.15.183:3300/0 conn(0x7f34e806d330 msgr2=0x7f34e80ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f34e7fff700 1 --2- 172.21.15.29:0/4180735706 >> v2:172.21.15.183:3300/0 conn(0x7f34e806d330 0x7f34e80ab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f34e7fff700 1 -- 172.21.15.29:0/4180735706 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8158310 con 0x7f34e81569e0 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f34e7fff700 1 --2- 172.21.15.29:0/4180735706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e81569e0 0x7f34e8067660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34e8068680 tx=0x7f34dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cda3624e0caf1b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7fd1d79f1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd1d00bf970 0x7fd1d00bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7fd1d79f1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd1d00ac1a0 0x7fd1d00ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7fd1d79f1700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d00acb40 con 0x7fd1d006d4c0 2023-10-08T15:40:36.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7fd1d79f1700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d00c7960 con 0x7fd1d00ac1a0 2023-10-08T15:40:36.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7fd1d79f1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d00c7c40 con 0x7fd1d00bf970 2023-10-08T15:40:36.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f21e7119700 1 Processor -- start 2023-10-08T15:40:36.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7fd1d578d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd1d00bf970 0x7fd1d00bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f21e7119700 1 -- start start 2023-10-08T15:40:36.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f389d59e700 1 Processor -- start 2023-10-08T15:40:36.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.322+0000 7f389d59e700 1 -- start start 2023-10-08T15:40:36.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7fd1d578d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd1d00bf970 0x7fd1d00bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56642/0 (socket says 172.21.15.29:56642) 2023-10-08T15:40:36.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7fd1d578d700 1 -- 172.21.15.29:0/3778128678 learned_addr learned my addr 172.21.15.29:0/3778128678 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7fd1d578d700 1 -- 172.21.15.29:0/3778128678 >> v2:172.21.15.29:3300/0 conn(0x7fd1d00ac1a0 msgr2=0x7fd1d00ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7fd1d578d700 1 --2- 172.21.15.29:0/3778128678 >> v2:172.21.15.29:3300/0 conn(0x7fd1d00ac1a0 0x7fd1d00ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7fd1d578d700 1 -- 172.21.15.29:0/3778128678 >> v1:172.21.15.183:6789/0 conn(0x7fd1d006d4c0 legacy=0x7fd1d006ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T15:40:36.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7fd1d578d700 1 -- 172.21.15.29:0/3778128678 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00c7f20 con 0x7fd1d00bf970 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f389d59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3898176f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f389d59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38980c4840 0x7f38980c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f389d59e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38980b10d0 0x7f38980b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f389d59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980c5630 con 0x7f3880003e50 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f389d59e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980b0c40 con 0x7f38980b10d0 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f389d59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980c5350 con 0x7f38980c4840 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f3896ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3898176f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f3896ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3898176f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33848/0 (socket says 172.21.15.29:33848) 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f3896ffd700 1 -- 172.21.15.29:0/5371436 learned_addr learned my addr 172.21.15.29:0/5371436 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f38967fc700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38980c4840 0x7f38980c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7f38977fe700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38980b10d0 0x7f38980b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.323+0000 7fd1d578d700 1 --2- 172.21.15.29:0/3778128678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d00bf970 0x7fd1d00bfd40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0099b0 tx=0x7fd1cc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e674dfcc6c6bba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f38967fc700 1 -- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38980b10d0 msgr2=0x7f38980b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f38967fc700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38980b10d0 0x7f38980b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f38967fc700 1 -- 172.21.15.29:0/5371436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 msgr2=0x7f3898176f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f38967fc700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3898176f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f38967fc700 1 -- 172.21.15.29:0/5371436 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980b05f0 con 0x7f38980c4840 2023-10-08T15:40:36.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f38967fc700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38980c4840 0x7f38980c4cb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d8b0 tx=0x7f388c009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7fd1c7fff700 1 -- 172.21.15.29:0/3778128678 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00b7e0 con 0x7fd1d00bf970 2023-10-08T15:40:36.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7fd1c7fff700 1 -- 172.21.15.29:0/3778128678 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc00b940 con 0x7fd1d00bf970 2023-10-08T15:40:36.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7fd1c7fff700 1 -- 172.21.15.29:0/3778128678 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00bcc0 con 0x7fd1d00bf970 2023-10-08T15:40:36.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7fd1d79f1700 1 -- 172.21.15.29:0/3778128678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d00bf970 msgr2=0x7fd1d00bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f34e6ffd700 1 -- 172.21.15.29:0/4180735706 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00b8f0 con 0x7f34e81569e0 2023-10-08T15:40:36.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f34e6ffd700 1 -- 172.21.15.29:0/4180735706 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00ba50 con 0x7f34e81569e0 2023-10-08T15:40:36.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f34e6ffd700 1 -- 172.21.15.29:0/4180735706 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00bdf0 con 0x7f34e81569e0 2023-10-08T15:40:36.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f052f226700 1 Processor -- start 2023-10-08T15:40:36.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f052f226700 1 -- start start 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e7119700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f21e006f260 0x7f21e00c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e7119700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e7119700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e015ddc0 con 0x7f21e006ee90 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e7119700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e015a750 con 0x7f21e006f260 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e7119700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015e940 con 0x7f21e00cd3d0 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e4eb5700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f21e006ee90 0x7f21e00cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43336/0 (socket says 172.21.15.29:43336) 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e4eb5700 1 -- 172.21.15.29:0/2175182840 learned_addr learned my addr 172.21.15.29:0/2175182840 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e56b6700 1 --2- 172.21.15.29:0/2175182840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21dffff700 1 --2- 172.21.15.29:0/2175182840 >> v2:172.21.15.183:3300/0 conn(0x7f21e006f260 0x7f21e00c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e56b6700 1 -- 172.21.15.29:0/2175182840 >> v2:172.21.15.183:3300/0 conn(0x7f21e006f260 msgr2=0x7f21e00c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e56b6700 1 --2- 172.21.15.29:0/2175182840 >> v2:172.21.15.183:3300/0 conn(0x7f21e006f260 0x7f21e00c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e56b6700 1 -- 172.21.15.29:0/2175182840 >> v1:172.21.15.29:6789/0 conn(0x7f21e006ee90 legacy=0x7f21e00cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21e56b6700 1 -- 172.21.15.29:0/2175182840 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e015e010 con 0x7f21e00cd3d0 2023-10-08T15:40:36.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.324+0000 7f21df7fe700 1 -- 172.21.15.29:0/2175182840 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067928718 0 0) 0x7f21e015ddc0 con 0x7f21e006ee90 2023-10-08T15:40:36.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f21e56b6700 1 --2- 172.21.15.29:0/2175182840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00c9ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f21c80098e0 tx=0x7f21c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce95bb1e5624f6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/3778128678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d00bf970 0x7fd1d00bfd40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0099b0 tx=0x7fd1cc009250 comp rx=0 tx=0).stop 2023-10-08T15:40:36.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 -- 172.21.15.29:0/4180735706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e81569e0 msgr2=0x7f34e8067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/4180735706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e81569e0 0x7f34e8067660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34e8068680 tx=0x7f34dc009250 comp rx=0 tx=0).stop 2023-10-08T15:40:36.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f7b1c305700 1 Processor -- start 2023-10-08T15:40:36.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 -- 172.21.15.29:0/4180735706 shutdown_connections 2023-10-08T15:40:36.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/4180735706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e81569e0 0x7f34e8067660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/4180735706 >> v2:172.21.15.183:3300/0 conn(0x7f34e806d330 0x7f34e80ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/4180735706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e806cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 -- 172.21.15.29:0/4180735706 >> 172.21.15.29:0/4180735706 conn(0x7f34e80cc760 msgr2=0x7f34e80ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f21df7fe700 1 -- 172.21.15.29:0/2175182840 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800b640 con 0x7f21e00cd3d0 2023-10-08T15:40:36.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f21df7fe700 1 -- 172.21.15.29:0/2175182840 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800b7a0 con 0x7f21e00cd3d0 2023-10-08T15:40:36.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f21df7fe700 1 -- 172.21.15.29:0/2175182840 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800bb40 con 0x7f21e00cd3d0 2023-10-08T15:40:36.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 -- 172.21.15.29:0/4180735706 shutdown_connections 2023-10-08T15:40:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7fd1d79f1700 1 -- 172.21.15.29:0/3778128678 shutdown_connections 2023-10-08T15:40:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/3778128678 >> v2:172.21.15.29:3300/0 conn(0x7fd1d00ac1a0 0x7fd1d00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/3778128678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d00bf970 0x7fd1d00bfd40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7fd1d79f1700 1 -- 172.21.15.29:0/3778128678 >> 172.21.15.29:0/3778128678 conn(0x7fd1d0067660 msgr2=0x7fd1d0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7fd1d79f1700 1 -- 172.21.15.29:0/3778128678 shutdown_connections 2023-10-08T15:40:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7fd1d79f1700 1 -- 172.21.15.29:0/3778128678 wait complete. 2023-10-08T15:40:36.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f7b1c305700 1 -- start start 2023-10-08T15:40:36.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f052f226700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280ccfb0 0x7f05280af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f052f226700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05280c6eb0 con 0x7f0528088800 2023-10-08T15:40:36.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f052f226700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05280b1270 con 0x7f05280afe50 2023-10-08T15:40:36.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f052f226700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05280b0940 con 0x7f05280ccfb0 2023-10-08T15:40:36.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.325+0000 7f34ed7a5700 1 -- 172.21.15.29:0/4180735706 wait complete. 2023-10-08T15:40:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f21e7119700 1 -- 172.21.15.29:0/2175182840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 msgr2=0x7f21e00c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f21e7119700 1 --2- 172.21.15.29:0/2175182840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00c9ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f21c80098e0 tx=0x7f21c80091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f21e7119700 1 -- 172.21.15.29:0/2175182840 shutdown_connections 2023-10-08T15:40:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f21e7119700 1 --2- 172.21.15.29:0/2175182840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00c9ac0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f21e7119700 1 --2- 172.21.15.29:0/2175182840 >> v2:172.21.15.183:3300/0 conn(0x7f21e006f260 0x7f21e00c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f21e7119700 1 -- 172.21.15.29:0/2175182840 >> 172.21.15.29:0/2175182840 conn(0x7f21e0070700 msgr2=0x7f21e0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f052d7c3700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f05280afe50 0x7f05280b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54314/0 (socket says 172.21.15.29:54314) 2023-10-08T15:40:36.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f052d7c3700 1 -- 172.21.15.29:0/388841175 learned_addr learned my addr 172.21.15.29:0/388841175 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f21e7119700 1 -- 172.21.15.29:0/2175182840 shutdown_connections 2023-10-08T15:40:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f21e7119700 1 -- 172.21.15.29:0/2175182840 wait complete. 2023-10-08T15:40:36.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f0527fff700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280ccfb0 0x7f05280af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f7b1c305700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1415e180 0x7f7b1406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f7b1c305700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b140cfcc0 con 0x7f7b1415e550 2023-10-08T15:40:36.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f7b1c305700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b140b64e0 con 0x7f7b140b6970 2023-10-08T15:40:36.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f7b1c305700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140b51c0 con 0x7f7b1415e180 2023-10-08T15:40:36.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7fd1d79f1700 1 Processor -- start 2023-10-08T15:40:36.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f34ed7a5700 1 Processor -- start 2023-10-08T15:40:36.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.326+0000 7f7b1a8a2700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f7b140b6970 0x7f7b14167f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:54326/0 (socket says 172.21.15.29:54326) 2023-10-08T15:40:36.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f7b1a8a2700 1 -- 172.21.15.29:0/4029424221 learned_addr learned my addr 172.21.15.29:0/4029424221 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:36.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f7b1a0a1700 1 --2- 172.21.15.29:0/4029424221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1415e180 0x7f7b1406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852536351 0 0) 0x7f05280c6eb0 con 0x7f0528088800 2023-10-08T15:40:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0510003570 con 0x7f0528088800 2023-10-08T15:40:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f7b1a0a1700 1 -- 172.21.15.29:0/4029424221 >> v1:172.21.15.183:6789/0 conn(0x7f7b140b6970 legacy=0x7f7b14167f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f7b1909f700 1 -- 172.21.15.29:0/4029424221 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160558905 0 0) 0x7f7b08001490 con 0x7f7b1415e550 2023-10-08T15:40:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f7b1a0a1700 1 -- 172.21.15.29:0/4029424221 >> v1:172.21.15.29:6789/0 conn(0x7f7b1415e550 legacy=0x7f7b1406aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f7b1a0a1700 1 -- 172.21.15.29:0/4029424221 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b140b55f0 con 0x7f7b1415e180 2023-10-08T15:40:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7fd1d79f1700 1 -- start start 2023-10-08T15:40:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374972962 0 0) 0x7f0510003570 con 0x7f0528088800 2023-10-08T15:40:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280ccfb0 msgr2=0x7f05280af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280ccfb0 0x7f05280af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 >> v1:172.21.15.183:6789/0 conn(0x7f05280afe50 legacy=0x7f05280b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280b0c20 con 0x7f0528088800 2023-10-08T15:40:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f0518001470 con 0x7f0528088800 2023-10-08T15:40:36.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 >> v1:172.21.15.29:6789/0 conn(0x7f0528088800 legacy=0x7f05280cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510003a90 0x7f0510003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0510004810 0x7f0510004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0510005210 0x7f051000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05280b0940 con 0x7f0510005210 2023-10-08T15:40:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510014910 con 0x7f0510003a90 2023-10-08T15:40:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0510014ad0 con 0x7f0510004810 2023-10-08T15:40:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f052d7c3700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0510005210 0x7f051000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f7b1a0a1700 1 --2- 172.21.15.29:0/4029424221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1415e180 0x7f7b1406a520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009910 tx=0x7f7b0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1ebe96e86a8bf51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f7b1909f700 1 -- 172.21.15.29:0/4029424221 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00b860 con 0x7f7b1415e180 2023-10-08T15:40:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f7b1909f700 1 -- 172.21.15.29:0/4029424221 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c00b9c0 con 0x7f7b1415e180 2023-10-08T15:40:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f7b1909f700 1 -- 172.21.15.29:0/4029424221 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00bd60 con 0x7f7b1415e180 2023-10-08T15:40:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f052cfc2700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510003a90 0x7f0510003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d79f1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d006d4c0 0x7fd1d01494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d79f1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1d00ac1a0 0x7fd1d00c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d79f1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00bf970 0x7fd1d00c0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d79f1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00c4290 con 0x7fd1d00bf970 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d79f1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00c2dc0 con 0x7fd1d006d4c0 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d79f1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00c30a0 con 0x7fd1d00ac1a0 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d5f8e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00bf970 0x7fd1d00c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d5f8e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00bf970 0x7fd1d00c0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33870/0 (socket says 172.21.15.29:33870) 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d5f8e700 1 -- 172.21.15.29:0/2173390161 learned_addr learned my addr 172.21.15.29:0/2173390161 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d578d700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d006d4c0 0x7fd1d01494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7fd1d4f8c700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1d00ac1a0 0x7fd1d00c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.327+0000 7f34ed7a5700 1 -- start start 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34ed7a5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34ed7a5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e806d330 0x7f34e816a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34ed7a5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e81569e0 0x7f34e80c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34ed7a5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e816d9d0 con 0x7f34e806d330 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34ed7a5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e816a910 con 0x7f34e81569e0 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34ed7a5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c2980 con 0x7f34e8067ba0 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34e7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34e7fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e80b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:46152/0 (socket says 172.21.15.29:46152) 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34e7fff700 1 -- 172.21.15.29:0/2265003737 learned_addr learned my addr 172.21.15.29:0/2265003737 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f34e77fe700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e806d330 0x7f34e816a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f052d7c3700 1 -- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0510004810 msgr2=0x7f0510004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T15:40:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f052d7c3700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0510004810 0x7f0510004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f052d7c3700 1 -- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510003a90 msgr2=0x7f0510003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f052d7c3700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0510003a90 0x7f0510003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f052d7c3700 1 -- 172.21.15.29:0/388841175 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280b0c20 con 0x7f0510005210 2023-10-08T15:40:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f052d7c3700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0510005210 0x7f051000ba60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0520008ca0 tx=0x7f05200052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab27bd3acf8c883 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.328+0000 7f21e7119700 1 Processor -- start 2023-10-08T15:40:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f34e7fff700 1 -- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e81569e0 msgr2=0x7f34e80c2440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T15:40:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f34e7fff700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e81569e0 0x7f34e80c2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f7b1c305700 1 -- 172.21.15.29:0/4029424221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1415e180 msgr2=0x7f7b1406a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f7b1c305700 1 --2- 172.21.15.29:0/4029424221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1415e180 0x7f7b1406a520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009910 tx=0x7f7b0c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f34e7fff700 1 -- 172.21.15.29:0/2265003737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e806d330 msgr2=0x7f34e816a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f34e7fff700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e806d330 0x7f34e816a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f34e7fff700 1 -- 172.21.15.29:0/2265003737 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc0094f0 con 0x7f34e8067ba0 2023-10-08T15:40:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7fd1d5f8e700 1 -- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1d00ac1a0 msgr2=0x7fd1d00c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7fd1d5f8e700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1d00ac1a0 0x7fd1d00c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7fd1d5f8e700 1 -- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d006d4c0 msgr2=0x7fd1d01494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7fd1d5f8e700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d006d4c0 0x7fd1d01494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7fd1d5f8e700 1 -- 172.21.15.29:0/2173390161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0094f0 con 0x7fd1d00bf970 2023-10-08T15:40:36.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7fd1d578d700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d006d4c0 0x7fd1d01494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f7b1c305700 1 -- 172.21.15.29:0/4029424221 shutdown_connections 2023-10-08T15:40:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f7b1c305700 1 --2- 172.21.15.29:0/4029424221 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1415e180 0x7f7b1406a520 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f7b1c305700 1 -- 172.21.15.29:0/4029424221 >> 172.21.15.29:0/4029424221 conn(0x7f7b14068ce0 msgr2=0x7f7b140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f21e7119700 1 -- start start 2023-10-08T15:40:36.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f7b1c305700 1 -- 172.21.15.29:0/4029424221 shutdown_connections 2023-10-08T15:40:36.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7fd1d5f8e700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00bf970 0x7fd1d00c0340 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800bc30 tx=0x7fd1c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f7b1c305700 1 -- 172.21.15.29:0/4029424221 wait complete. 2023-10-08T15:40:36.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520008110 con 0x7f0510005210 2023-10-08T15:40:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0520008290 con 0x7f0510005210 2023-10-08T15:40:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f05277fe700 1 -- 172.21.15.29:0/388841175 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520001c30 con 0x7f0510005210 2023-10-08T15:40:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f052f226700 1 -- 172.21.15.29:0/388841175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0510005210 msgr2=0x7f051000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f052f226700 1 --2- 172.21.15.29:0/388841175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0510005210 0x7f051000ba60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0520008ca0 tx=0x7f05200052a0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f052d7c3700 1 -- 172.21.15.29:0/388841175 reap_dead start 2023-10-08T15:40:36.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.329+0000 7f34e7fff700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e80b2030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34e8071440 tx=0x7f34dc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f052f226700 1 -- 172.21.15.29:0/388841175 shutdown_connections 2023-10-08T15:40:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f052f226700 1 -- 172.21.15.29:0/388841175 >> 172.21.15.29:0/388841175 conn(0x7f0528070700 msgr2=0x7f0528070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f052f226700 1 -- 172.21.15.29:0/388841175 shutdown_connections 2023-10-08T15:40:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f052f226700 1 -- 172.21.15.29:0/388841175 wait complete. 2023-10-08T15:40:36.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21e7119700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e006ee90 0x7f21e01569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21e7119700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21e006f260 0x7f21e015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21e7119700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21e7119700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e016bc50 con 0x7f21e006f260 2023-10-08T15:40:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21e7119700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0156f30 con 0x7f21e006ee90 2023-10-08T15:40:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21e7119700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e016b620 con 0x7f21e00cd3d0 2023-10-08T15:40:36.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f387effd700 1 -- 172.21.15.29:0/5371436 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c006820 con 0x7f38980c4840 2023-10-08T15:40:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21dffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21e006f260 0x7f21e015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21dffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21e006f260 0x7f21e015b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33872/0 (socket says 172.21.15.29:33872) 2023-10-08T15:40:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21dffff700 1 -- 172.21.15.29:0/156407471 learned_addr learned my addr 172.21.15.29:0/156407471 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f21e4eb5700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e006ee90 0x7f21e01569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f387effd700 1 -- 172.21.15.29:0/5371436 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c0069a0 con 0x7f38980c4840 2023-10-08T15:40:36.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.330+0000 7f387effd700 1 -- 172.21.15.29:0/5371436 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c006d60 con 0x7f38980c4840 2023-10-08T15:40:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f7b1c305700 1 Processor -- start 2023-10-08T15:40:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f7b1c305700 1 -- start start 2023-10-08T15:40:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7fd1c57fa700 1 -- 172.21.15.29:0/2173390161 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80092e0 con 0x7fd1d00bf970 2023-10-08T15:40:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7fd1c57fa700 1 -- 172.21.15.29:0/2173390161 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c800c630 con 0x7fd1d00bf970 2023-10-08T15:40:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7fd1c57fa700 1 -- 172.21.15.29:0/2173390161 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c800ca10 con 0x7fd1d00bf970 2023-10-08T15:40:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d00c3380 con 0x7fd1d00bf970 2023-10-08T15:40:36.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d01499e0 con 0x7fd1d00bf970 2023-10-08T15:40:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38980b08d0 con 0x7f38980c4840 2023-10-08T15:40:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38981655f0 con 0x7f38980c4840 2023-10-08T15:40:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f34cffff700 1 -- 172.21.15.29:0/2265003737 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc024440 con 0x7f34e8067ba0 2023-10-08T15:40:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f34cffff700 1 -- 172.21.15.29:0/2265003737 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc0245a0 con 0x7f34e8067ba0 2023-10-08T15:40:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f34cffff700 1 -- 172.21.15.29:0/2265003737 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc024960 con 0x7f34e8067ba0 2023-10-08T15:40:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e816ab90 con 0x7f34e8067ba0 2023-10-08T15:40:36.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e816b150 con 0x7f34e8067ba0 2023-10-08T15:40:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f21e56b6700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f21e56b6700 1 -- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e006ee90 msgr2=0x7f21e01569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f21e56b6700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e006ee90 0x7f21e01569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f21e56b6700 1 -- 172.21.15.29:0/156407471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21e006f260 msgr2=0x7f21e015b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f21e56b6700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21e006f260 0x7f21e015b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f21e56b6700 1 -- 172.21.15.29:0/156407471 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8009420 con 0x7f21e00cd3d0 2023-10-08T15:40:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.332+0000 7f7b1c305700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b140b6970 0x7f7b140b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.332+0000 7f7b1c305700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1415e180 0x7f7b1414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.332+0000 7f7b1c305700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1415e550 0x7f7b14150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.332+0000 7f7b1c305700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1415f9d0 con 0x7f7b1415e180 2023-10-08T15:40:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.332+0000 7f7b1c305700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1415fe60 con 0x7f7b1415e550 2023-10-08T15:40:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.332+0000 7f7b1c305700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1415edc0 con 0x7f7b140b6970 2023-10-08T15:40:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.332+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980b0a60 con 0x7f38980c4840 2023-10-08T15:40:36.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.331+0000 7f052f226700 1 Processor -- start 2023-10-08T15:40:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.332+0000 7f052f226700 1 -- start start 2023-10-08T15:40:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a0a1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b140b6970 0x7f7b140b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1415e550 0x7f7b14150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1415e550 0x7f7b14150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56724/0 (socket says 172.21.15.29:56724) 2023-10-08T15:40:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 -- 172.21.15.29:0/3606678642 learned_addr learned my addr 172.21.15.29:0/3606678642 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a0a1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b140b6970 0x7f7b140b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:46194/0 (socket says 172.21.15.29:46194) 2023-10-08T15:40:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b198a0700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1415e180 0x7f7b1414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 -- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b140b6970 msgr2=0x7f7b140b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f21e56b6700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00ae0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f21c8016000 tx=0x7f21c8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b140b6970 0x7f7b140b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 -- 172.21.15.29:0/3606678642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1415e180 msgr2=0x7f7b1414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1415e180 0x7f7b1414eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 -- 172.21.15.29:0/3606678642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c009420 con 0x7f7b1415e550 2023-10-08T15:40:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b198a0700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1415e180 0x7f7b1414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f052f226700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0528169180 0x7f05280c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f052f226700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05280c9c40 0x7f05280c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f052f226700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280c7bc0 0x7f05280c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f052f226700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05280c8030 con 0x7f05280c9c40 2023-10-08T15:40:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f052f226700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05280c5940 con 0x7f0528169180 2023-10-08T15:40:36.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f052f226700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05280c5c20 con 0x7f05280c7bc0 2023-10-08T15:40:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c80052b0 con 0x7f34e8067ba0 2023-10-08T15:40:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f7b1a8a2700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1415e550 0x7f7b14150420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c590 tx=0x7f7b00007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f0527fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05280c9c40 0x7f05280c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f052cfc2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0528169180 0x7f05280c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7f0527fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05280c9c40 0x7f05280c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33888/0 (socket says 172.21.15.29:33888) 2023-10-08T15:40:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f0527fff700 1 -- 172.21.15.29:0/578058512 learned_addr learned my addr 172.21.15.29:0/578058512 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f052d7c3700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280c7bc0 0x7f05280c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f7b127fc700 1 -- 172.21.15.29:0/3606678642 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00005c00 con 0x7f7b1415e550 2023-10-08T15:40:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f7b127fc700 1 -- 172.21.15.29:0/3606678642 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b00005d60 con 0x7f7b1415e550 2023-10-08T15:40:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f7b127fc700 1 -- 172.21.15.29:0/3606678642 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00007320 con 0x7f7b1415e550 2023-10-08T15:40:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f21dcff9700 1 -- 172.21.15.29:0/156407471 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c801be70 con 0x7f21e00cd3d0 2023-10-08T15:40:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f21dcff9700 1 -- 172.21.15.29:0/156407471 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8011420 con 0x7f21e00cd3d0 2023-10-08T15:40:36.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f21dcff9700 1 -- 172.21.15.29:0/156407471 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80117e0 con 0x7f21e00cd3d0 2023-10-08T15:40:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f387effd700 1 -- 172.21.15.29:0/5371436 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f388c007240 con 0x7f38980c4840 2023-10-08T15:40:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f387effd700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3884067080 0x7f3884069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f387effd700 1 -- 172.21.15.29:0/5371436 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f388c084290 con 0x7f38980c4840 2023-10-08T15:40:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.333+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b00052b0 con 0x7fd1d00bf970 2023-10-08T15:40:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f34cffff700 1 -- 172.21.15.29:0/2265003737 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34dc024d50 con 0x7f34e8067ba0 2023-10-08T15:40:36.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f34cffff700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f34d4067080 0x7f34d4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f34cffff700 1 -- 172.21.15.29:0/2265003737 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34dc0861f0 con 0x7f34e8067ba0 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f34e77fe700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f34d4067080 0x7f34d4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.336+0000 7f34e77fe700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f34d4067080 0x7f34d4069530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34e806eac0 tx=0x7f34e00097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f052cfc2700 1 -- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280c7bc0 msgr2=0x7f05280c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f052cfc2700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280c7bc0 0x7f05280c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f052cfc2700 1 -- 172.21.15.29:0/578058512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05280c9c40 msgr2=0x7f05280c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f052cfc2700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05280c9c40 0x7f05280c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f052cfc2700 1 -- 172.21.15.29:0/578058512 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280c5f00 con 0x7f0528169180 2023-10-08T15:40:36.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.335+0000 7f052cfc2700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0528169180 0x7f05280c6e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f051800e8a0 tx=0x7f0518009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.336+0000 7f0524ff9700 1 -- 172.21.15.29:0/578058512 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518013560 con 0x7f0528169180 2023-10-08T15:40:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.336+0000 7f0524ff9700 1 -- 172.21.15.29:0/578058512 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518010040 con 0x7f0528169180 2023-10-08T15:40:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.336+0000 7f0524ff9700 1 -- 172.21.15.29:0/578058512 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518013930 con 0x7f0528169180 2023-10-08T15:40:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1415f0a0 con 0x7f7b1415e550 2023-10-08T15:40:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1415f660 con 0x7f7b1415e550 2023-10-08T15:40:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.336+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1415fb80 con 0x7f7b1415e550 2023-10-08T15:40:36.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e015c000 con 0x7f21e00cd3d0 2023-10-08T15:40:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.334+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e015bcf0 con 0x7f21e00cd3d0 2023-10-08T15:40:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.337+0000 7fd1c57fa700 1 -- 172.21.15.29:0/2173390161 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1c8012070 con 0x7fd1d00bf970 2023-10-08T15:40:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.337+0000 7f3896ffd700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3884067080 0x7f3884069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.371 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.337+0000 7fd1c57fa700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd1b4067000 0x7fd1b40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.337+0000 7f3896ffd700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3884067080 0x7f3884069530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f389000d010 tx=0x7f3890016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.337+0000 7fd1c57fa700 1 -- 172.21.15.29:0/2173390161 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1c80841b0 con 0x7fd1d00bf970 2023-10-08T15:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.337+0000 7f7b127fc700 1 -- 172.21.15.29:0/3606678642 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b0001b3b0 con 0x7f7b1415e550 2023-10-08T15:40:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05280c61e0 con 0x7f0528169180 2023-10-08T15:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05280c7340 con 0x7f0528169180 2023-10-08T15:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7f7b127fc700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7af8067000 0x7f7af80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c40052b0 con 0x7f21e00cd3d0 2023-10-08T15:40:36.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7fd1d578d700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd1b4067000 0x7fd1b40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7f7b127fc700 1 -- 172.21.15.29:0/3606678642 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b00083c80 con 0x7f7b1415e550 2023-10-08T15:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7f7b1a0a1700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7af8067000 0x7f7af80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7fd1d578d700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd1b4067000 0x7fd1b40694b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0099b0 tx=0x7fd1cc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.374 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.338+0000 7f7b1a0a1700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7af8067000 0x7f7af80694b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0093f0 tx=0x7f7b0c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.339+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052804c3c0 con 0x7f0528169180 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.340+0000 7fd76b836700 1 Processor -- start 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.340+0000 7fd76b836700 1 -- start start 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd76b836700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7640af1e0 0x7fd7640b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd76b836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640b1680 0x7fd764159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd76b836700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640b2890 con 0x7fd7640af5b0 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd76b836700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7640b1c80 con 0x7fd7640af1e0 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd76b836700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640b1f60 con 0x7fd7640b1680 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd7695d2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7640af1e0 0x7fd7640b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd7695d2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7640af1e0 0x7fd7640b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33902/0 (socket says 172.21.15.29:33902) 2023-10-08T15:40:36.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd7695d2700 1 -- 172.21.15.29:0/678799829 learned_addr learned my addr 172.21.15.29:0/678799829 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.377 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd1c57fa700 1 -- 172.21.15.29:0/2173390161 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1c804d5a0 con 0x7fd1d00bf970 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd769dd3700 1 --2- 172.21.15.29:0/678799829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640b1680 0x7fd764159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd7695d2700 1 -- 172.21.15.29:0/678799829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640b1680 msgr2=0x7fd764159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd7695d2700 1 --2- 172.21.15.29:0/678799829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640b1680 0x7fd764159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd7695d2700 1 -- 172.21.15.29:0/678799829 >> v1:172.21.15.183:6789/0 conn(0x7fd7640af5b0 legacy=0x7fd76406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.341+0000 7fd7695d2700 1 -- 172.21.15.29:0/678799829 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640b2240 con 0x7fd7640af1e0 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.342+0000 7fd7695d2700 1 --2- 172.21.15.29:0/678799829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640af1e0 0x7fd7640b2d20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd7600099b0 tx=0x7fd760009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1bb9fa9a32a6d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.342+0000 7fd75bfff700 1 -- 172.21.15.29:0/678799829 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760009ea0 con 0x7fd7640af1e0 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.342+0000 7fd75bfff700 1 -- 172.21.15.29:0/678799829 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76000b860 con 0x7fd7640af1e0 2023-10-08T15:40:36.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.342+0000 7fd75bfff700 1 -- 172.21.15.29:0/678799829 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000bc00 con 0x7fd7640af1e0 2023-10-08T15:40:36.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.342+0000 7f34cffff700 1 -- 172.21.15.29:0/2265003737 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34dc053440 con 0x7f34e8067ba0 2023-10-08T15:40:36.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.343+0000 7fd76b836700 1 -- 172.21.15.29:0/678799829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640af1e0 msgr2=0x7fd7640b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.343+0000 7fd76b836700 1 --2- 172.21.15.29:0/678799829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640af1e0 0x7fd7640b2d20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd7600099b0 tx=0x7fd760009250 comp rx=0 tx=0).stop 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.343+0000 7fd76b836700 1 -- 172.21.15.29:0/678799829 shutdown_connections 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.343+0000 7fd76b836700 1 --2- 172.21.15.29:0/678799829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640b1680 0x7fd764159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.343+0000 7fd76b836700 1 --2- 172.21.15.29:0/678799829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640af1e0 0x7fd7640b2d20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.343+0000 7fd76b836700 1 -- 172.21.15.29:0/678799829 >> 172.21.15.29:0/678799829 conn(0x7fd7640cd1e0 msgr2=0x7fd7640cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.343+0000 7fd76b836700 1 -- 172.21.15.29:0/678799829 shutdown_connections 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.343+0000 7fd76b836700 1 -- 172.21.15.29:0/678799829 wait complete. 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.344+0000 7fd76b836700 1 Processor -- start 2023-10-08T15:40:36.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.344+0000 7fd76b836700 1 -- start start 2023-10-08T15:40:36.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7f7b127fc700 1 -- 172.21.15.29:0/3606678642 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b00051050 con 0x7f7b1415e550 2023-10-08T15:40:36.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd76b836700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7640af1e0 0x7fd764097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd76b836700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640af5b0 0x7fd764150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd76b836700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640b1680 0x7fd764151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd76b836700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640a75a0 con 0x7fd7640b1680 2023-10-08T15:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd76b836700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641506a0 con 0x7fd7640af1e0 2023-10-08T15:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd76b836700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76414f850 con 0x7fd7640af5b0 2023-10-08T15:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd7695d2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7640af1e0 0x7fd764097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd7695d2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7640af1e0 0x7fd764097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:56736/0 (socket says 172.21.15.29:56736) 2023-10-08T15:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd7695d2700 1 -- 172.21.15.29:0/1973545965 learned_addr learned my addr 172.21.15.29:0/1973545965 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd769dd3700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640b1680 0x7fd764151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.345+0000 7fd768dd1700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640af5b0 0x7fd764150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.347+0000 7f0524ff9700 1 -- 172.21.15.29:0/578058512 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0518013ca0 con 0x7f0528169180 2023-10-08T15:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.346+0000 7fd7695d2700 1 -- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640af5b0 msgr2=0x7fd764150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.346+0000 7fd7695d2700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640af5b0 0x7fd764150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.346+0000 7fd7695d2700 1 -- 172.21.15.29:0/1973545965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640b1680 msgr2=0x7fd764151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.346+0000 7fd7695d2700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640b1680 0x7fd764151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.346+0000 7fd7695d2700 1 -- 172.21.15.29:0/1973545965 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600094f0 con 0x7fd7640af1e0 2023-10-08T15:40:36.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.346+0000 7fd7695d2700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7640af1e0 0x7fd764097a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd760006fd0 tx=0x7fd760017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.347+0000 7f0524ff9700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0514067000 0x7f05140694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.347+0000 7f0524ff9700 1 -- 172.21.15.29:0/578058512 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0518085430 con 0x7f0528169180 2023-10-08T15:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.347+0000 7f0527fff700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0514067000 0x7f05140694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.348+0000 7f0527fff700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0514067000 0x7f05140694b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f051c00ab80 tx=0x7f051c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.350+0000 7f387effd700 1 -- 172.21.15.29:0/5371436 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f388c0514e0 con 0x7f38980c4840 2023-10-08T15:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.352+0000 7f21dcff9700 1 -- 172.21.15.29:0/156407471 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21c8011b90 con 0x7f21e00cd3d0 2023-10-08T15:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.353+0000 7f21dcff9700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21c0067030 0x7f21c00694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.353+0000 7f21dcff9700 1 -- 172.21.15.29:0/156407471 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21c8086170 con 0x7f21e00cd3d0 2023-10-08T15:40:36.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.353+0000 7f21e4eb5700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21c0067030 0x7f21c00694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.353+0000 7fd7597fa700 1 -- 172.21.15.29:0/1973545965 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760000d10 con 0x7fd7640af1e0 2023-10-08T15:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.353+0000 7f0524ff9700 1 -- 172.21.15.29:0/578058512 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0518052720 con 0x7f0528169180 2023-10-08T15:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.353+0000 7fd7597fa700 1 -- 172.21.15.29:0/1973545965 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76000bbe0 con 0x7fd7640af1e0 2023-10-08T15:40:36.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.353+0000 7fd7597fa700 1 -- 172.21.15.29:0/1973545965 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760011670 con 0x7fd7640af1e0 2023-10-08T15:40:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.354+0000 7f21e4eb5700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21c0067030 0x7f21c00694e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21e015a130 tx=0x7f21d8001950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.357+0000 7f21dcff9700 1 -- 172.21.15.29:0/156407471 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21c80534c0 con 0x7f21e00cd3d0 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.362+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76414fad0 con 0x7fd7640af1e0 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.362+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd764150050 con 0x7fd7640af1e0 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.364+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd764150980 con 0x7fd7640af1e0 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.365+0000 7fd7597fa700 1 -- 172.21.15.29:0/1973545965 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd760011aa0 con 0x7fd7640af1e0 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.365+0000 7fd7597fa700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd748067080 0x7fd748069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.365+0000 7fd7597fa700 1 -- 172.21.15.29:0/1973545965 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd760085d60 con 0x7fd7640af1e0 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.366+0000 7fd768dd1700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd748067080 0x7fd748069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.366+0000 7fd768dd1700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd748067080 0x7fd748069530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd7640ae0b0 tx=0x7fd754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.369+0000 7fd7597fa700 1 -- 172.21.15.29:0/1973545965 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd760052fb0 con 0x7fd7640af1e0 2023-10-08T15:40:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.665+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5d80005560 con 0x7f5da0088ac0 2023-10-08T15:40:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.666+0000 7f5d9cff9700 1 -- 172.21.15.29:0/4145375676 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d98055150 con 0x7f5da0088ac0 2023-10-08T15:40:36.669 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:36.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d8c067080 msgr2=0x7f5d8c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d8c067080 0x7f5d8c069530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5da018d4d0 tx=0x7f5d9000e040 comp rx=0 tx=0).stop 2023-10-08T15:40:36.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 msgr2=0x7f5da00a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00a9270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800ccc0 tx=0x7f5d98001a80 comp rx=0 tx=0).stop 2023-10-08T15:40:36.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 shutdown_connections 2023-10-08T15:40:36.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d8c067080 0x7f5d8c069530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5da00ccec0 0x7f5da018e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0088ac0 0x7f5da00a9270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 --2- 172.21.15.29:0/4145375676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da00ccaf0 0x7f5da018e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.669+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 >> 172.21.15.29:0/4145375676 conn(0x7f5da0070700 msgr2=0x7f5da0063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.670+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 shutdown_connections 2023-10-08T15:40:36.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.670+0000 7f5da71f3700 1 -- 172.21.15.29:0/4145375676 wait complete. 2023-10-08T15:40:36.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-08T15:40:36.689 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:36.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.730+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd76404c3c0 con 0x7fd7640af1e0 2023-10-08T15:40:36.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.730+0000 7fd7597fa700 1 -- 172.21.15.29:0/1973545965 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd760015020 con 0x7fd7640af1e0 2023-10-08T15:40:36.731 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.733+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd748067080 msgr2=0x7fd748069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.733+0000 7fd76b836700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd748067080 0x7fd748069530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd7640ae0b0 tx=0x7fd754009040 comp rx=0 tx=0).stop 2023-10-08T15:40:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.733+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7640af1e0 msgr2=0x7fd764097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.733+0000 7fd76b836700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7640af1e0 0x7fd764097a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd760006fd0 tx=0x7fd760017000 comp rx=0 tx=0).stop 2023-10-08T15:40:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.734+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 shutdown_connections 2023-10-08T15:40:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.734+0000 7fd76b836700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd748067080 0x7fd748069530 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.734+0000 7fd76b836700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7640b1680 0x7fd764151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.734+0000 7fd76b836700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7640af1e0 0x7fd764097a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.734+0000 7fd76b836700 1 --2- 172.21.15.29:0/1973545965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7640af5b0 0x7fd764150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.734+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 >> 172.21.15.29:0/1973545965 conn(0x7fd7640cd1e0 msgr2=0x7fd7640a7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.735+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 shutdown_connections 2023-10-08T15:40:36.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.735+0000 7fd76b836700 1 -- 172.21.15.29:0/1973545965 wait complete. 2023-10-08T15:40:36.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-08T15:40:36.748 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:36.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.751+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7b1415fb40 con 0x7f7b1415e550 2023-10-08T15:40:36.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.751+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f34c8005560 con 0x7f34e8067ba0 2023-10-08T15:40:36.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.751+0000 7f7b127fc700 1 -- 172.21.15.29:0/3606678642 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b00017090 con 0x7f7b1415e550 2023-10-08T15:40:36.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.751+0000 7f34cffff700 1 -- 172.21.15.29:0/2265003737 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34dc02b340 con 0x7f34e8067ba0 2023-10-08T15:40:36.752 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:36.752 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:36.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.752+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f38980b0d80 con 0x7f38980c4840 2023-10-08T15:40:36.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.752+0000 7f387effd700 1 -- 172.21.15.29:0/5371436 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f388c054b00 con 0x7f38980c4840 2023-10-08T15:40:36.753 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:36.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.753+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1b0005830 con 0x7fd1d00bf970 2023-10-08T15:40:36.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.754+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f05280b0f00 con 0x7f0528169180 2023-10-08T15:40:36.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.754+0000 7fd1c57fa700 1 -- 172.21.15.29:0/2173390161 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1c8054f10 con 0x7fd1d00bf970 2023-10-08T15:40:36.755 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:36.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.754+0000 7f0524ff9700 1 -- 172.21.15.29:0/578058512 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0518055d40 con 0x7f0528169180 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.754+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f34d4067080 msgr2=0x7f34d4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f34d4067080 0x7f34d4069530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34e806eac0 tx=0x7f34e00097e0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 msgr2=0x7f34e80b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e80b2030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34e8071440 tx=0x7f34dc017000 comp rx=0 tx=0).stop 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 shutdown_connections 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f34d4067080 0x7f34d4069530 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34e806eac0 tx=0x7f34e00097e0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e81569e0 0x7f34e80c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e8067ba0 0x7f34e80b2030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 --2- 172.21.15.29:0/2265003737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34e806d330 0x7f34e816a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 >> 172.21.15.29:0/2265003737 conn(0x7f34e80cc760 msgr2=0x7f34e80c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.757 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.754+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7af8067000 msgr2=0x7f7af80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.754+0000 7f7b1c305700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7af8067000 0x7f7af80694b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0093f0 tx=0x7f7b0c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.754+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1415e550 msgr2=0x7f7b14150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.754+0000 7f7b1c305700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1415e550 0x7f7b14150420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c590 tx=0x7f7b00007ef0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 shutdown_connections 2023-10-08T15:40:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f7b1c305700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7af8067000 0x7f7af80694b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f7b1c305700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1415e550 0x7f7b14150420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f7b1c305700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b140b6970 0x7f7b140b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f7b1c305700 1 --2- 172.21.15.29:0/3606678642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1415e180 0x7f7b1414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 >> 172.21.15.29:0/3606678642 conn(0x7f7b14068ce0 msgr2=0x7f7b140690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 shutdown_connections 2023-10-08T15:40:36.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f7b1c305700 1 -- 172.21.15.29:0/3606678642 wait complete. 2023-10-08T15:40:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.755+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3884067080 msgr2=0x7f3884069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3884067080 0x7f3884069530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f389000d010 tx=0x7f3890016000 comp rx=0 tx=0).stop 2023-10-08T15:40:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38980c4840 msgr2=0x7f38980c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38980c4840 0x7f38980c4cb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d8b0 tx=0x7f388c009040 comp rx=0 tx=0).stop 2023-10-08T15:40:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 shutdown_connections 2023-10-08T15:40:36.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3884067080 0x7f3884069530 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38980b10d0 0x7f38980b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3880003e50 0x7f3898176f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 --2- 172.21.15.29:0/5371436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38980c4840 0x7f38980c4cb0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d8b0 tx=0x7f388c009040 comp rx=0 tx=0).stop 2023-10-08T15:40:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 >> 172.21.15.29:0/5371436 conn(0x7f3898067660 msgr2=0x7f38980c1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 shutdown_connections 2023-10-08T15:40:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f389d59e700 1 -- 172.21.15.29:0/5371436 wait complete. 2023-10-08T15:40:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.756+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 shutdown_connections 2023-10-08T15:40:36.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0514067000 msgr2=0x7f05140694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7f052f226700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0514067000 0x7f05140694b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f051c00ab80 tx=0x7f051c008040 comp rx=0 tx=0).stop 2023-10-08T15:40:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0528169180 msgr2=0x7f05280c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7f052f226700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0528169180 0x7f05280c6e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f051800e8a0 tx=0x7f0518009040 comp rx=0 tx=0).stop 2023-10-08T15:40:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd1b4067000 msgr2=0x7fd1b40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd1b4067000 0x7fd1b40694b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0099b0 tx=0x7fd1cc016000 comp rx=0 tx=0).stop 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00bf970 msgr2=0x7fd1d00c0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00bf970 0x7fd1d00c0340 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800bc30 tx=0x7fd1c8009840 comp rx=0 tx=0).stop 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 shutdown_connections 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd1b4067000 0x7fd1b40694b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1d00bf970 0x7fd1d00c0340 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1d006d4c0 0x7fd1d01494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 --2- 172.21.15.29:0/2173390161 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1d00ac1a0 0x7fd1d00c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.757+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 >> 172.21.15.29:0/2173390161 conn(0x7fd1d0067660 msgr2=0x7fd1d015dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 shutdown_connections 2023-10-08T15:40:36.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f34ed7a5700 1 -- 172.21.15.29:0/2265003737 wait complete. 2023-10-08T15:40:36.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 shutdown_connections 2023-10-08T15:40:36.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f052f226700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0514067000 0x7f05140694b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f052f226700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05280c7bc0 0x7f05280c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f052f226700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0528169180 0x7f05280c6e00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f052f226700 1 --2- 172.21.15.29:0/578058512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05280c9c40 0x7f05280c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 >> 172.21.15.29:0/578058512 conn(0x7f0528070700 msgr2=0x7f052816a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7fd1d79f1700 1 -- 172.21.15.29:0/2173390161 wait complete. 2023-10-08T15:40:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 shutdown_connections 2023-10-08T15:40:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.759+0000 7f052f226700 1 -- 172.21.15.29:0/578058512 wait complete. 2023-10-08T15:40:36.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.767+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f21c4005830 con 0x7f21e00cd3d0 2023-10-08T15:40:36.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.767+0000 7f21dcff9700 1 -- 172.21.15.29:0/156407471 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21c8056ae0 con 0x7f21e00cd3d0 2023-10-08T15:40:36.769 INFO:teuthology.orchestra.run.smithi029.stdout:55834574854 2023-10-08T15:40:36.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-08T15:40:36.772 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:36.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.772+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21c0067030 msgr2=0x7f21c00694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.772+0000 7f21e7119700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21c0067030 0x7f21c00694e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21e015a130 tx=0x7f21d8001950 comp rx=0 tx=0).stop 2023-10-08T15:40:36.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.772+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 msgr2=0x7f21e00ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.772+0000 7f21e7119700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00ae0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f21c8016000 tx=0x7f21c8017000 comp rx=0 tx=0).stop 2023-10-08T15:40:36.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.773+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 shutdown_connections 2023-10-08T15:40:36.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.773+0000 7f21e7119700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f21c0067030 0x7f21c00694e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.773+0000 7f21e7119700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21e00cd3d0 0x7f21e00ae0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.773+0000 7f21e7119700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e006ee90 0x7f21e01569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.773+0000 7f21e7119700 1 --2- 172.21.15.29:0/156407471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21e006f260 0x7f21e015b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.773+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 >> 172.21.15.29:0/156407471 conn(0x7f21e0070700 msgr2=0x7f21e00b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.773+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 shutdown_connections 2023-10-08T15:40:36.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.773+0000 7f21e7119700 1 -- 172.21.15.29:0/156407471 wait complete. 2023-10-08T15:40:36.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-08T15:40:36.776 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:36.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-08T15:40:36.785 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:36.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-08T15:40:36.785 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:36.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-08T15:40:36.786 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:36.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-08T15:40:36.790 DEBUG:teuthology.parallel:result is None 2023-10-08T15:40:36.790 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T15:40:36.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.948+0000 7f99b4742700 1 Processor -- start 2023-10-08T15:40:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.948+0000 7f99b4742700 1 -- start start 2023-10-08T15:40:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b4742700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99ac0d1c30 0x7f99ac0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b4742700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99ac15a680 0x7f99ac0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b4742700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac0c5d80 con 0x7f99ac15a2b0 2023-10-08T15:40:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b4742700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac068470 con 0x7f99ac0d1c30 2023-10-08T15:40:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b4742700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac0c6060 con 0x7f99ac15a680 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b1cdd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99ac0d1c30 0x7f99ac0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b1cdd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99ac0d1c30 0x7f99ac0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33924/0 (socket says 172.21.15.29:33924) 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b1cdd700 1 -- 172.21.15.29:0/2252155120 learned_addr learned my addr 172.21.15.29:0/2252155120 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.949+0000 7f99b2cdf700 1 --2- 172.21.15.29:0/2252155120 >> v2:172.21.15.183:3300/0 conn(0x7f99ac15a680 0x7f99ac0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b1cdd700 1 -- 172.21.15.29:0/2252155120 >> v2:172.21.15.183:3300/0 conn(0x7f99ac15a680 msgr2=0x7f99ac0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b1cdd700 1 --2- 172.21.15.29:0/2252155120 >> v2:172.21.15.183:3300/0 conn(0x7f99ac15a680 0x7f99ac0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b1cdd700 1 -- 172.21.15.29:0/2252155120 >> v1:172.21.15.183:6789/0 conn(0x7f99ac15a2b0 legacy=0x7f99ac0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b1cdd700 1 -- 172.21.15.29:0/2252155120 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0c6340 con 0x7f99ac0d1c30 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b1cdd700 1 --2- 172.21.15.29:0/2252155120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac0ccdd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f99ac064970 tx=0x7f99a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d604ddbcdae33ba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b14dc700 1 -- 172.21.15.29:0/2252155120 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0009e70 con 0x7f99ac0d1c30 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b14dc700 1 -- 172.21.15.29:0/2252155120 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a000b860 con 0x7f99ac0d1c30 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b14dc700 1 -- 172.21.15.29:0/2252155120 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000bc00 con 0x7f99ac0d1c30 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b4742700 1 -- 172.21.15.29:0/2252155120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 msgr2=0x7f99ac0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b4742700 1 --2- 172.21.15.29:0/2252155120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac0ccdd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f99ac064970 tx=0x7f99a0009250 comp rx=0 tx=0).stop 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b4742700 1 -- 172.21.15.29:0/2252155120 shutdown_connections 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b4742700 1 --2- 172.21.15.29:0/2252155120 >> v2:172.21.15.183:3300/0 conn(0x7f99ac15a680 0x7f99ac0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b4742700 1 --2- 172.21.15.29:0/2252155120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac0ccdd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b4742700 1 -- 172.21.15.29:0/2252155120 >> 172.21.15.29:0/2252155120 conn(0x7f99ac067e40 msgr2=0x7f99ac0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b4742700 1 -- 172.21.15.29:0/2252155120 shutdown_connections 2023-10-08T15:40:36.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.950+0000 7f99b4742700 1 -- 172.21.15.29:0/2252155120 wait complete. 2023-10-08T15:40:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.951+0000 7f99b4742700 1 Processor -- start 2023-10-08T15:40:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b4742700 1 -- start start 2023-10-08T15:40:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b4742700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b4742700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac15a2b0 0x7f99ac14aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b4742700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac15a680 0x7f99ac15b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b4742700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0c8460 con 0x7f99ac0d1c30 2023-10-08T15:40:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b4742700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac15f400 con 0x7f99ac15a680 2023-10-08T15:40:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b4742700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac16a4d0 con 0x7f99ac15a2b0 2023-10-08T15:40:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b24de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b24de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac15d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33930/0 (socket says 172.21.15.29:33930) 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b24de700 1 -- 172.21.15.29:0/1386485991 learned_addr learned my addr 172.21.15.29:0/1386485991 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b2cdf700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac15a680 0x7f99ac15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.952+0000 7f99b1cdd700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac15a2b0 0x7f99ac14aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99b24de700 1 -- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac15a2b0 msgr2=0x7f99ac14aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99b24de700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac15a2b0 0x7f99ac14aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99b24de700 1 -- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac15a680 msgr2=0x7f99ac15b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99b24de700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac15a680 0x7f99ac15b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:36.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99b24de700 1 -- 172.21.15.29:0/1386485991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00094f0 con 0x7f99ac0d1c30 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99b24de700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac15d740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99a400c540 tx=0x7f99a4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99aa7fc700 1 -- 172.21.15.29:0/1386485991 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4011590 con 0x7f99ac0d1c30 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99aa7fc700 1 -- 172.21.15.29:0/1386485991 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40116f0 con 0x7f99ac0d1c30 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99aa7fc700 1 -- 172.21.15.29:0/1386485991 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4011ab0 con 0x7f99ac0d1c30 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac0cac10 con 0x7f99ac0d1c30 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.953+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac0cb1d0 con 0x7f99ac0d1c30 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.954+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac04c3c0 con 0x7f99ac0d1c30 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.954+0000 7f99aa7fc700 1 -- 172.21.15.29:0/1386485991 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99a401b3b0 con 0x7f99ac0d1c30 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.955+0000 7f99aa7fc700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9998066f30 0x7f99980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.955+0000 7f99aa7fc700 1 -- 172.21.15.29:0/1386485991 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99a4083890 con 0x7f99ac0d1c30 2023-10-08T15:40:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.955+0000 7f99b1cdd700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9998066f30 0x7f99980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.955+0000 7f99b1cdd700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9998066f30 0x7f99980693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99ac064970 tx=0x7f99a0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:36.959+0000 7f99aa7fc700 1 -- 172.21.15.29:0/1386485991 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99a4050b10 con 0x7f99ac0d1c30 2023-10-08T15:40:37.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.146+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99ac15f540 con 0x7f9998066f30 2023-10-08T15:40:37.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.153+0000 7f99aa7fc700 1 -- 172.21.15.29:0/1386485991 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260175 (secure 0 0 0) 0x7f99a000b9d0 con 0x7f9998066f30 2023-10-08T15:40:37.157 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9998066f30 msgr2=0x7f99980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9998066f30 0x7f99980693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99ac064970 tx=0x7f99a0017000 comp rx=0 tx=0).stop 2023-10-08T15:40:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 msgr2=0x7f99ac15d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac15d740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99a400c540 tx=0x7f99a4001070 comp rx=0 tx=0).stop 2023-10-08T15:40:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 shutdown_connections 2023-10-08T15:40:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9998066f30 0x7f99980693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99ac15a680 0x7f99ac15b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99ac0d1c30 0x7f99ac15d740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 --2- 172.21.15.29:0/1386485991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99ac15a2b0 0x7f99ac14aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 >> 172.21.15.29:0/1386485991 conn(0x7f99ac067e40 msgr2=0x7f99ac068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 shutdown_connections 2023-10-08T15:40:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.156+0000 7f99b4742700 1 -- 172.21.15.29:0/1386485991 wait complete. 2023-10-08T15:40:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:40:37.169 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T15:40:36.305515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.613450"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701562+0000","last_change":"2023-10-08T15:40:23.700602+0000","last_active":"2023-10-08T15:40:23.701562+0000","last_peered":"2023-10-08T15:40:23.701562+0000","last_clean":"2023-10-08T15:40:23.701562+0000","last_became_active":"2023-10-08T15:40:23.700351+0000","last_became_peered":"2023-10-08T15:40:23.700351+0000","last_unstale":"2023-10-08T15:40:23.701562+0000","last_undegraded":"2023-10-08T15:40:23.701562+0000","last_fullsized":"2023-10-08T15:40:23.701562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:17.290508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705971+0000","last_change":"2023-10-08T15:40:23.705905+0000","last_active":"2023-10-08T15:40:23.705971+0000","last_peered":"2023-10-08T15:40:23.705971+0000","last_clean":"2023-10-08T15:40:23.705971+0000","last_became_active":"2023-10-08T15:40:23.705644+0000","last_became_peered":"2023-10-08T15:40:23.705644+0000","last_unstale":"2023-10-08T15:40:23.705971+0000","last_undegraded":"2023-10-08T15:40:23.705971+0000","last_fullsized":"2023-10-08T15:40:23.705971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707366+0000","last_change":"2023-10-08T15:40:23.705871+0000","last_active":"2023-10-08T15:40:23.707366+0000","last_peered":"2023-10-08T15:40:23.707366+0000","last_clean":"2023-10-08T15:40:23.707366+0000","last_became_active":"2023-10-08T15:40:23.705207+0000","last_became_peered":"2023-10-08T15:40:23.705207+0000","last_unstale":"2023-10-08T15:40:23.707366+0000","last_undegraded":"2023-10-08T15:40:23.707366+0000","last_fullsized":"2023-10-08T15:40:23.707366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695623+0000","last_change":"2023-10-08T15:40:23.695515+0000","last_active":"2023-10-08T15:40:23.695623+0000","last_peered":"2023-10-08T15:40:23.695623+0000","last_clean":"2023-10-08T15:40:23.695623+0000","last_became_active":"2023-10-08T15:40:23.695301+0000","last_became_peered":"2023-10-08T15:40:23.695301+0000","last_unstale":"2023-10-08T15:40:23.695623+0000","last_undegraded":"2023-10-08T15:40:23.695623+0000","last_fullsized":"2023-10-08T15:40:23.695623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:56:55.421889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700059+0000","last_change":"2023-10-08T15:40:23.698698+0000","last_active":"2023-10-08T15:40:23.700059+0000","last_peered":"2023-10-08T15:40:23.700059+0000","last_clean":"2023-10-08T15:40:23.700059+0000","last_became_active":"2023-10-08T15:40:23.698435+0000","last_became_peered":"2023-10-08T15:40:23.698435+0000","last_unstale":"2023-10-08T15:40:23.700059+0000","last_undegraded":"2023-10-08T15:40:23.700059+0000","last_fullsized":"2023-10-08T15:40:23.700059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:27.901303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710147+0000","last_change":"2023-10-08T15:40:23.709600+0000","last_active":"2023-10-08T15:40:23.710147+0000","last_peered":"2023-10-08T15:40:23.710147+0000","last_clean":"2023-10-08T15:40:23.710147+0000","last_became_active":"2023-10-08T15:40:23.709218+0000","last_became_peered":"2023-10-08T15:40:23.709218+0000","last_unstale":"2023-10-08T15:40:23.710147+0000","last_undegraded":"2023-10-08T15:40:23.710147+0000","last_fullsized":"2023-10-08T15:40:23.710147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:17.290508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711213+0000","last_change":"2023-10-08T15:40:23.711171+0000","last_active":"2023-10-08T15:40:23.711213+0000","last_peered":"2023-10-08T15:40:23.711213+0000","last_clean":"2023-10-08T15:40:23.711213+0000","last_became_active":"2023-10-08T15:40:23.710893+0000","last_became_peered":"2023-10-08T15:40:23.710893+0000","last_unstale":"2023-10-08T15:40:23.711213+0000","last_undegraded":"2023-10-08T15:40:23.711213+0000","last_fullsized":"2023-10-08T15:40:23.711213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703451+0000","last_change":"2023-10-08T15:40:23.702893+0000","last_active":"2023-10-08T15:40:23.703451+0000","last_peered":"2023-10-08T15:40:23.703451+0000","last_clean":"2023-10-08T15:40:23.703451+0000","last_became_active":"2023-10-08T15:40:23.701153+0000","last_became_peered":"2023-10-08T15:40:23.701153+0000","last_unstale":"2023-10-08T15:40:23.703451+0000","last_undegraded":"2023-10-08T15:40:23.703451+0000","last_fullsized":"2023-10-08T15:40:23.703451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704759+0000","last_change":"2023-10-08T15:40:23.704635+0000","last_active":"2023-10-08T15:40:23.704759+0000","last_peered":"2023-10-08T15:40:23.704759+0000","last_clean":"2023-10-08T15:40:23.704759+0000","last_became_active":"2023-10-08T15:40:23.704385+0000","last_became_peered":"2023-10-08T15:40:23.704385+0000","last_unstale":"2023-10-08T15:40:23.704759+0000","last_undegraded":"2023-10-08T15:40:23.704759+0000","last_fullsized":"2023-10-08T15:40:23.704759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:08:21.476854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709217+0000","last_change":"2023-10-08T15:40:23.709147+0000","last_active":"2023-10-08T15:40:23.709217+0000","last_peered":"2023-10-08T15:40:23.709217+0000","last_clean":"2023-10-08T15:40:23.709217+0000","last_became_active":"2023-10-08T15:40:23.708936+0000","last_became_peered":"2023-10-08T15:40:23.708936+0000","last_unstale":"2023-10-08T15:40:23.709217+0000","last_undegraded":"2023-10-08T15:40:23.709217+0000","last_fullsized":"2023-10-08T15:40:23.709217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.706519+0000","last_change":"2023-10-08T15:40:23.706380+0000","last_active":"2023-10-08T15:40:23.706519+0000","last_peered":"2023-10-08T15:40:23.706519+0000","last_clean":"2023-10-08T15:40:23.706519+0000","last_became_active":"2023-10-08T15:40:23.706144+0000","last_became_peered":"2023-10-08T15:40:23.706144+0000","last_unstale":"2023-10-08T15:40:23.706519+0000","last_undegraded":"2023-10-08T15:40:23.706519+0000","last_fullsized":"2023-10-08T15:40:23.706519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695687+0000","last_change":"2023-10-08T15:40:23.695528+0000","last_active":"2023-10-08T15:40:23.695687+0000","last_peered":"2023-10-08T15:40:23.695687+0000","last_clean":"2023-10-08T15:40:23.695687+0000","last_became_active":"2023-10-08T15:40:23.695302+0000","last_became_peered":"2023-10-08T15:40:23.695302+0000","last_unstale":"2023-10-08T15:40:23.695687+0000","last_undegraded":"2023-10-08T15:40:23.695687+0000","last_fullsized":"2023-10-08T15:40:23.695687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703495+0000","last_change":"2023-10-08T15:40:23.703349+0000","last_active":"2023-10-08T15:40:23.703495+0000","last_peered":"2023-10-08T15:40:23.703495+0000","last_clean":"2023-10-08T15:40:23.703495+0000","last_became_active":"2023-10-08T15:40:23.702660+0000","last_became_peered":"2023-10-08T15:40:23.702660+0000","last_unstale":"2023-10-08T15:40:23.703495+0000","last_undegraded":"2023-10-08T15:40:23.703495+0000","last_fullsized":"2023-10-08T15:40:23.703495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707426+0000","last_change":"2023-10-08T15:40:23.707180+0000","last_active":"2023-10-08T15:40:23.707426+0000","last_peered":"2023-10-08T15:40:23.707426+0000","last_clean":"2023-10-08T15:40:23.707426+0000","last_became_active":"2023-10-08T15:40:23.706069+0000","last_became_peered":"2023-10-08T15:40:23.706069+0000","last_unstale":"2023-10-08T15:40:23.707426+0000","last_undegraded":"2023-10-08T15:40:23.707426+0000","last_fullsized":"2023-10-08T15:40:23.707426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703755+0000","last_change":"2023-10-08T15:40:23.703647+0000","last_active":"2023-10-08T15:40:23.703755+0000","last_peered":"2023-10-08T15:40:23.703755+0000","last_clean":"2023-10-08T15:40:23.703755+0000","last_became_active":"2023-10-08T15:40:23.703408+0000","last_became_peered":"2023-10-08T15:40:23.703408+0000","last_unstale":"2023-10-08T15:40:23.703755+0000","last_undegraded":"2023-10-08T15:40:23.703755+0000","last_fullsized":"2023-10-08T15:40:23.703755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710129+0000","last_change":"2023-10-08T15:40:23.709470+0000","last_active":"2023-10-08T15:40:23.710129+0000","last_peered":"2023-10-08T15:40:23.710129+0000","last_clean":"2023-10-08T15:40:23.710129+0000","last_became_active":"2023-10-08T15:40:23.708885+0000","last_became_peered":"2023-10-08T15:40:23.708885+0000","last_unstale":"2023-10-08T15:40:23.710129+0000","last_undegraded":"2023-10-08T15:40:23.710129+0000","last_fullsized":"2023-10-08T15:40:23.710129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:27.901303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705498+0000","last_change":"2023-10-08T15:40:23.703463+0000","last_active":"2023-10-08T15:40:23.705498+0000","last_peered":"2023-10-08T15:40:23.705498+0000","last_clean":"2023-10-08T15:40:23.705498+0000","last_became_active":"2023-10-08T15:40:23.702524+0000","last_became_peered":"2023-10-08T15:40:23.702524+0000","last_unstale":"2023-10-08T15:40:23.705498+0000","last_undegraded":"2023-10-08T15:40:23.705498+0000","last_fullsized":"2023-10-08T15:40:23.705498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704661+0000","last_change":"2023-10-08T15:40:23.702028+0000","last_active":"2023-10-08T15:40:23.704661+0000","last_peered":"2023-10-08T15:40:23.704661+0000","last_clean":"2023-10-08T15:40:23.704661+0000","last_became_active":"2023-10-08T15:40:23.701778+0000","last_became_peered":"2023-10-08T15:40:23.701778+0000","last_unstale":"2023-10-08T15:40:23.704661+0000","last_undegraded":"2023-10-08T15:40:23.704661+0000","last_fullsized":"2023-10-08T15:40:23.704661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700079+0000","last_change":"2023-10-08T15:40:23.699492+0000","last_active":"2023-10-08T15:40:23.700079+0000","last_peered":"2023-10-08T15:40:23.700079+0000","last_clean":"2023-10-08T15:40:23.700079+0000","last_became_active":"2023-10-08T15:40:23.698975+0000","last_became_peered":"2023-10-08T15:40:23.698975+0000","last_unstale":"2023-10-08T15:40:23.700079+0000","last_undegraded":"2023-10-08T15:40:23.700079+0000","last_fullsized":"2023-10-08T15:40:23.700079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710621+0000","last_change":"2023-10-08T15:40:22.695776+0000","last_active":"2023-10-08T15:40:23.710621+0000","last_peered":"2023-10-08T15:40:23.710621+0000","last_clean":"2023-10-08T15:40:23.710621+0000","last_became_active":"2023-10-08T15:40:22.695553+0000","last_became_peered":"2023-10-08T15:40:22.695553+0000","last_unstale":"2023-10-08T15:40:23.710621+0000","last_undegraded":"2023-10-08T15:40:23.710621+0000","last_fullsized":"2023-10-08T15:40:23.710621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.698627+0000","last_change":"2023-10-08T15:40:23.697252+0000","last_active":"2023-10-08T15:40:23.698627+0000","last_peered":"2023-10-08T15:40:23.698627+0000","last_clean":"2023-10-08T15:40:23.698627+0000","last_became_active":"2023-10-08T15:40:23.697020+0000","last_became_peered":"2023-10-08T15:40:23.697020+0000","last_unstale":"2023-10-08T15:40:23.698627+0000","last_undegraded":"2023-10-08T15:40:23.698627+0000","last_fullsized":"2023-10-08T15:40:23.698627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708476+0000","last_change":"2023-10-08T15:40:22.699564+0000","last_active":"2023-10-08T15:40:23.708476+0000","last_peered":"2023-10-08T15:40:23.708476+0000","last_clean":"2023-10-08T15:40:23.708476+0000","last_became_active":"2023-10-08T15:40:22.698627+0000","last_became_peered":"2023-10-08T15:40:22.698627+0000","last_unstale":"2023-10-08T15:40:23.708476+0000","last_undegraded":"2023-10-08T15:40:23.708476+0000","last_fullsized":"2023-10-08T15:40:23.708476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707387+0000","last_change":"2023-10-08T15:40:23.706021+0000","last_active":"2023-10-08T15:40:23.707387+0000","last_peered":"2023-10-08T15:40:23.707387+0000","last_clean":"2023-10-08T15:40:23.707387+0000","last_became_active":"2023-10-08T15:40:23.705521+0000","last_became_peered":"2023-10-08T15:40:23.705521+0000","last_unstale":"2023-10-08T15:40:23.707387+0000","last_undegraded":"2023-10-08T15:40:23.707387+0000","last_fullsized":"2023-10-08T15:40:23.707387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707933+0000","last_change":"2023-10-08T15:40:22.700173+0000","last_active":"2023-10-08T15:40:23.707933+0000","last_peered":"2023-10-08T15:40:23.707933+0000","last_clean":"2023-10-08T15:40:23.707933+0000","last_became_active":"2023-10-08T15:40:22.699897+0000","last_became_peered":"2023-10-08T15:40:22.699897+0000","last_unstale":"2023-10-08T15:40:23.707933+0000","last_undegraded":"2023-10-08T15:40:23.707933+0000","last_fullsized":"2023-10-08T15:40:23.707933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:48.001159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702397+0000","last_change":"2023-10-08T15:40:23.702311+0000","last_active":"2023-10-08T15:40:23.702397+0000","last_peered":"2023-10-08T15:40:23.702397+0000","last_clean":"2023-10-08T15:40:23.702397+0000","last_became_active":"2023-10-08T15:40:23.702075+0000","last_became_peered":"2023-10-08T15:40:23.702075+0000","last_unstale":"2023-10-08T15:40:23.702397+0000","last_undegraded":"2023-10-08T15:40:23.702397+0000","last_fullsized":"2023-10-08T15:40:23.702397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:47.802873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709088+0000","last_change":"2023-10-08T15:40:22.702341+0000","last_active":"2023-10-08T15:40:23.709088+0000","last_peered":"2023-10-08T15:40:23.709088+0000","last_clean":"2023-10-08T15:40:23.709088+0000","last_became_active":"2023-10-08T15:40:22.701383+0000","last_became_peered":"2023-10-08T15:40:22.701383+0000","last_unstale":"2023-10-08T15:40:23.709088+0000","last_undegraded":"2023-10-08T15:40:23.709088+0000","last_fullsized":"2023-10-08T15:40:23.709088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708763+0000","last_change":"2023-10-08T15:40:23.708521+0000","last_active":"2023-10-08T15:40:23.708763+0000","last_peered":"2023-10-08T15:40:23.708763+0000","last_clean":"2023-10-08T15:40:23.708763+0000","last_became_active":"2023-10-08T15:40:23.708313+0000","last_became_peered":"2023-10-08T15:40:23.708313+0000","last_unstale":"2023-10-08T15:40:23.708763+0000","last_undegraded":"2023-10-08T15:40:23.708763+0000","last_fullsized":"2023-10-08T15:40:23.708763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703043+0000","last_change":"2023-10-08T15:40:22.698477+0000","last_active":"2023-10-08T15:40:23.703043+0000","last_peered":"2023-10-08T15:40:23.703043+0000","last_clean":"2023-10-08T15:40:23.703043+0000","last_became_active":"2023-10-08T15:40:22.698057+0000","last_became_peered":"2023-10-08T15:40:22.698057+0000","last_unstale":"2023-10-08T15:40:23.703043+0000","last_undegraded":"2023-10-08T15:40:23.703043+0000","last_fullsized":"2023-10-08T15:40:23.703043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695668+0000","last_change":"2023-10-08T15:40:23.695420+0000","last_active":"2023-10-08T15:40:23.695668+0000","last_peered":"2023-10-08T15:40:23.695668+0000","last_clean":"2023-10-08T15:40:23.695668+0000","last_became_active":"2023-10-08T15:40:23.695193+0000","last_became_peered":"2023-10-08T15:40:23.695193+0000","last_unstale":"2023-10-08T15:40:23.695668+0000","last_undegraded":"2023-10-08T15:40:23.695668+0000","last_fullsized":"2023-10-08T15:40:23.695668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704172+0000","last_change":"2023-10-08T15:40:22.695547+0000","last_active":"2023-10-08T15:40:23.704172+0000","last_peered":"2023-10-08T15:40:23.704172+0000","last_clean":"2023-10-08T15:40:23.704172+0000","last_became_active":"2023-10-08T15:40:22.695272+0000","last_became_peered":"2023-10-08T15:40:22.695272+0000","last_unstale":"2023-10-08T15:40:23.704172+0000","last_undegraded":"2023-10-08T15:40:23.704172+0000","last_fullsized":"2023-10-08T15:40:23.704172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708209+0000","last_change":"2023-10-08T15:40:23.708141+0000","last_active":"2023-10-08T15:40:23.708209+0000","last_peered":"2023-10-08T15:40:23.708209+0000","last_clean":"2023-10-08T15:40:23.708209+0000","last_became_active":"2023-10-08T15:40:23.707923+0000","last_became_peered":"2023-10-08T15:40:23.707923+0000","last_unstale":"2023-10-08T15:40:23.708209+0000","last_undegraded":"2023-10-08T15:40:23.708209+0000","last_fullsized":"2023-10-08T15:40:23.708209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692120+0000","last_change":"2023-10-08T15:40:22.700006+0000","last_active":"2023-10-08T15:40:23.692120+0000","last_peered":"2023-10-08T15:40:23.692120+0000","last_clean":"2023-10-08T15:40:23.692120+0000","last_became_active":"2023-10-08T15:40:22.699783+0000","last_became_peered":"2023-10-08T15:40:22.699783+0000","last_unstale":"2023-10-08T15:40:23.692120+0000","last_undegraded":"2023-10-08T15:40:23.692120+0000","last_fullsized":"2023-10-08T15:40:23.692120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705390+0000","last_change":"2023-10-08T15:40:23.705275+0000","last_active":"2023-10-08T15:40:23.705390+0000","last_peered":"2023-10-08T15:40:23.705390+0000","last_clean":"2023-10-08T15:40:23.705390+0000","last_became_active":"2023-10-08T15:40:23.700794+0000","last_became_peered":"2023-10-08T15:40:23.700794+0000","last_unstale":"2023-10-08T15:40:23.705390+0000","last_undegraded":"2023-10-08T15:40:23.705390+0000","last_fullsized":"2023-10-08T15:40:23.705390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694804+0000","last_change":"2023-10-08T15:40:22.695652+0000","last_active":"2023-10-08T15:40:23.694804+0000","last_peered":"2023-10-08T15:40:23.694804+0000","last_clean":"2023-10-08T15:40:23.694804+0000","last_became_active":"2023-10-08T15:40:22.695043+0000","last_became_peered":"2023-10-08T15:40:22.695043+0000","last_unstale":"2023-10-08T15:40:23.694804+0000","last_undegraded":"2023-10-08T15:40:23.694804+0000","last_fullsized":"2023-10-08T15:40:23.694804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695661+0000","last_change":"2023-10-08T15:40:23.695481+0000","last_active":"2023-10-08T15:40:23.695661+0000","last_peered":"2023-10-08T15:40:23.695661+0000","last_clean":"2023-10-08T15:40:23.695661+0000","last_became_active":"2023-10-08T15:40:23.695247+0000","last_became_peered":"2023-10-08T15:40:23.695247+0000","last_unstale":"2023-10-08T15:40:23.695661+0000","last_undegraded":"2023-10-08T15:40:23.695661+0000","last_fullsized":"2023-10-08T15:40:23.695661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693450+0000","last_change":"2023-10-08T15:40:22.702796+0000","last_active":"2023-10-08T15:40:23.693450+0000","last_peered":"2023-10-08T15:40:23.693450+0000","last_clean":"2023-10-08T15:40:23.693450+0000","last_became_active":"2023-10-08T15:40:22.702571+0000","last_became_peered":"2023-10-08T15:40:22.702571+0000","last_unstale":"2023-10-08T15:40:23.693450+0000","last_undegraded":"2023-10-08T15:40:23.693450+0000","last_fullsized":"2023-10-08T15:40:23.693450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708503+0000","last_change":"2023-10-08T15:40:23.708328+0000","last_active":"2023-10-08T15:40:23.708503+0000","last_peered":"2023-10-08T15:40:23.708503+0000","last_clean":"2023-10-08T15:40:23.708503+0000","last_became_active":"2023-10-08T15:40:23.703248+0000","last_became_peered":"2023-10-08T15:40:23.703248+0000","last_unstale":"2023-10-08T15:40:23.708503+0000","last_undegraded":"2023-10-08T15:40:23.708503+0000","last_fullsized":"2023-10-08T15:40:23.708503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689878+0000","last_change":"2023-10-08T15:40:22.702638+0000","last_active":"2023-10-08T15:40:23.689878+0000","last_peered":"2023-10-08T15:40:23.689878+0000","last_clean":"2023-10-08T15:40:23.689878+0000","last_became_active":"2023-10-08T15:40:22.702409+0000","last_became_peered":"2023-10-08T15:40:22.702409+0000","last_unstale":"2023-10-08T15:40:23.689878+0000","last_undegraded":"2023-10-08T15:40:23.689878+0000","last_fullsized":"2023-10-08T15:40:23.689878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711325+0000","last_change":"2023-10-08T15:40:23.711250+0000","last_active":"2023-10-08T15:40:23.711325+0000","last_peered":"2023-10-08T15:40:23.711325+0000","last_clean":"2023-10-08T15:40:23.711325+0000","last_became_active":"2023-10-08T15:40:23.710219+0000","last_became_peered":"2023-10-08T15:40:23.710219+0000","last_unstale":"2023-10-08T15:40:23.711325+0000","last_undegraded":"2023-10-08T15:40:23.711325+0000","last_fullsized":"2023-10-08T15:40:23.711325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705796+0000","last_change":"2023-10-08T15:40:22.697798+0000","last_active":"2023-10-08T15:40:23.705796+0000","last_peered":"2023-10-08T15:40:23.705796+0000","last_clean":"2023-10-08T15:40:23.705796+0000","last_became_active":"2023-10-08T15:40:22.697562+0000","last_became_peered":"2023-10-08T15:40:22.697562+0000","last_unstale":"2023-10-08T15:40:23.705796+0000","last_undegraded":"2023-10-08T15:40:23.705796+0000","last_fullsized":"2023-10-08T15:40:23.705796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.697935+0000","last_change":"2023-10-08T15:40:23.697679+0000","last_active":"2023-10-08T15:40:23.697935+0000","last_peered":"2023-10-08T15:40:23.697935+0000","last_clean":"2023-10-08T15:40:23.697935+0000","last_became_active":"2023-10-08T15:40:23.697500+0000","last_became_peered":"2023-10-08T15:40:23.697500+0000","last_unstale":"2023-10-08T15:40:23.697935+0000","last_undegraded":"2023-10-08T15:40:23.697935+0000","last_fullsized":"2023-10-08T15:40:23.697935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708929+0000","last_change":"2023-10-08T15:40:22.700551+0000","last_active":"2023-10-08T15:40:23.708929+0000","last_peered":"2023-10-08T15:40:23.708929+0000","last_clean":"2023-10-08T15:40:23.708929+0000","last_became_active":"2023-10-08T15:40:22.700305+0000","last_became_peered":"2023-10-08T15:40:22.700305+0000","last_unstale":"2023-10-08T15:40:23.708929+0000","last_undegraded":"2023-10-08T15:40:23.708929+0000","last_fullsized":"2023-10-08T15:40:23.708929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707313+0000","last_change":"2023-10-08T15:40:23.707252+0000","last_active":"2023-10-08T15:40:23.707313+0000","last_peered":"2023-10-08T15:40:23.707313+0000","last_clean":"2023-10-08T15:40:23.707313+0000","last_became_active":"2023-10-08T15:40:23.706836+0000","last_became_peered":"2023-10-08T15:40:23.706836+0000","last_unstale":"2023-10-08T15:40:23.707313+0000","last_undegraded":"2023-10-08T15:40:23.707313+0000","last_fullsized":"2023-10-08T15:40:23.707313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:56:55.421889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711061+0000","last_change":"2023-10-08T15:40:22.695062+0000","last_active":"2023-10-08T15:40:23.711061+0000","last_peered":"2023-10-08T15:40:23.711061+0000","last_clean":"2023-10-08T15:40:23.711061+0000","last_became_active":"2023-10-08T15:40:22.694763+0000","last_became_peered":"2023-10-08T15:40:22.694763+0000","last_unstale":"2023-10-08T15:40:23.711061+0000","last_undegraded":"2023-10-08T15:40:23.711061+0000","last_fullsized":"2023-10-08T15:40:23.711061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711493+0000","last_change":"2023-10-08T15:40:23.711417+0000","last_active":"2023-10-08T15:40:23.711493+0000","last_peered":"2023-10-08T15:40:23.711493+0000","last_clean":"2023-10-08T15:40:23.711493+0000","last_became_active":"2023-10-08T15:40:23.710718+0000","last_became_peered":"2023-10-08T15:40:23.710718+0000","last_unstale":"2023-10-08T15:40:23.711493+0000","last_undegraded":"2023-10-08T15:40:23.711493+0000","last_fullsized":"2023-10-08T15:40:23.711493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690573+0000","last_change":"2023-10-08T15:40:22.701263+0000","last_active":"2023-10-08T15:40:23.690573+0000","last_peered":"2023-10-08T15:40:23.690573+0000","last_clean":"2023-10-08T15:40:23.690573+0000","last_became_active":"2023-10-08T15:40:22.700296+0000","last_became_peered":"2023-10-08T15:40:22.700296+0000","last_unstale":"2023-10-08T15:40:23.690573+0000","last_undegraded":"2023-10-08T15:40:23.690573+0000","last_fullsized":"2023-10-08T15:40:23.690573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702914+0000","last_change":"2023-10-08T15:40:23.702841+0000","last_active":"2023-10-08T15:40:23.702914+0000","last_peered":"2023-10-08T15:40:23.702914+0000","last_clean":"2023-10-08T15:40:23.702914+0000","last_became_active":"2023-10-08T15:40:23.702595+0000","last_became_peered":"2023-10-08T15:40:23.702595+0000","last_unstale":"2023-10-08T15:40:23.702914+0000","last_undegraded":"2023-10-08T15:40:23.702914+0000","last_fullsized":"2023-10-08T15:40:23.702914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:21.202497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694299+0000","last_change":"2023-10-08T15:40:22.699338+0000","last_active":"2023-10-08T15:40:23.694299+0000","last_peered":"2023-10-08T15:40:23.694299+0000","last_clean":"2023-10-08T15:40:23.694299+0000","last_became_active":"2023-10-08T15:40:22.698307+0000","last_became_peered":"2023-10-08T15:40:22.698307+0000","last_unstale":"2023-10-08T15:40:23.694299+0000","last_undegraded":"2023-10-08T15:40:23.694299+0000","last_fullsized":"2023-10-08T15:40:23.694299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710031+0000","last_change":"2023-10-08T15:40:23.709914+0000","last_active":"2023-10-08T15:40:23.710031+0000","last_peered":"2023-10-08T15:40:23.710031+0000","last_clean":"2023-10-08T15:40:23.710031+0000","last_became_active":"2023-10-08T15:40:23.709690+0000","last_became_peered":"2023-10-08T15:40:23.709690+0000","last_unstale":"2023-10-08T15:40:23.710031+0000","last_undegraded":"2023-10-08T15:40:23.710031+0000","last_fullsized":"2023-10-08T15:40:23.710031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.706704+0000","last_change":"2023-10-08T15:40:22.692944+0000","last_active":"2023-10-08T15:40:23.706704+0000","last_peered":"2023-10-08T15:40:23.706704+0000","last_clean":"2023-10-08T15:40:23.706704+0000","last_became_active":"2023-10-08T15:40:22.692741+0000","last_became_peered":"2023-10-08T15:40:22.692741+0000","last_unstale":"2023-10-08T15:40:23.706704+0000","last_undegraded":"2023-10-08T15:40:23.706704+0000","last_fullsized":"2023-10-08T15:40:23.706704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701648+0000","last_change":"2023-10-08T15:40:23.701472+0000","last_active":"2023-10-08T15:40:23.701648+0000","last_peered":"2023-10-08T15:40:23.701648+0000","last_clean":"2023-10-08T15:40:23.701648+0000","last_became_active":"2023-10-08T15:40:23.701256+0000","last_became_peered":"2023-10-08T15:40:23.701256+0000","last_unstale":"2023-10-08T15:40:23.701648+0000","last_undegraded":"2023-10-08T15:40:23.701648+0000","last_fullsized":"2023-10-08T15:40:23.701648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707703+0000","last_change":"2023-10-08T15:40:22.696237+0000","last_active":"2023-10-08T15:40:23.707703+0000","last_peered":"2023-10-08T15:40:23.707703+0000","last_clean":"2023-10-08T15:40:23.707703+0000","last_became_active":"2023-10-08T15:40:22.695953+0000","last_became_peered":"2023-10-08T15:40:22.695953+0000","last_unstale":"2023-10-08T15:40:23.707703+0000","last_undegraded":"2023-10-08T15:40:23.707703+0000","last_fullsized":"2023-10-08T15:40:23.707703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:40.912548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708134+0000","last_change":"2023-10-08T15:40:23.708069+0000","last_active":"2023-10-08T15:40:23.708134+0000","last_peered":"2023-10-08T15:40:23.708134+0000","last_clean":"2023-10-08T15:40:23.708134+0000","last_became_active":"2023-10-08T15:40:23.707605+0000","last_became_peered":"2023-10-08T15:40:23.707605+0000","last_unstale":"2023-10-08T15:40:23.708134+0000","last_undegraded":"2023-10-08T15:40:23.708134+0000","last_fullsized":"2023-10-08T15:40:23.708134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689446+0000","last_change":"2023-10-08T15:40:22.695667+0000","last_active":"2023-10-08T15:40:23.689446+0000","last_peered":"2023-10-08T15:40:23.689446+0000","last_clean":"2023-10-08T15:40:23.689446+0000","last_became_active":"2023-10-08T15:40:22.695439+0000","last_became_peered":"2023-10-08T15:40:22.695439+0000","last_unstale":"2023-10-08T15:40:23.689446+0000","last_undegraded":"2023-10-08T15:40:23.689446+0000","last_fullsized":"2023-10-08T15:40:23.689446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699711+0000","last_change":"2023-10-08T15:40:23.699438+0000","last_active":"2023-10-08T15:40:23.699711+0000","last_peered":"2023-10-08T15:40:23.699711+0000","last_clean":"2023-10-08T15:40:23.699711+0000","last_became_active":"2023-10-08T15:40:23.697150+0000","last_became_peered":"2023-10-08T15:40:23.697150+0000","last_unstale":"2023-10-08T15:40:23.699711+0000","last_undegraded":"2023-10-08T15:40:23.699711+0000","last_fullsized":"2023-10-08T15:40:23.699711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690287+0000","last_change":"2023-10-08T15:40:22.698283+0000","last_active":"2023-10-08T15:40:23.690287+0000","last_peered":"2023-10-08T15:40:23.690287+0000","last_clean":"2023-10-08T15:40:23.690287+0000","last_became_active":"2023-10-08T15:40:22.697621+0000","last_became_peered":"2023-10-08T15:40:22.697621+0000","last_unstale":"2023-10-08T15:40:23.690287+0000","last_undegraded":"2023-10-08T15:40:23.690287+0000","last_fullsized":"2023-10-08T15:40:23.690287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708554+0000","last_change":"2023-10-08T15:40:23.708442+0000","last_active":"2023-10-08T15:40:23.708554+0000","last_peered":"2023-10-08T15:40:23.708554+0000","last_clean":"2023-10-08T15:40:23.708554+0000","last_became_active":"2023-10-08T15:40:23.708184+0000","last_became_peered":"2023-10-08T15:40:23.708184+0000","last_unstale":"2023-10-08T15:40:23.708554+0000","last_undegraded":"2023-10-08T15:40:23.708554+0000","last_fullsized":"2023-10-08T15:40:23.708554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693436+0000","last_change":"2023-10-08T15:40:23.693350+0000","last_active":"2023-10-08T15:40:23.693436+0000","last_peered":"2023-10-08T15:40:23.693436+0000","last_clean":"2023-10-08T15:40:23.693436+0000","last_became_active":"2023-10-08T15:40:23.693126+0000","last_became_peered":"2023-10-08T15:40:23.693126+0000","last_unstale":"2023-10-08T15:40:23.693436+0000","last_undegraded":"2023-10-08T15:40:23.693436+0000","last_fullsized":"2023-10-08T15:40:23.693436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690921+0000","last_change":"2023-10-08T15:40:22.698673+0000","last_active":"2023-10-08T15:40:23.690921+0000","last_peered":"2023-10-08T15:40:23.690921+0000","last_clean":"2023-10-08T15:40:23.690921+0000","last_became_active":"2023-10-08T15:40:22.698433+0000","last_became_peered":"2023-10-08T15:40:22.698433+0000","last_unstale":"2023-10-08T15:40:23.690921+0000","last_undegraded":"2023-10-08T15:40:23.690921+0000","last_fullsized":"2023-10-08T15:40:23.690921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694799+0000","last_change":"2023-10-08T15:40:23.694732+0000","last_active":"2023-10-08T15:40:23.694799+0000","last_peered":"2023-10-08T15:40:23.694799+0000","last_clean":"2023-10-08T15:40:23.694799+0000","last_became_active":"2023-10-08T15:40:23.694463+0000","last_became_peered":"2023-10-08T15:40:23.694463+0000","last_unstale":"2023-10-08T15:40:23.694799+0000","last_undegraded":"2023-10-08T15:40:23.694799+0000","last_fullsized":"2023-10-08T15:40:23.694799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690975+0000","last_change":"2023-10-08T15:40:22.701412+0000","last_active":"2023-10-08T15:40:23.690975+0000","last_peered":"2023-10-08T15:40:23.690975+0000","last_clean":"2023-10-08T15:40:23.690975+0000","last_became_active":"2023-10-08T15:40:22.701018+0000","last_became_peered":"2023-10-08T15:40:22.701018+0000","last_unstale":"2023-10-08T15:40:23.690975+0000","last_undegraded":"2023-10-08T15:40:23.690975+0000","last_fullsized":"2023-10-08T15:40:23.690975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692909+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:40:23.692909+0000","last_peered":"2023-10-08T15:40:23.692909+0000","last_clean":"2023-10-08T15:40:23.692909+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:40:23.692909+0000","last_undegraded":"2023-10-08T15:40:23.692909+0000","last_fullsized":"2023-10-08T15:40:23.692909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708661+0000","last_change":"2023-10-08T15:40:23.708609+0000","last_active":"2023-10-08T15:40:23.708661+0000","last_peered":"2023-10-08T15:40:23.708661+0000","last_clean":"2023-10-08T15:40:23.708661+0000","last_became_active":"2023-10-08T15:40:23.708135+0000","last_became_peered":"2023-10-08T15:40:23.708135+0000","last_unstale":"2023-10-08T15:40:23.708661+0000","last_undegraded":"2023-10-08T15:40:23.708661+0000","last_fullsized":"2023-10-08T15:40:23.708661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692107+0000","last_change":"2023-10-08T15:40:22.702091+0000","last_active":"2023-10-08T15:40:23.692107+0000","last_peered":"2023-10-08T15:40:23.692107+0000","last_clean":"2023-10-08T15:40:23.692107+0000","last_became_active":"2023-10-08T15:40:22.701729+0000","last_became_peered":"2023-10-08T15:40:22.701729+0000","last_unstale":"2023-10-08T15:40:23.692107+0000","last_undegraded":"2023-10-08T15:40:23.692107+0000","last_fullsized":"2023-10-08T15:40:23.692107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:00.869317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692213+0000","last_change":"2023-10-08T15:40:22.701958+0000","last_active":"2023-10-08T15:40:23.692213+0000","last_peered":"2023-10-08T15:40:23.692213+0000","last_clean":"2023-10-08T15:40:23.692213+0000","last_became_active":"2023-10-08T15:40:22.701237+0000","last_became_peered":"2023-10-08T15:40:22.701237+0000","last_unstale":"2023-10-08T15:40:23.692213+0000","last_undegraded":"2023-10-08T15:40:23.692213+0000","last_fullsized":"2023-10-08T15:40:23.692213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.696404+0000","last_change":"2023-10-08T15:40:23.696335+0000","last_active":"2023-10-08T15:40:23.696404+0000","last_peered":"2023-10-08T15:40:23.696404+0000","last_clean":"2023-10-08T15:40:23.696404+0000","last_became_active":"2023-10-08T15:40:23.696088+0000","last_became_peered":"2023-10-08T15:40:23.696088+0000","last_unstale":"2023-10-08T15:40:23.696404+0000","last_undegraded":"2023-10-08T15:40:23.696404+0000","last_fullsized":"2023-10-08T15:40:23.696404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T15:40:24.689606+0000","last_change":"2023-10-08T15:40:22.702336+0000","last_active":"2023-10-08T15:40:24.689606+0000","last_peered":"2023-10-08T15:40:24.689606+0000","last_clean":"2023-10-08T15:40:24.689606+0000","last_became_active":"2023-10-08T15:40:22.702088+0000","last_became_peered":"2023-10-08T15:40:22.702088+0000","last_unstale":"2023-10-08T15:40:24.689606+0000","last_undegraded":"2023-10-08T15:40:24.689606+0000","last_fullsized":"2023-10-08T15:40:24.689606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711086+0000","last_change":"2023-10-08T15:40:23.711013+0000","last_active":"2023-10-08T15:40:23.711086+0000","last_peered":"2023-10-08T15:40:23.711086+0000","last_clean":"2023-10-08T15:40:23.711086+0000","last_became_active":"2023-10-08T15:40:23.710775+0000","last_became_peered":"2023-10-08T15:40:23.710775+0000","last_unstale":"2023-10-08T15:40:23.711086+0000","last_undegraded":"2023-10-08T15:40:23.711086+0000","last_fullsized":"2023-10-08T15:40:23.711086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705898+0000","last_change":"2023-10-08T15:40:22.699798+0000","last_active":"2023-10-08T15:40:23.705898+0000","last_peered":"2023-10-08T15:40:23.705898+0000","last_clean":"2023-10-08T15:40:23.705898+0000","last_became_active":"2023-10-08T15:40:22.699567+0000","last_became_peered":"2023-10-08T15:40:22.699567+0000","last_unstale":"2023-10-08T15:40:23.705898+0000","last_undegraded":"2023-10-08T15:40:23.705898+0000","last_fullsized":"2023-10-08T15:40:23.705898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708191+0000","last_change":"2023-10-08T15:40:23.707901+0000","last_active":"2023-10-08T15:40:23.708191+0000","last_peered":"2023-10-08T15:40:23.708191+0000","last_clean":"2023-10-08T15:40:23.708191+0000","last_became_active":"2023-10-08T15:40:23.707456+0000","last_became_peered":"2023-10-08T15:40:23.707456+0000","last_unstale":"2023-10-08T15:40:23.708191+0000","last_undegraded":"2023-10-08T15:40:23.708191+0000","last_fullsized":"2023-10-08T15:40:23.708191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693777+0000","last_change":"2023-10-08T15:40:22.701044+0000","last_active":"2023-10-08T15:40:23.693777+0000","last_peered":"2023-10-08T15:40:23.693777+0000","last_clean":"2023-10-08T15:40:23.693777+0000","last_became_active":"2023-10-08T15:40:22.700575+0000","last_became_peered":"2023-10-08T15:40:22.700575+0000","last_unstale":"2023-10-08T15:40:23.693777+0000","last_undegraded":"2023-10-08T15:40:23.693777+0000","last_fullsized":"2023-10-08T15:40:23.693777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702957+0000","last_change":"2023-10-08T15:40:23.702405+0000","last_active":"2023-10-08T15:40:23.702957+0000","last_peered":"2023-10-08T15:40:23.702957+0000","last_clean":"2023-10-08T15:40:23.702957+0000","last_became_active":"2023-10-08T15:40:23.702039+0000","last_became_peered":"2023-10-08T15:40:23.702039+0000","last_unstale":"2023-10-08T15:40:23.702957+0000","last_undegraded":"2023-10-08T15:40:23.702957+0000","last_fullsized":"2023-10-08T15:40:23.702957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689542+0000","last_change":"2023-10-08T15:40:22.700842+0000","last_active":"2023-10-08T15:40:23.689542+0000","last_peered":"2023-10-08T15:40:23.689542+0000","last_clean":"2023-10-08T15:40:23.689542+0000","last_became_active":"2023-10-08T15:40:22.700609+0000","last_became_peered":"2023-10-08T15:40:22.700609+0000","last_unstale":"2023-10-08T15:40:23.689542+0000","last_undegraded":"2023-10-08T15:40:23.689542+0000","last_fullsized":"2023-10-08T15:40:23.689542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693774+0000","last_change":"2023-10-08T15:40:23.693701+0000","last_active":"2023-10-08T15:40:23.693774+0000","last_peered":"2023-10-08T15:40:23.693774+0000","last_clean":"2023-10-08T15:40:23.693774+0000","last_became_active":"2023-10-08T15:40:23.693469+0000","last_became_peered":"2023-10-08T15:40:23.693469+0000","last_unstale":"2023-10-08T15:40:23.693774+0000","last_undegraded":"2023-10-08T15:40:23.693774+0000","last_fullsized":"2023-10-08T15:40:23.693774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689145+0000","last_change":"2023-10-08T15:40:22.700304+0000","last_active":"2023-10-08T15:40:23.689145+0000","last_peered":"2023-10-08T15:40:23.689145+0000","last_clean":"2023-10-08T15:40:23.689145+0000","last_became_active":"2023-10-08T15:40:22.700075+0000","last_became_peered":"2023-10-08T15:40:22.700075+0000","last_unstale":"2023-10-08T15:40:23.689145+0000","last_undegraded":"2023-10-08T15:40:23.689145+0000","last_fullsized":"2023-10-08T15:40:23.689145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709767+0000","last_change":"2023-10-08T15:40:23.709682+0000","last_active":"2023-10-08T15:40:23.709767+0000","last_peered":"2023-10-08T15:40:23.709767+0000","last_clean":"2023-10-08T15:40:23.709767+0000","last_became_active":"2023-10-08T15:40:23.709450+0000","last_became_peered":"2023-10-08T15:40:23.709450+0000","last_unstale":"2023-10-08T15:40:23.709767+0000","last_undegraded":"2023-10-08T15:40:23.709767+0000","last_fullsized":"2023-10-08T15:40:23.709767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707105+0000","last_change":"2023-10-08T15:40:22.699299+0000","last_active":"2023-10-08T15:40:23.707105+0000","last_peered":"2023-10-08T15:40:23.707105+0000","last_clean":"2023-10-08T15:40:23.707105+0000","last_became_active":"2023-10-08T15:40:22.699051+0000","last_became_peered":"2023-10-08T15:40:22.699051+0000","last_unstale":"2023-10-08T15:40:23.707105+0000","last_undegraded":"2023-10-08T15:40:23.707105+0000","last_fullsized":"2023-10-08T15:40:23.707105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699507+0000","last_change":"2023-10-08T15:40:23.699439+0000","last_active":"2023-10-08T15:40:23.699507+0000","last_peered":"2023-10-08T15:40:23.699507+0000","last_clean":"2023-10-08T15:40:23.699507+0000","last_became_active":"2023-10-08T15:40:23.699096+0000","last_became_peered":"2023-10-08T15:40:23.699096+0000","last_unstale":"2023-10-08T15:40:23.699507+0000","last_undegraded":"2023-10-08T15:40:23.699507+0000","last_fullsized":"2023-10-08T15:40:23.699507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.691509+0000","last_change":"2023-10-08T15:40:22.694836+0000","last_active":"2023-10-08T15:40:23.691509+0000","last_peered":"2023-10-08T15:40:23.691509+0000","last_clean":"2023-10-08T15:40:23.691509+0000","last_became_active":"2023-10-08T15:40:22.694608+0000","last_became_peered":"2023-10-08T15:40:22.694608+0000","last_unstale":"2023-10-08T15:40:23.691509+0000","last_undegraded":"2023-10-08T15:40:23.691509+0000","last_fullsized":"2023-10-08T15:40:23.691509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703621+0000","last_change":"2023-10-08T15:40:23.703118+0000","last_active":"2023-10-08T15:40:23.703621+0000","last_peered":"2023-10-08T15:40:23.703621+0000","last_clean":"2023-10-08T15:40:23.703621+0000","last_became_active":"2023-10-08T15:40:23.702720+0000","last_became_peered":"2023-10-08T15:40:23.702720+0000","last_unstale":"2023-10-08T15:40:23.703621+0000","last_undegraded":"2023-10-08T15:40:23.703621+0000","last_fullsized":"2023-10-08T15:40:23.703621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:47.802873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703205+0000","last_change":"2023-10-08T15:40:22.694954+0000","last_active":"2023-10-08T15:40:23.703205+0000","last_peered":"2023-10-08T15:40:23.703205+0000","last_clean":"2023-10-08T15:40:23.703205+0000","last_became_active":"2023-10-08T15:40:22.694720+0000","last_became_peered":"2023-10-08T15:40:22.694720+0000","last_unstale":"2023-10-08T15:40:23.703205+0000","last_undegraded":"2023-10-08T15:40:23.703205+0000","last_fullsized":"2023-10-08T15:40:23.703205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700201+0000","last_change":"2023-10-08T15:40:23.700137+0000","last_active":"2023-10-08T15:40:23.700201+0000","last_peered":"2023-10-08T15:40:23.700201+0000","last_clean":"2023-10-08T15:40:23.700201+0000","last_became_active":"2023-10-08T15:40:23.699832+0000","last_became_peered":"2023-10-08T15:40:23.699832+0000","last_unstale":"2023-10-08T15:40:23.700201+0000","last_undegraded":"2023-10-08T15:40:23.700201+0000","last_fullsized":"2023-10-08T15:40:23.700201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707215+0000","last_change":"2023-10-08T15:40:22.696186+0000","last_active":"2023-10-08T15:40:23.707215+0000","last_peered":"2023-10-08T15:40:23.707215+0000","last_clean":"2023-10-08T15:40:23.707215+0000","last_became_active":"2023-10-08T15:40:22.695949+0000","last_became_peered":"2023-10-08T15:40:22.695949+0000","last_unstale":"2023-10-08T15:40:23.707215+0000","last_undegraded":"2023-10-08T15:40:23.707215+0000","last_fullsized":"2023-10-08T15:40:23.707215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700110+0000","last_change":"2023-10-08T15:40:23.699621+0000","last_active":"2023-10-08T15:40:23.700110+0000","last_peered":"2023-10-08T15:40:23.700110+0000","last_clean":"2023-10-08T15:40:23.700110+0000","last_became_active":"2023-10-08T15:40:23.699275+0000","last_became_peered":"2023-10-08T15:40:23.699275+0000","last_unstale":"2023-10-08T15:40:23.700110+0000","last_undegraded":"2023-10-08T15:40:23.700110+0000","last_fullsized":"2023-10-08T15:40:23.700110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:25.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709672+0000","last_change":"2023-10-08T15:40:23.709581+0000","last_active":"2023-10-08T15:40:23.709672+0000","last_peered":"2023-10-08T15:40:23.709672+0000","last_clean":"2023-10-08T15:40:23.709672+0000","last_became_active":"2023-10-08T15:40:23.709337+0000","last_became_peered":"2023-10-08T15:40:23.709337+0000","last_unstale":"2023-10-08T15:40:23.709672+0000","last_undegraded":"2023-10-08T15:40:23.709672+0000","last_fullsized":"2023-10-08T15:40:23.709672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711931+0000","last_change":"2023-10-08T15:40:23.711865+0000","last_active":"2023-10-08T15:40:23.711931+0000","last_peered":"2023-10-08T15:40:23.711931+0000","last_clean":"2023-10-08T15:40:23.711931+0000","last_became_active":"2023-10-08T15:40:23.711619+0000","last_became_peered":"2023-10-08T15:40:23.711619+0000","last_unstale":"2023-10-08T15:40:23.711931+0000","last_undegraded":"2023-10-08T15:40:23.711931+0000","last_fullsized":"2023-10-08T15:40:23.711931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.696945+0000","last_change":"2023-10-08T15:40:23.696703+0000","last_active":"2023-10-08T15:40:23.696945+0000","last_peered":"2023-10-08T15:40:23.696945+0000","last_clean":"2023-10-08T15:40:23.696945+0000","last_became_active":"2023-10-08T15:40:23.696465+0000","last_became_peered":"2023-10-08T15:40:23.696465+0000","last_unstale":"2023-10-08T15:40:23.696945+0000","last_undegraded":"2023-10-08T15:40:23.696945+0000","last_fullsized":"2023-10-08T15:40:23.696945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:21.202497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707466+0000","last_change":"2023-10-08T15:40:23.707367+0000","last_active":"2023-10-08T15:40:23.707466+0000","last_peered":"2023-10-08T15:40:23.707466+0000","last_clean":"2023-10-08T15:40:23.707466+0000","last_became_active":"2023-10-08T15:40:23.706468+0000","last_became_peered":"2023-10-08T15:40:23.706468+0000","last_unstale":"2023-10-08T15:40:23.707466+0000","last_undegraded":"2023-10-08T15:40:23.707466+0000","last_fullsized":"2023-10-08T15:40:23.707466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703465+0000","last_change":"2023-10-08T15:40:23.703030+0000","last_active":"2023-10-08T15:40:23.703465+0000","last_peered":"2023-10-08T15:40:23.703465+0000","last_clean":"2023-10-08T15:40:23.703465+0000","last_became_active":"2023-10-08T15:40:23.702048+0000","last_became_peered":"2023-10-08T15:40:23.702048+0000","last_unstale":"2023-10-08T15:40:23.703465+0000","last_undegraded":"2023-10-08T15:40:23.703465+0000","last_fullsized":"2023-10-08T15:40:23.703465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693260+0000","last_change":"2023-10-08T15:40:23.693188+0000","last_active":"2023-10-08T15:40:23.693260+0000","last_peered":"2023-10-08T15:40:23.693260+0000","last_clean":"2023-10-08T15:40:23.693260+0000","last_became_active":"2023-10-08T15:40:23.692944+0000","last_became_peered":"2023-10-08T15:40:23.692944+0000","last_unstale":"2023-10-08T15:40:23.693260+0000","last_undegraded":"2023-10-08T15:40:23.693260+0000","last_fullsized":"2023-10-08T15:40:23.693260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701609+0000","last_change":"2023-10-08T15:40:23.701502+0000","last_active":"2023-10-08T15:40:23.701609+0000","last_peered":"2023-10-08T15:40:23.701609+0000","last_clean":"2023-10-08T15:40:23.701609+0000","last_became_active":"2023-10-08T15:40:23.701163+0000","last_became_peered":"2023-10-08T15:40:23.701163+0000","last_unstale":"2023-10-08T15:40:23.701609+0000","last_undegraded":"2023-10-08T15:40:23.701609+0000","last_fullsized":"2023-10-08T15:40:23.701609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705950+0000","last_change":"2023-10-08T15:40:23.705746+0000","last_active":"2023-10-08T15:40:23.705950+0000","last_peered":"2023-10-08T15:40:23.705950+0000","last_clean":"2023-10-08T15:40:23.705950+0000","last_became_active":"2023-10-08T15:40:23.705532+0000","last_became_peered":"2023-10-08T15:40:23.705532+0000","last_unstale":"2023-10-08T15:40:23.705950+0000","last_undegraded":"2023-10-08T15:40:23.705950+0000","last_fullsized":"2023-10-08T15:40:23.705950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699729+0000","last_change":"2023-10-08T15:40:23.699584+0000","last_active":"2023-10-08T15:40:23.699729+0000","last_peered":"2023-10-08T15:40:23.699729+0000","last_clean":"2023-10-08T15:40:23.699729+0000","last_became_active":"2023-10-08T15:40:23.697371+0000","last_became_peered":"2023-10-08T15:40:23.697371+0000","last_unstale":"2023-10-08T15:40:23.699729+0000","last_undegraded":"2023-10-08T15:40:23.699729+0000","last_fullsized":"2023-10-08T15:40:23.699729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703480+0000","last_change":"2023-10-08T15:40:23.703199+0000","last_active":"2023-10-08T15:40:23.703480+0000","last_peered":"2023-10-08T15:40:23.703480+0000","last_clean":"2023-10-08T15:40:23.703480+0000","last_became_active":"2023-10-08T15:40:23.702381+0000","last_became_peered":"2023-10-08T15:40:23.702381+0000","last_unstale":"2023-10-08T15:40:23.703480+0000","last_undegraded":"2023-10-08T15:40:23.703480+0000","last_fullsized":"2023-10-08T15:40:23.703480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708427+0000","last_change":"2023-10-08T15:40:23.704911+0000","last_active":"2023-10-08T15:40:23.708427+0000","last_peered":"2023-10-08T15:40:23.708427+0000","last_clean":"2023-10-08T15:40:23.708427+0000","last_became_active":"2023-10-08T15:40:23.702946+0000","last_became_peered":"2023-10-08T15:40:23.702946+0000","last_unstale":"2023-10-08T15:40:23.708427+0000","last_undegraded":"2023-10-08T15:40:23.708427+0000","last_fullsized":"2023-10-08T15:40:23.708427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711664+0000","last_change":"2023-10-08T15:40:23.711593+0000","last_active":"2023-10-08T15:40:23.711664+0000","last_peered":"2023-10-08T15:40:23.711664+0000","last_clean":"2023-10-08T15:40:23.711664+0000","last_became_active":"2023-10-08T15:40:23.711030+0000","last_became_peered":"2023-10-08T15:40:23.711030+0000","last_unstale":"2023-10-08T15:40:23.711664+0000","last_undegraded":"2023-10-08T15:40:23.711664+0000","last_fullsized":"2023-10-08T15:40:23.711664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704150+0000","last_change":"2023-10-08T15:40:23.704080+0000","last_active":"2023-10-08T15:40:23.704150+0000","last_peered":"2023-10-08T15:40:23.704150+0000","last_clean":"2023-10-08T15:40:23.704150+0000","last_became_active":"2023-10-08T15:40:23.703850+0000","last_became_peered":"2023-10-08T15:40:23.703850+0000","last_unstale":"2023-10-08T15:40:23.704150+0000","last_undegraded":"2023-10-08T15:40:23.704150+0000","last_fullsized":"2023-10-08T15:40:23.704150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[]}} 2023-10-08T15:40:37.177 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:40:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.328+0000 7fcd78148700 1 Processor -- start 2023-10-08T15:40:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.328+0000 7fcd78148700 1 -- start start 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd78148700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcd70157870 0x7fcd7015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd78148700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd7015a620 0x7fcd7015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd78148700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7015cbb0 con 0x7fcd7015d580 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd78148700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7015bfa0 con 0x7fcd7015a620 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd78148700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7015c280 con 0x7fcd70157870 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd756e3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd7015a620 0x7fcd7015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd756e3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcd7015a620 0x7fcd7015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33946/0 (socket says 172.21.15.29:33946) 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd756e3700 1 -- 172.21.15.29:0/460142616 learned_addr learned my addr 172.21.15.29:0/460142616 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd75ee4700 1 --2- 172.21.15.29:0/460142616 >> v2:172.21.15.183:3300/0 conn(0x7fcd70157870 0x7fcd7015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd756e3700 1 -- 172.21.15.29:0/460142616 >> v2:172.21.15.183:3300/0 conn(0x7fcd70157870 msgr2=0x7fcd7015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd756e3700 1 --2- 172.21.15.29:0/460142616 >> v2:172.21.15.183:3300/0 conn(0x7fcd70157870 0x7fcd7015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd756e3700 1 -- 172.21.15.29:0/460142616 >> v1:172.21.15.183:6789/0 conn(0x7fcd7015d580 legacy=0x7fcd70158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd756e3700 1 -- 172.21.15.29:0/460142616 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7015c560 con 0x7fcd7015a620 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd75ee4700 1 --2- 172.21.15.29:0/460142616 >> v2:172.21.15.183:3300/0 conn(0x7fcd70157870 0x7fcd7015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd756e3700 1 --2- 172.21.15.29:0/460142616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd7015a620 0x7fcd7015d040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcd70069d80 tx=0x7fcd64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5b066f249d59bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd74ee2700 1 -- 172.21.15.29:0/460142616 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400b820 con 0x7fcd7015a620 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.329+0000 7fcd74ee2700 1 -- 172.21.15.29:0/460142616 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6400b980 con 0x7fcd7015a620 2023-10-08T15:40:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd74ee2700 1 -- 172.21.15.29:0/460142616 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400bd20 con 0x7fcd7015a620 2023-10-08T15:40:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd78148700 1 -- 172.21.15.29:0/460142616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd7015a620 msgr2=0x7fcd7015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd78148700 1 --2- 172.21.15.29:0/460142616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd7015a620 0x7fcd7015d040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcd70069d80 tx=0x7fcd64009250 comp rx=0 tx=0).stop 2023-10-08T15:40:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd78148700 1 -- 172.21.15.29:0/460142616 shutdown_connections 2023-10-08T15:40:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd78148700 1 --2- 172.21.15.29:0/460142616 >> v2:172.21.15.183:3300/0 conn(0x7fcd70157870 0x7fcd7015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd78148700 1 --2- 172.21.15.29:0/460142616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd7015a620 0x7fcd7015d040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd78148700 1 -- 172.21.15.29:0/460142616 >> 172.21.15.29:0/460142616 conn(0x7fcd70068ce0 msgr2=0x7fcd700690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd78148700 1 -- 172.21.15.29:0/460142616 shutdown_connections 2023-10-08T15:40:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.330+0000 7fcd78148700 1 -- 172.21.15.29:0/460142616 wait complete. 2023-10-08T15:40:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.331+0000 7fcd78148700 1 Processor -- start 2023-10-08T15:40:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.331+0000 7fcd78148700 1 -- start start 2023-10-08T15:40:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd78148700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd70157870 0x7fcd700cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd78148700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7015a620 0x7fcd700b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd78148700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7015d580 0x7fcd7014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd78148700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700d02b0 con 0x7fcd70157870 2023-10-08T15:40:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd78148700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700b1e20 con 0x7fcd7015a620 2023-10-08T15:40:37.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd78148700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7014d9b0 con 0x7fcd7015d580 2023-10-08T15:40:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd75ee4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd70157870 0x7fcd700cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd75ee4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd70157870 0x7fcd700cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33956/0 (socket says 172.21.15.29:33956) 2023-10-08T15:40:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd75ee4700 1 -- 172.21.15.29:0/1804570970 learned_addr learned my addr 172.21.15.29:0/1804570970 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd756e3700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7015a620 0x7fcd700b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd766e5700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7015d580 0x7fcd7014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd75ee4700 1 -- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7015d580 msgr2=0x7fcd7014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd75ee4700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7015d580 0x7fcd7014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd75ee4700 1 -- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7015a620 msgr2=0x7fcd700b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd75ee4700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7015a620 0x7fcd700b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd75ee4700 1 -- 172.21.15.29:0/1804570970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd640094f0 con 0x7fcd70157870 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.332+0000 7fcd766e5700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7015d580 0x7fcd7014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.333+0000 7fcd75ee4700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd70157870 0x7fcd700cfd70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000a400 tx=0x7fcd60007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.333+0000 7fcd6dffb700 1 -- 172.21.15.29:0/1804570970 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000ae20 con 0x7fcd70157870 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.333+0000 7fcd6dffb700 1 -- 172.21.15.29:0/1804570970 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6000d650 con 0x7fcd70157870 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.333+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd700b2050 con 0x7fcd70157870 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.333+0000 7fcd6dffb700 1 -- 172.21.15.29:0/1804570970 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000d9f0 con 0x7fcd70157870 2023-10-08T15:40:37.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.333+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd700b2610 con 0x7fcd70157870 2023-10-08T15:40:37.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.334+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7004c3c0 con 0x7fcd70157870 2023-10-08T15:40:37.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.334+0000 7fcd6dffb700 1 -- 172.21.15.29:0/1804570970 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd60015440 con 0x7fcd70157870 2023-10-08T15:40:37.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.334+0000 7fcd6dffb700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.334+0000 7fcd6dffb700 1 -- 172.21.15.29:0/1804570970 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd60084da0 con 0x7fcd70157870 2023-10-08T15:40:37.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.335+0000 7fcd756e3700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.335+0000 7fcd756e3700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcd5c066f30 0x7fcd5c0693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd70069d80 tx=0x7fcd64016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:37.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.339+0000 7fcd6dffb700 1 -- 172.21.15.29:0/1804570970 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd6004e5a0 con 0x7fcd70157870 2023-10-08T15:40:37.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.529+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd7015c840 con 0x7fcd5c066f30 2023-10-08T15:40:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.536+0000 7fcd6dffb700 1 -- 172.21.15.29:0/1804570970 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260175 (secure 0 0 0) 0x7fcd7015c840 con 0x7fcd5c066f30 2023-10-08T15:40:37.540 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcd5c066f30 msgr2=0x7fcd5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcd5c066f30 0x7fcd5c0693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd70069d80 tx=0x7fcd64016000 comp rx=0 tx=0).stop 2023-10-08T15:40:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd70157870 msgr2=0x7fcd700cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd70157870 0x7fcd700cfd70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000a400 tx=0x7fcd60007910 comp rx=0 tx=0).stop 2023-10-08T15:40:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 shutdown_connections 2023-10-08T15:40:37.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7015d580 0x7fcd7014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd70157870 0x7fcd700cfd70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 --2- 172.21.15.29:0/1804570970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7015a620 0x7fcd700b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 >> 172.21.15.29:0/1804570970 conn(0x7fcd70068ce0 msgr2=0x7fcd701582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:37.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 shutdown_connections 2023-10-08T15:40:37.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.540+0000 7fcd78148700 1 -- 172.21.15.29:0/1804570970 wait complete. 2023-10-08T15:40:37.543 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:40:37.552 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T15:40:36.305515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.613450"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701562+0000","last_change":"2023-10-08T15:40:23.700602+0000","last_active":"2023-10-08T15:40:23.701562+0000","last_peered":"2023-10-08T15:40:23.701562+0000","last_clean":"2023-10-08T15:40:23.701562+0000","last_became_active":"2023-10-08T15:40:23.700351+0000","last_became_peered":"2023-10-08T15:40:23.700351+0000","last_unstale":"2023-10-08T15:40:23.701562+0000","last_undegraded":"2023-10-08T15:40:23.701562+0000","last_fullsized":"2023-10-08T15:40:23.701562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:17.290508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705971+0000","last_change":"2023-10-08T15:40:23.705905+0000","last_active":"2023-10-08T15:40:23.705971+0000","last_peered":"2023-10-08T15:40:23.705971+0000","last_clean":"2023-10-08T15:40:23.705971+0000","last_became_active":"2023-10-08T15:40:23.705644+0000","last_became_peered":"2023-10-08T15:40:23.705644+0000","last_unstale":"2023-10-08T15:40:23.705971+0000","last_undegraded":"2023-10-08T15:40:23.705971+0000","last_fullsized":"2023-10-08T15:40:23.705971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707366+0000","last_change":"2023-10-08T15:40:23.705871+0000","last_active":"2023-10-08T15:40:23.707366+0000","last_peered":"2023-10-08T15:40:23.707366+0000","last_clean":"2023-10-08T15:40:23.707366+0000","last_became_active":"2023-10-08T15:40:23.705207+0000","last_became_peered":"2023-10-08T15:40:23.705207+0000","last_unstale":"2023-10-08T15:40:23.707366+0000","last_undegraded":"2023-10-08T15:40:23.707366+0000","last_fullsized":"2023-10-08T15:40:23.707366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695623+0000","last_change":"2023-10-08T15:40:23.695515+0000","last_active":"2023-10-08T15:40:23.695623+0000","last_peered":"2023-10-08T15:40:23.695623+0000","last_clean":"2023-10-08T15:40:23.695623+0000","last_became_active":"2023-10-08T15:40:23.695301+0000","last_became_peered":"2023-10-08T15:40:23.695301+0000","last_unstale":"2023-10-08T15:40:23.695623+0000","last_undegraded":"2023-10-08T15:40:23.695623+0000","last_fullsized":"2023-10-08T15:40:23.695623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:56:55.421889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700059+0000","last_change":"2023-10-08T15:40:23.698698+0000","last_active":"2023-10-08T15:40:23.700059+0000","last_peered":"2023-10-08T15:40:23.700059+0000","last_clean":"2023-10-08T15:40:23.700059+0000","last_became_active":"2023-10-08T15:40:23.698435+0000","last_became_peered":"2023-10-08T15:40:23.698435+0000","last_unstale":"2023-10-08T15:40:23.700059+0000","last_undegraded":"2023-10-08T15:40:23.700059+0000","last_fullsized":"2023-10-08T15:40:23.700059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:27.901303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710147+0000","last_change":"2023-10-08T15:40:23.709600+0000","last_active":"2023-10-08T15:40:23.710147+0000","last_peered":"2023-10-08T15:40:23.710147+0000","last_clean":"2023-10-08T15:40:23.710147+0000","last_became_active":"2023-10-08T15:40:23.709218+0000","last_became_peered":"2023-10-08T15:40:23.709218+0000","last_unstale":"2023-10-08T15:40:23.710147+0000","last_undegraded":"2023-10-08T15:40:23.710147+0000","last_fullsized":"2023-10-08T15:40:23.710147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:17.290508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711213+0000","last_change":"2023-10-08T15:40:23.711171+0000","last_active":"2023-10-08T15:40:23.711213+0000","last_peered":"2023-10-08T15:40:23.711213+0000","last_clean":"2023-10-08T15:40:23.711213+0000","last_became_active":"2023-10-08T15:40:23.710893+0000","last_became_peered":"2023-10-08T15:40:23.710893+0000","last_unstale":"2023-10-08T15:40:23.711213+0000","last_undegraded":"2023-10-08T15:40:23.711213+0000","last_fullsized":"2023-10-08T15:40:23.711213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703451+0000","last_change":"2023-10-08T15:40:23.702893+0000","last_active":"2023-10-08T15:40:23.703451+0000","last_peered":"2023-10-08T15:40:23.703451+0000","last_clean":"2023-10-08T15:40:23.703451+0000","last_became_active":"2023-10-08T15:40:23.701153+0000","last_became_peered":"2023-10-08T15:40:23.701153+0000","last_unstale":"2023-10-08T15:40:23.703451+0000","last_undegraded":"2023-10-08T15:40:23.703451+0000","last_fullsized":"2023-10-08T15:40:23.703451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704759+0000","last_change":"2023-10-08T15:40:23.704635+0000","last_active":"2023-10-08T15:40:23.704759+0000","last_peered":"2023-10-08T15:40:23.704759+0000","last_clean":"2023-10-08T15:40:23.704759+0000","last_became_active":"2023-10-08T15:40:23.704385+0000","last_became_peered":"2023-10-08T15:40:23.704385+0000","last_unstale":"2023-10-08T15:40:23.704759+0000","last_undegraded":"2023-10-08T15:40:23.704759+0000","last_fullsized":"2023-10-08T15:40:23.704759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:08:21.476854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709217+0000","last_change":"2023-10-08T15:40:23.709147+0000","last_active":"2023-10-08T15:40:23.709217+0000","last_peered":"2023-10-08T15:40:23.709217+0000","last_clean":"2023-10-08T15:40:23.709217+0000","last_became_active":"2023-10-08T15:40:23.708936+0000","last_became_peered":"2023-10-08T15:40:23.708936+0000","last_unstale":"2023-10-08T15:40:23.709217+0000","last_undegraded":"2023-10-08T15:40:23.709217+0000","last_fullsized":"2023-10-08T15:40:23.709217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.706519+0000","last_change":"2023-10-08T15:40:23.706380+0000","last_active":"2023-10-08T15:40:23.706519+0000","last_peered":"2023-10-08T15:40:23.706519+0000","last_clean":"2023-10-08T15:40:23.706519+0000","last_became_active":"2023-10-08T15:40:23.706144+0000","last_became_peered":"2023-10-08T15:40:23.706144+0000","last_unstale":"2023-10-08T15:40:23.706519+0000","last_undegraded":"2023-10-08T15:40:23.706519+0000","last_fullsized":"2023-10-08T15:40:23.706519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695687+0000","last_change":"2023-10-08T15:40:23.695528+0000","last_active":"2023-10-08T15:40:23.695687+0000","last_peered":"2023-10-08T15:40:23.695687+0000","last_clean":"2023-10-08T15:40:23.695687+0000","last_became_active":"2023-10-08T15:40:23.695302+0000","last_became_peered":"2023-10-08T15:40:23.695302+0000","last_unstale":"2023-10-08T15:40:23.695687+0000","last_undegraded":"2023-10-08T15:40:23.695687+0000","last_fullsized":"2023-10-08T15:40:23.695687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.713048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703495+0000","last_change":"2023-10-08T15:40:23.703349+0000","last_active":"2023-10-08T15:40:23.703495+0000","last_peered":"2023-10-08T15:40:23.703495+0000","last_clean":"2023-10-08T15:40:23.703495+0000","last_became_active":"2023-10-08T15:40:23.702660+0000","last_became_peered":"2023-10-08T15:40:23.702660+0000","last_unstale":"2023-10-08T15:40:23.703495+0000","last_undegraded":"2023-10-08T15:40:23.703495+0000","last_fullsized":"2023-10-08T15:40:23.703495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707426+0000","last_change":"2023-10-08T15:40:23.707180+0000","last_active":"2023-10-08T15:40:23.707426+0000","last_peered":"2023-10-08T15:40:23.707426+0000","last_clean":"2023-10-08T15:40:23.707426+0000","last_became_active":"2023-10-08T15:40:23.706069+0000","last_became_peered":"2023-10-08T15:40:23.706069+0000","last_unstale":"2023-10-08T15:40:23.707426+0000","last_undegraded":"2023-10-08T15:40:23.707426+0000","last_fullsized":"2023-10-08T15:40:23.707426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703755+0000","last_change":"2023-10-08T15:40:23.703647+0000","last_active":"2023-10-08T15:40:23.703755+0000","last_peered":"2023-10-08T15:40:23.703755+0000","last_clean":"2023-10-08T15:40:23.703755+0000","last_became_active":"2023-10-08T15:40:23.703408+0000","last_became_peered":"2023-10-08T15:40:23.703408+0000","last_unstale":"2023-10-08T15:40:23.703755+0000","last_undegraded":"2023-10-08T15:40:23.703755+0000","last_fullsized":"2023-10-08T15:40:23.703755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710129+0000","last_change":"2023-10-08T15:40:23.709470+0000","last_active":"2023-10-08T15:40:23.710129+0000","last_peered":"2023-10-08T15:40:23.710129+0000","last_clean":"2023-10-08T15:40:23.710129+0000","last_became_active":"2023-10-08T15:40:23.708885+0000","last_became_peered":"2023-10-08T15:40:23.708885+0000","last_unstale":"2023-10-08T15:40:23.710129+0000","last_undegraded":"2023-10-08T15:40:23.710129+0000","last_fullsized":"2023-10-08T15:40:23.710129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:27.901303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705498+0000","last_change":"2023-10-08T15:40:23.703463+0000","last_active":"2023-10-08T15:40:23.705498+0000","last_peered":"2023-10-08T15:40:23.705498+0000","last_clean":"2023-10-08T15:40:23.705498+0000","last_became_active":"2023-10-08T15:40:23.702524+0000","last_became_peered":"2023-10-08T15:40:23.702524+0000","last_unstale":"2023-10-08T15:40:23.705498+0000","last_undegraded":"2023-10-08T15:40:23.705498+0000","last_fullsized":"2023-10-08T15:40:23.705498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704661+0000","last_change":"2023-10-08T15:40:23.702028+0000","last_active":"2023-10-08T15:40:23.704661+0000","last_peered":"2023-10-08T15:40:23.704661+0000","last_clean":"2023-10-08T15:40:23.704661+0000","last_became_active":"2023-10-08T15:40:23.701778+0000","last_became_peered":"2023-10-08T15:40:23.701778+0000","last_unstale":"2023-10-08T15:40:23.704661+0000","last_undegraded":"2023-10-08T15:40:23.704661+0000","last_fullsized":"2023-10-08T15:40:23.704661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700079+0000","last_change":"2023-10-08T15:40:23.699492+0000","last_active":"2023-10-08T15:40:23.700079+0000","last_peered":"2023-10-08T15:40:23.700079+0000","last_clean":"2023-10-08T15:40:23.700079+0000","last_became_active":"2023-10-08T15:40:23.698975+0000","last_became_peered":"2023-10-08T15:40:23.698975+0000","last_unstale":"2023-10-08T15:40:23.700079+0000","last_undegraded":"2023-10-08T15:40:23.700079+0000","last_fullsized":"2023-10-08T15:40:23.700079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710621+0000","last_change":"2023-10-08T15:40:22.695776+0000","last_active":"2023-10-08T15:40:23.710621+0000","last_peered":"2023-10-08T15:40:23.710621+0000","last_clean":"2023-10-08T15:40:23.710621+0000","last_became_active":"2023-10-08T15:40:22.695553+0000","last_became_peered":"2023-10-08T15:40:22.695553+0000","last_unstale":"2023-10-08T15:40:23.710621+0000","last_undegraded":"2023-10-08T15:40:23.710621+0000","last_fullsized":"2023-10-08T15:40:23.710621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.698627+0000","last_change":"2023-10-08T15:40:23.697252+0000","last_active":"2023-10-08T15:40:23.698627+0000","last_peered":"2023-10-08T15:40:23.698627+0000","last_clean":"2023-10-08T15:40:23.698627+0000","last_became_active":"2023-10-08T15:40:23.697020+0000","last_became_peered":"2023-10-08T15:40:23.697020+0000","last_unstale":"2023-10-08T15:40:23.698627+0000","last_undegraded":"2023-10-08T15:40:23.698627+0000","last_fullsized":"2023-10-08T15:40:23.698627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708476+0000","last_change":"2023-10-08T15:40:22.699564+0000","last_active":"2023-10-08T15:40:23.708476+0000","last_peered":"2023-10-08T15:40:23.708476+0000","last_clean":"2023-10-08T15:40:23.708476+0000","last_became_active":"2023-10-08T15:40:22.698627+0000","last_became_peered":"2023-10-08T15:40:22.698627+0000","last_unstale":"2023-10-08T15:40:23.708476+0000","last_undegraded":"2023-10-08T15:40:23.708476+0000","last_fullsized":"2023-10-08T15:40:23.708476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707387+0000","last_change":"2023-10-08T15:40:23.706021+0000","last_active":"2023-10-08T15:40:23.707387+0000","last_peered":"2023-10-08T15:40:23.707387+0000","last_clean":"2023-10-08T15:40:23.707387+0000","last_became_active":"2023-10-08T15:40:23.705521+0000","last_became_peered":"2023-10-08T15:40:23.705521+0000","last_unstale":"2023-10-08T15:40:23.707387+0000","last_undegraded":"2023-10-08T15:40:23.707387+0000","last_fullsized":"2023-10-08T15:40:23.707387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707933+0000","last_change":"2023-10-08T15:40:22.700173+0000","last_active":"2023-10-08T15:40:23.707933+0000","last_peered":"2023-10-08T15:40:23.707933+0000","last_clean":"2023-10-08T15:40:23.707933+0000","last_became_active":"2023-10-08T15:40:22.699897+0000","last_became_peered":"2023-10-08T15:40:22.699897+0000","last_unstale":"2023-10-08T15:40:23.707933+0000","last_undegraded":"2023-10-08T15:40:23.707933+0000","last_fullsized":"2023-10-08T15:40:23.707933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:48.001159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702397+0000","last_change":"2023-10-08T15:40:23.702311+0000","last_active":"2023-10-08T15:40:23.702397+0000","last_peered":"2023-10-08T15:40:23.702397+0000","last_clean":"2023-10-08T15:40:23.702397+0000","last_became_active":"2023-10-08T15:40:23.702075+0000","last_became_peered":"2023-10-08T15:40:23.702075+0000","last_unstale":"2023-10-08T15:40:23.702397+0000","last_undegraded":"2023-10-08T15:40:23.702397+0000","last_fullsized":"2023-10-08T15:40:23.702397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:47.802873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709088+0000","last_change":"2023-10-08T15:40:22.702341+0000","last_active":"2023-10-08T15:40:23.709088+0000","last_peered":"2023-10-08T15:40:23.709088+0000","last_clean":"2023-10-08T15:40:23.709088+0000","last_became_active":"2023-10-08T15:40:22.701383+0000","last_became_peered":"2023-10-08T15:40:22.701383+0000","last_unstale":"2023-10-08T15:40:23.709088+0000","last_undegraded":"2023-10-08T15:40:23.709088+0000","last_fullsized":"2023-10-08T15:40:23.709088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708763+0000","last_change":"2023-10-08T15:40:23.708521+0000","last_active":"2023-10-08T15:40:23.708763+0000","last_peered":"2023-10-08T15:40:23.708763+0000","last_clean":"2023-10-08T15:40:23.708763+0000","last_became_active":"2023-10-08T15:40:23.708313+0000","last_became_peered":"2023-10-08T15:40:23.708313+0000","last_unstale":"2023-10-08T15:40:23.708763+0000","last_undegraded":"2023-10-08T15:40:23.708763+0000","last_fullsized":"2023-10-08T15:40:23.708763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703043+0000","last_change":"2023-10-08T15:40:22.698477+0000","last_active":"2023-10-08T15:40:23.703043+0000","last_peered":"2023-10-08T15:40:23.703043+0000","last_clean":"2023-10-08T15:40:23.703043+0000","last_became_active":"2023-10-08T15:40:22.698057+0000","last_became_peered":"2023-10-08T15:40:22.698057+0000","last_unstale":"2023-10-08T15:40:23.703043+0000","last_undegraded":"2023-10-08T15:40:23.703043+0000","last_fullsized":"2023-10-08T15:40:23.703043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695668+0000","last_change":"2023-10-08T15:40:23.695420+0000","last_active":"2023-10-08T15:40:23.695668+0000","last_peered":"2023-10-08T15:40:23.695668+0000","last_clean":"2023-10-08T15:40:23.695668+0000","last_became_active":"2023-10-08T15:40:23.695193+0000","last_became_peered":"2023-10-08T15:40:23.695193+0000","last_unstale":"2023-10-08T15:40:23.695668+0000","last_undegraded":"2023-10-08T15:40:23.695668+0000","last_fullsized":"2023-10-08T15:40:23.695668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704172+0000","last_change":"2023-10-08T15:40:22.695547+0000","last_active":"2023-10-08T15:40:23.704172+0000","last_peered":"2023-10-08T15:40:23.704172+0000","last_clean":"2023-10-08T15:40:23.704172+0000","last_became_active":"2023-10-08T15:40:22.695272+0000","last_became_peered":"2023-10-08T15:40:22.695272+0000","last_unstale":"2023-10-08T15:40:23.704172+0000","last_undegraded":"2023-10-08T15:40:23.704172+0000","last_fullsized":"2023-10-08T15:40:23.704172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708209+0000","last_change":"2023-10-08T15:40:23.708141+0000","last_active":"2023-10-08T15:40:23.708209+0000","last_peered":"2023-10-08T15:40:23.708209+0000","last_clean":"2023-10-08T15:40:23.708209+0000","last_became_active":"2023-10-08T15:40:23.707923+0000","last_became_peered":"2023-10-08T15:40:23.707923+0000","last_unstale":"2023-10-08T15:40:23.708209+0000","last_undegraded":"2023-10-08T15:40:23.708209+0000","last_fullsized":"2023-10-08T15:40:23.708209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692120+0000","last_change":"2023-10-08T15:40:22.700006+0000","last_active":"2023-10-08T15:40:23.692120+0000","last_peered":"2023-10-08T15:40:23.692120+0000","last_clean":"2023-10-08T15:40:23.692120+0000","last_became_active":"2023-10-08T15:40:22.699783+0000","last_became_peered":"2023-10-08T15:40:22.699783+0000","last_unstale":"2023-10-08T15:40:23.692120+0000","last_undegraded":"2023-10-08T15:40:23.692120+0000","last_fullsized":"2023-10-08T15:40:23.692120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705390+0000","last_change":"2023-10-08T15:40:23.705275+0000","last_active":"2023-10-08T15:40:23.705390+0000","last_peered":"2023-10-08T15:40:23.705390+0000","last_clean":"2023-10-08T15:40:23.705390+0000","last_became_active":"2023-10-08T15:40:23.700794+0000","last_became_peered":"2023-10-08T15:40:23.700794+0000","last_unstale":"2023-10-08T15:40:23.705390+0000","last_undegraded":"2023-10-08T15:40:23.705390+0000","last_fullsized":"2023-10-08T15:40:23.705390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:39:13.952710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694804+0000","last_change":"2023-10-08T15:40:22.695652+0000","last_active":"2023-10-08T15:40:23.694804+0000","last_peered":"2023-10-08T15:40:23.694804+0000","last_clean":"2023-10-08T15:40:23.694804+0000","last_became_active":"2023-10-08T15:40:22.695043+0000","last_became_peered":"2023-10-08T15:40:22.695043+0000","last_unstale":"2023-10-08T15:40:23.694804+0000","last_undegraded":"2023-10-08T15:40:23.694804+0000","last_fullsized":"2023-10-08T15:40:23.694804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.695661+0000","last_change":"2023-10-08T15:40:23.695481+0000","last_active":"2023-10-08T15:40:23.695661+0000","last_peered":"2023-10-08T15:40:23.695661+0000","last_clean":"2023-10-08T15:40:23.695661+0000","last_became_active":"2023-10-08T15:40:23.695247+0000","last_became_peered":"2023-10-08T15:40:23.695247+0000","last_unstale":"2023-10-08T15:40:23.695661+0000","last_undegraded":"2023-10-08T15:40:23.695661+0000","last_fullsized":"2023-10-08T15:40:23.695661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693450+0000","last_change":"2023-10-08T15:40:22.702796+0000","last_active":"2023-10-08T15:40:23.693450+0000","last_peered":"2023-10-08T15:40:23.693450+0000","last_clean":"2023-10-08T15:40:23.693450+0000","last_became_active":"2023-10-08T15:40:22.702571+0000","last_became_peered":"2023-10-08T15:40:22.702571+0000","last_unstale":"2023-10-08T15:40:23.693450+0000","last_undegraded":"2023-10-08T15:40:23.693450+0000","last_fullsized":"2023-10-08T15:40:23.693450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708503+0000","last_change":"2023-10-08T15:40:23.708328+0000","last_active":"2023-10-08T15:40:23.708503+0000","last_peered":"2023-10-08T15:40:23.708503+0000","last_clean":"2023-10-08T15:40:23.708503+0000","last_became_active":"2023-10-08T15:40:23.703248+0000","last_became_peered":"2023-10-08T15:40:23.703248+0000","last_unstale":"2023-10-08T15:40:23.708503+0000","last_undegraded":"2023-10-08T15:40:23.708503+0000","last_fullsized":"2023-10-08T15:40:23.708503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689878+0000","last_change":"2023-10-08T15:40:22.702638+0000","last_active":"2023-10-08T15:40:23.689878+0000","last_peered":"2023-10-08T15:40:23.689878+0000","last_clean":"2023-10-08T15:40:23.689878+0000","last_became_active":"2023-10-08T15:40:22.702409+0000","last_became_peered":"2023-10-08T15:40:22.702409+0000","last_unstale":"2023-10-08T15:40:23.689878+0000","last_undegraded":"2023-10-08T15:40:23.689878+0000","last_fullsized":"2023-10-08T15:40:23.689878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711325+0000","last_change":"2023-10-08T15:40:23.711250+0000","last_active":"2023-10-08T15:40:23.711325+0000","last_peered":"2023-10-08T15:40:23.711325+0000","last_clean":"2023-10-08T15:40:23.711325+0000","last_became_active":"2023-10-08T15:40:23.710219+0000","last_became_peered":"2023-10-08T15:40:23.710219+0000","last_unstale":"2023-10-08T15:40:23.711325+0000","last_undegraded":"2023-10-08T15:40:23.711325+0000","last_fullsized":"2023-10-08T15:40:23.711325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705796+0000","last_change":"2023-10-08T15:40:22.697798+0000","last_active":"2023-10-08T15:40:23.705796+0000","last_peered":"2023-10-08T15:40:23.705796+0000","last_clean":"2023-10-08T15:40:23.705796+0000","last_became_active":"2023-10-08T15:40:22.697562+0000","last_became_peered":"2023-10-08T15:40:22.697562+0000","last_unstale":"2023-10-08T15:40:23.705796+0000","last_undegraded":"2023-10-08T15:40:23.705796+0000","last_fullsized":"2023-10-08T15:40:23.705796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.697935+0000","last_change":"2023-10-08T15:40:23.697679+0000","last_active":"2023-10-08T15:40:23.697935+0000","last_peered":"2023-10-08T15:40:23.697935+0000","last_clean":"2023-10-08T15:40:23.697935+0000","last_became_active":"2023-10-08T15:40:23.697500+0000","last_became_peered":"2023-10-08T15:40:23.697500+0000","last_unstale":"2023-10-08T15:40:23.697935+0000","last_undegraded":"2023-10-08T15:40:23.697935+0000","last_fullsized":"2023-10-08T15:40:23.697935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708929+0000","last_change":"2023-10-08T15:40:22.700551+0000","last_active":"2023-10-08T15:40:23.708929+0000","last_peered":"2023-10-08T15:40:23.708929+0000","last_clean":"2023-10-08T15:40:23.708929+0000","last_became_active":"2023-10-08T15:40:22.700305+0000","last_became_peered":"2023-10-08T15:40:22.700305+0000","last_unstale":"2023-10-08T15:40:23.708929+0000","last_undegraded":"2023-10-08T15:40:23.708929+0000","last_fullsized":"2023-10-08T15:40:23.708929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707313+0000","last_change":"2023-10-08T15:40:23.707252+0000","last_active":"2023-10-08T15:40:23.707313+0000","last_peered":"2023-10-08T15:40:23.707313+0000","last_clean":"2023-10-08T15:40:23.707313+0000","last_became_active":"2023-10-08T15:40:23.706836+0000","last_became_peered":"2023-10-08T15:40:23.706836+0000","last_unstale":"2023-10-08T15:40:23.707313+0000","last_undegraded":"2023-10-08T15:40:23.707313+0000","last_fullsized":"2023-10-08T15:40:23.707313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:56:55.421889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711061+0000","last_change":"2023-10-08T15:40:22.695062+0000","last_active":"2023-10-08T15:40:23.711061+0000","last_peered":"2023-10-08T15:40:23.711061+0000","last_clean":"2023-10-08T15:40:23.711061+0000","last_became_active":"2023-10-08T15:40:22.694763+0000","last_became_peered":"2023-10-08T15:40:22.694763+0000","last_unstale":"2023-10-08T15:40:23.711061+0000","last_undegraded":"2023-10-08T15:40:23.711061+0000","last_fullsized":"2023-10-08T15:40:23.711061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711493+0000","last_change":"2023-10-08T15:40:23.711417+0000","last_active":"2023-10-08T15:40:23.711493+0000","last_peered":"2023-10-08T15:40:23.711493+0000","last_clean":"2023-10-08T15:40:23.711493+0000","last_became_active":"2023-10-08T15:40:23.710718+0000","last_became_peered":"2023-10-08T15:40:23.710718+0000","last_unstale":"2023-10-08T15:40:23.711493+0000","last_undegraded":"2023-10-08T15:40:23.711493+0000","last_fullsized":"2023-10-08T15:40:23.711493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690573+0000","last_change":"2023-10-08T15:40:22.701263+0000","last_active":"2023-10-08T15:40:23.690573+0000","last_peered":"2023-10-08T15:40:23.690573+0000","last_clean":"2023-10-08T15:40:23.690573+0000","last_became_active":"2023-10-08T15:40:22.700296+0000","last_became_peered":"2023-10-08T15:40:22.700296+0000","last_unstale":"2023-10-08T15:40:23.690573+0000","last_undegraded":"2023-10-08T15:40:23.690573+0000","last_fullsized":"2023-10-08T15:40:23.690573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702914+0000","last_change":"2023-10-08T15:40:23.702841+0000","last_active":"2023-10-08T15:40:23.702914+0000","last_peered":"2023-10-08T15:40:23.702914+0000","last_clean":"2023-10-08T15:40:23.702914+0000","last_became_active":"2023-10-08T15:40:23.702595+0000","last_became_peered":"2023-10-08T15:40:23.702595+0000","last_unstale":"2023-10-08T15:40:23.702914+0000","last_undegraded":"2023-10-08T15:40:23.702914+0000","last_fullsized":"2023-10-08T15:40:23.702914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:21.202497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694299+0000","last_change":"2023-10-08T15:40:22.699338+0000","last_active":"2023-10-08T15:40:23.694299+0000","last_peered":"2023-10-08T15:40:23.694299+0000","last_clean":"2023-10-08T15:40:23.694299+0000","last_became_active":"2023-10-08T15:40:22.698307+0000","last_became_peered":"2023-10-08T15:40:22.698307+0000","last_unstale":"2023-10-08T15:40:23.694299+0000","last_undegraded":"2023-10-08T15:40:23.694299+0000","last_fullsized":"2023-10-08T15:40:23.694299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.710031+0000","last_change":"2023-10-08T15:40:23.709914+0000","last_active":"2023-10-08T15:40:23.710031+0000","last_peered":"2023-10-08T15:40:23.710031+0000","last_clean":"2023-10-08T15:40:23.710031+0000","last_became_active":"2023-10-08T15:40:23.709690+0000","last_became_peered":"2023-10-08T15:40:23.709690+0000","last_unstale":"2023-10-08T15:40:23.710031+0000","last_undegraded":"2023-10-08T15:40:23.710031+0000","last_fullsized":"2023-10-08T15:40:23.710031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.706704+0000","last_change":"2023-10-08T15:40:22.692944+0000","last_active":"2023-10-08T15:40:23.706704+0000","last_peered":"2023-10-08T15:40:23.706704+0000","last_clean":"2023-10-08T15:40:23.706704+0000","last_became_active":"2023-10-08T15:40:22.692741+0000","last_became_peered":"2023-10-08T15:40:22.692741+0000","last_unstale":"2023-10-08T15:40:23.706704+0000","last_undegraded":"2023-10-08T15:40:23.706704+0000","last_fullsized":"2023-10-08T15:40:23.706704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:54.157251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701648+0000","last_change":"2023-10-08T15:40:23.701472+0000","last_active":"2023-10-08T15:40:23.701648+0000","last_peered":"2023-10-08T15:40:23.701648+0000","last_clean":"2023-10-08T15:40:23.701648+0000","last_became_active":"2023-10-08T15:40:23.701256+0000","last_became_peered":"2023-10-08T15:40:23.701256+0000","last_unstale":"2023-10-08T15:40:23.701648+0000","last_undegraded":"2023-10-08T15:40:23.701648+0000","last_fullsized":"2023-10-08T15:40:23.701648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707703+0000","last_change":"2023-10-08T15:40:22.696237+0000","last_active":"2023-10-08T15:40:23.707703+0000","last_peered":"2023-10-08T15:40:23.707703+0000","last_clean":"2023-10-08T15:40:23.707703+0000","last_became_active":"2023-10-08T15:40:22.695953+0000","last_became_peered":"2023-10-08T15:40:22.695953+0000","last_unstale":"2023-10-08T15:40:23.707703+0000","last_undegraded":"2023-10-08T15:40:23.707703+0000","last_fullsized":"2023-10-08T15:40:23.707703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:40.912548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708134+0000","last_change":"2023-10-08T15:40:23.708069+0000","last_active":"2023-10-08T15:40:23.708134+0000","last_peered":"2023-10-08T15:40:23.708134+0000","last_clean":"2023-10-08T15:40:23.708134+0000","last_became_active":"2023-10-08T15:40:23.707605+0000","last_became_peered":"2023-10-08T15:40:23.707605+0000","last_unstale":"2023-10-08T15:40:23.708134+0000","last_undegraded":"2023-10-08T15:40:23.708134+0000","last_fullsized":"2023-10-08T15:40:23.708134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689446+0000","last_change":"2023-10-08T15:40:22.695667+0000","last_active":"2023-10-08T15:40:23.689446+0000","last_peered":"2023-10-08T15:40:23.689446+0000","last_clean":"2023-10-08T15:40:23.689446+0000","last_became_active":"2023-10-08T15:40:22.695439+0000","last_became_peered":"2023-10-08T15:40:22.695439+0000","last_unstale":"2023-10-08T15:40:23.689446+0000","last_undegraded":"2023-10-08T15:40:23.689446+0000","last_fullsized":"2023-10-08T15:40:23.689446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699711+0000","last_change":"2023-10-08T15:40:23.699438+0000","last_active":"2023-10-08T15:40:23.699711+0000","last_peered":"2023-10-08T15:40:23.699711+0000","last_clean":"2023-10-08T15:40:23.699711+0000","last_became_active":"2023-10-08T15:40:23.697150+0000","last_became_peered":"2023-10-08T15:40:23.697150+0000","last_unstale":"2023-10-08T15:40:23.699711+0000","last_undegraded":"2023-10-08T15:40:23.699711+0000","last_fullsized":"2023-10-08T15:40:23.699711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:33:29.495971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690287+0000","last_change":"2023-10-08T15:40:22.698283+0000","last_active":"2023-10-08T15:40:23.690287+0000","last_peered":"2023-10-08T15:40:23.690287+0000","last_clean":"2023-10-08T15:40:23.690287+0000","last_became_active":"2023-10-08T15:40:22.697621+0000","last_became_peered":"2023-10-08T15:40:22.697621+0000","last_unstale":"2023-10-08T15:40:23.690287+0000","last_undegraded":"2023-10-08T15:40:23.690287+0000","last_fullsized":"2023-10-08T15:40:23.690287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708554+0000","last_change":"2023-10-08T15:40:23.708442+0000","last_active":"2023-10-08T15:40:23.708554+0000","last_peered":"2023-10-08T15:40:23.708554+0000","last_clean":"2023-10-08T15:40:23.708554+0000","last_became_active":"2023-10-08T15:40:23.708184+0000","last_became_peered":"2023-10-08T15:40:23.708184+0000","last_unstale":"2023-10-08T15:40:23.708554+0000","last_undegraded":"2023-10-08T15:40:23.708554+0000","last_fullsized":"2023-10-08T15:40:23.708554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:01.873248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693436+0000","last_change":"2023-10-08T15:40:23.693350+0000","last_active":"2023-10-08T15:40:23.693436+0000","last_peered":"2023-10-08T15:40:23.693436+0000","last_clean":"2023-10-08T15:40:23.693436+0000","last_became_active":"2023-10-08T15:40:23.693126+0000","last_became_peered":"2023-10-08T15:40:23.693126+0000","last_unstale":"2023-10-08T15:40:23.693436+0000","last_undegraded":"2023-10-08T15:40:23.693436+0000","last_fullsized":"2023-10-08T15:40:23.693436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690921+0000","last_change":"2023-10-08T15:40:22.698673+0000","last_active":"2023-10-08T15:40:23.690921+0000","last_peered":"2023-10-08T15:40:23.690921+0000","last_clean":"2023-10-08T15:40:23.690921+0000","last_became_active":"2023-10-08T15:40:22.698433+0000","last_became_peered":"2023-10-08T15:40:22.698433+0000","last_unstale":"2023-10-08T15:40:23.690921+0000","last_undegraded":"2023-10-08T15:40:23.690921+0000","last_fullsized":"2023-10-08T15:40:23.690921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:19.550919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.694799+0000","last_change":"2023-10-08T15:40:23.694732+0000","last_active":"2023-10-08T15:40:23.694799+0000","last_peered":"2023-10-08T15:40:23.694799+0000","last_clean":"2023-10-08T15:40:23.694799+0000","last_became_active":"2023-10-08T15:40:23.694463+0000","last_became_peered":"2023-10-08T15:40:23.694463+0000","last_unstale":"2023-10-08T15:40:23.694799+0000","last_undegraded":"2023-10-08T15:40:23.694799+0000","last_fullsized":"2023-10-08T15:40:23.694799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.690975+0000","last_change":"2023-10-08T15:40:22.701412+0000","last_active":"2023-10-08T15:40:23.690975+0000","last_peered":"2023-10-08T15:40:23.690975+0000","last_clean":"2023-10-08T15:40:23.690975+0000","last_became_active":"2023-10-08T15:40:22.701018+0000","last_became_peered":"2023-10-08T15:40:22.701018+0000","last_unstale":"2023-10-08T15:40:23.690975+0000","last_undegraded":"2023-10-08T15:40:23.690975+0000","last_fullsized":"2023-10-08T15:40:23.690975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692909+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:40:23.692909+0000","last_peered":"2023-10-08T15:40:23.692909+0000","last_clean":"2023-10-08T15:40:23.692909+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:40:23.692909+0000","last_undegraded":"2023-10-08T15:40:23.692909+0000","last_fullsized":"2023-10-08T15:40:23.692909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708661+0000","last_change":"2023-10-08T15:40:23.708609+0000","last_active":"2023-10-08T15:40:23.708661+0000","last_peered":"2023-10-08T15:40:23.708661+0000","last_clean":"2023-10-08T15:40:23.708661+0000","last_became_active":"2023-10-08T15:40:23.708135+0000","last_became_peered":"2023-10-08T15:40:23.708135+0000","last_unstale":"2023-10-08T15:40:23.708661+0000","last_undegraded":"2023-10-08T15:40:23.708661+0000","last_fullsized":"2023-10-08T15:40:23.708661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:00.399404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692107+0000","last_change":"2023-10-08T15:40:22.702091+0000","last_active":"2023-10-08T15:40:23.692107+0000","last_peered":"2023-10-08T15:40:23.692107+0000","last_clean":"2023-10-08T15:40:23.692107+0000","last_became_active":"2023-10-08T15:40:22.701729+0000","last_became_peered":"2023-10-08T15:40:22.701729+0000","last_unstale":"2023-10-08T15:40:23.692107+0000","last_undegraded":"2023-10-08T15:40:23.692107+0000","last_fullsized":"2023-10-08T15:40:23.692107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:00.869317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.692213+0000","last_change":"2023-10-08T15:40:22.701958+0000","last_active":"2023-10-08T15:40:23.692213+0000","last_peered":"2023-10-08T15:40:23.692213+0000","last_clean":"2023-10-08T15:40:23.692213+0000","last_became_active":"2023-10-08T15:40:22.701237+0000","last_became_peered":"2023-10-08T15:40:22.701237+0000","last_unstale":"2023-10-08T15:40:23.692213+0000","last_undegraded":"2023-10-08T15:40:23.692213+0000","last_fullsized":"2023-10-08T15:40:23.692213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:15.285164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.696404+0000","last_change":"2023-10-08T15:40:23.696335+0000","last_active":"2023-10-08T15:40:23.696404+0000","last_peered":"2023-10-08T15:40:23.696404+0000","last_clean":"2023-10-08T15:40:23.696404+0000","last_became_active":"2023-10-08T15:40:23.696088+0000","last_became_peered":"2023-10-08T15:40:23.696088+0000","last_unstale":"2023-10-08T15:40:23.696404+0000","last_undegraded":"2023-10-08T15:40:23.696404+0000","last_fullsized":"2023-10-08T15:40:23.696404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T15:40:24.689606+0000","last_change":"2023-10-08T15:40:22.702336+0000","last_active":"2023-10-08T15:40:24.689606+0000","last_peered":"2023-10-08T15:40:24.689606+0000","last_clean":"2023-10-08T15:40:24.689606+0000","last_became_active":"2023-10-08T15:40:22.702088+0000","last_became_peered":"2023-10-08T15:40:22.702088+0000","last_unstale":"2023-10-08T15:40:24.689606+0000","last_undegraded":"2023-10-08T15:40:24.689606+0000","last_fullsized":"2023-10-08T15:40:24.689606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711086+0000","last_change":"2023-10-08T15:40:23.711013+0000","last_active":"2023-10-08T15:40:23.711086+0000","last_peered":"2023-10-08T15:40:23.711086+0000","last_clean":"2023-10-08T15:40:23.711086+0000","last_became_active":"2023-10-08T15:40:23.710775+0000","last_became_peered":"2023-10-08T15:40:23.710775+0000","last_unstale":"2023-10-08T15:40:23.711086+0000","last_undegraded":"2023-10-08T15:40:23.711086+0000","last_fullsized":"2023-10-08T15:40:23.711086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705898+0000","last_change":"2023-10-08T15:40:22.699798+0000","last_active":"2023-10-08T15:40:23.705898+0000","last_peered":"2023-10-08T15:40:23.705898+0000","last_clean":"2023-10-08T15:40:23.705898+0000","last_became_active":"2023-10-08T15:40:22.699567+0000","last_became_peered":"2023-10-08T15:40:22.699567+0000","last_unstale":"2023-10-08T15:40:23.705898+0000","last_undegraded":"2023-10-08T15:40:23.705898+0000","last_fullsized":"2023-10-08T15:40:23.705898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708191+0000","last_change":"2023-10-08T15:40:23.707901+0000","last_active":"2023-10-08T15:40:23.708191+0000","last_peered":"2023-10-08T15:40:23.708191+0000","last_clean":"2023-10-08T15:40:23.708191+0000","last_became_active":"2023-10-08T15:40:23.707456+0000","last_became_peered":"2023-10-08T15:40:23.707456+0000","last_unstale":"2023-10-08T15:40:23.708191+0000","last_undegraded":"2023-10-08T15:40:23.708191+0000","last_fullsized":"2023-10-08T15:40:23.708191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:13.569317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693777+0000","last_change":"2023-10-08T15:40:22.701044+0000","last_active":"2023-10-08T15:40:23.693777+0000","last_peered":"2023-10-08T15:40:23.693777+0000","last_clean":"2023-10-08T15:40:23.693777+0000","last_became_active":"2023-10-08T15:40:22.700575+0000","last_became_peered":"2023-10-08T15:40:22.700575+0000","last_unstale":"2023-10-08T15:40:23.693777+0000","last_undegraded":"2023-10-08T15:40:23.693777+0000","last_fullsized":"2023-10-08T15:40:23.693777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:18.780750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.702957+0000","last_change":"2023-10-08T15:40:23.702405+0000","last_active":"2023-10-08T15:40:23.702957+0000","last_peered":"2023-10-08T15:40:23.702957+0000","last_clean":"2023-10-08T15:40:23.702957+0000","last_became_active":"2023-10-08T15:40:23.702039+0000","last_became_peered":"2023-10-08T15:40:23.702039+0000","last_unstale":"2023-10-08T15:40:23.702957+0000","last_undegraded":"2023-10-08T15:40:23.702957+0000","last_fullsized":"2023-10-08T15:40:23.702957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:19.784681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689542+0000","last_change":"2023-10-08T15:40:22.700842+0000","last_active":"2023-10-08T15:40:23.689542+0000","last_peered":"2023-10-08T15:40:23.689542+0000","last_clean":"2023-10-08T15:40:23.689542+0000","last_became_active":"2023-10-08T15:40:22.700609+0000","last_became_peered":"2023-10-08T15:40:22.700609+0000","last_unstale":"2023-10-08T15:40:23.689542+0000","last_undegraded":"2023-10-08T15:40:23.689542+0000","last_fullsized":"2023-10-08T15:40:23.689542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693774+0000","last_change":"2023-10-08T15:40:23.693701+0000","last_active":"2023-10-08T15:40:23.693774+0000","last_peered":"2023-10-08T15:40:23.693774+0000","last_clean":"2023-10-08T15:40:23.693774+0000","last_became_active":"2023-10-08T15:40:23.693469+0000","last_became_peered":"2023-10-08T15:40:23.693469+0000","last_unstale":"2023-10-08T15:40:23.693774+0000","last_undegraded":"2023-10-08T15:40:23.693774+0000","last_fullsized":"2023-10-08T15:40:23.693774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.689145+0000","last_change":"2023-10-08T15:40:22.700304+0000","last_active":"2023-10-08T15:40:23.689145+0000","last_peered":"2023-10-08T15:40:23.689145+0000","last_clean":"2023-10-08T15:40:23.689145+0000","last_became_active":"2023-10-08T15:40:22.700075+0000","last_became_peered":"2023-10-08T15:40:22.700075+0000","last_unstale":"2023-10-08T15:40:23.689145+0000","last_undegraded":"2023-10-08T15:40:23.689145+0000","last_fullsized":"2023-10-08T15:40:23.689145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709767+0000","last_change":"2023-10-08T15:40:23.709682+0000","last_active":"2023-10-08T15:40:23.709767+0000","last_peered":"2023-10-08T15:40:23.709767+0000","last_clean":"2023-10-08T15:40:23.709767+0000","last_became_active":"2023-10-08T15:40:23.709450+0000","last_became_peered":"2023-10-08T15:40:23.709450+0000","last_unstale":"2023-10-08T15:40:23.709767+0000","last_undegraded":"2023-10-08T15:40:23.709767+0000","last_fullsized":"2023-10-08T15:40:23.709767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707105+0000","last_change":"2023-10-08T15:40:22.699299+0000","last_active":"2023-10-08T15:40:23.707105+0000","last_peered":"2023-10-08T15:40:23.707105+0000","last_clean":"2023-10-08T15:40:23.707105+0000","last_became_active":"2023-10-08T15:40:22.699051+0000","last_became_peered":"2023-10-08T15:40:22.699051+0000","last_unstale":"2023-10-08T15:40:23.707105+0000","last_undegraded":"2023-10-08T15:40:23.707105+0000","last_fullsized":"2023-10-08T15:40:23.707105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.172193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699507+0000","last_change":"2023-10-08T15:40:23.699439+0000","last_active":"2023-10-08T15:40:23.699507+0000","last_peered":"2023-10-08T15:40:23.699507+0000","last_clean":"2023-10-08T15:40:23.699507+0000","last_became_active":"2023-10-08T15:40:23.699096+0000","last_became_peered":"2023-10-08T15:40:23.699096+0000","last_unstale":"2023-10-08T15:40:23.699507+0000","last_undegraded":"2023-10-08T15:40:23.699507+0000","last_fullsized":"2023-10-08T15:40:23.699507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:21.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.691509+0000","last_change":"2023-10-08T15:40:22.694836+0000","last_active":"2023-10-08T15:40:23.691509+0000","last_peered":"2023-10-08T15:40:23.691509+0000","last_clean":"2023-10-08T15:40:23.691509+0000","last_became_active":"2023-10-08T15:40:22.694608+0000","last_became_peered":"2023-10-08T15:40:22.694608+0000","last_unstale":"2023-10-08T15:40:23.691509+0000","last_undegraded":"2023-10-08T15:40:23.691509+0000","last_fullsized":"2023-10-08T15:40:23.691509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:17:17.765848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703621+0000","last_change":"2023-10-08T15:40:23.703118+0000","last_active":"2023-10-08T15:40:23.703621+0000","last_peered":"2023-10-08T15:40:23.703621+0000","last_clean":"2023-10-08T15:40:23.703621+0000","last_became_active":"2023-10-08T15:40:23.702720+0000","last_became_peered":"2023-10-08T15:40:23.702720+0000","last_unstale":"2023-10-08T15:40:23.703621+0000","last_undegraded":"2023-10-08T15:40:23.703621+0000","last_fullsized":"2023-10-08T15:40:23.703621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:47.802873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703205+0000","last_change":"2023-10-08T15:40:22.694954+0000","last_active":"2023-10-08T15:40:23.703205+0000","last_peered":"2023-10-08T15:40:23.703205+0000","last_clean":"2023-10-08T15:40:23.703205+0000","last_became_active":"2023-10-08T15:40:22.694720+0000","last_became_peered":"2023-10-08T15:40:22.694720+0000","last_unstale":"2023-10-08T15:40:23.703205+0000","last_undegraded":"2023-10-08T15:40:23.703205+0000","last_fullsized":"2023-10-08T15:40:23.703205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:42.678790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700201+0000","last_change":"2023-10-08T15:40:23.700137+0000","last_active":"2023-10-08T15:40:23.700201+0000","last_peered":"2023-10-08T15:40:23.700201+0000","last_clean":"2023-10-08T15:40:23.700201+0000","last_became_active":"2023-10-08T15:40:23.699832+0000","last_became_peered":"2023-10-08T15:40:23.699832+0000","last_unstale":"2023-10-08T15:40:23.700201+0000","last_undegraded":"2023-10-08T15:40:23.700201+0000","last_fullsized":"2023-10-08T15:40:23.700201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:01.454580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707215+0000","last_change":"2023-10-08T15:40:22.696186+0000","last_active":"2023-10-08T15:40:23.707215+0000","last_peered":"2023-10-08T15:40:23.707215+0000","last_clean":"2023-10-08T15:40:23.707215+0000","last_became_active":"2023-10-08T15:40:22.695949+0000","last_became_peered":"2023-10-08T15:40:22.695949+0000","last_unstale":"2023-10-08T15:40:23.707215+0000","last_undegraded":"2023-10-08T15:40:23.707215+0000","last_fullsized":"2023-10-08T15:40:23.707215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:21.677857+0000","last_clean_scrub_stamp":"2023-10-08T15:40:21.677857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:55.351838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.700110+0000","last_change":"2023-10-08T15:40:23.699621+0000","last_active":"2023-10-08T15:40:23.700110+0000","last_peered":"2023-10-08T15:40:23.700110+0000","last_clean":"2023-10-08T15:40:23.700110+0000","last_became_active":"2023-10-08T15:40:23.699275+0000","last_became_peered":"2023-10-08T15:40:23.699275+0000","last_unstale":"2023-10-08T15:40:23.700110+0000","last_undegraded":"2023-10-08T15:40:23.700110+0000","last_fullsized":"2023-10-08T15:40:23.700110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:25.774345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.709672+0000","last_change":"2023-10-08T15:40:23.709581+0000","last_active":"2023-10-08T15:40:23.709672+0000","last_peered":"2023-10-08T15:40:23.709672+0000","last_clean":"2023-10-08T15:40:23.709672+0000","last_became_active":"2023-10-08T15:40:23.709337+0000","last_became_peered":"2023-10-08T15:40:23.709337+0000","last_unstale":"2023-10-08T15:40:23.709672+0000","last_undegraded":"2023-10-08T15:40:23.709672+0000","last_fullsized":"2023-10-08T15:40:23.709672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711931+0000","last_change":"2023-10-08T15:40:23.711865+0000","last_active":"2023-10-08T15:40:23.711931+0000","last_peered":"2023-10-08T15:40:23.711931+0000","last_clean":"2023-10-08T15:40:23.711931+0000","last_became_active":"2023-10-08T15:40:23.711619+0000","last_became_peered":"2023-10-08T15:40:23.711619+0000","last_unstale":"2023-10-08T15:40:23.711931+0000","last_undegraded":"2023-10-08T15:40:23.711931+0000","last_fullsized":"2023-10-08T15:40:23.711931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:49.005089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.696945+0000","last_change":"2023-10-08T15:40:23.696703+0000","last_active":"2023-10-08T15:40:23.696945+0000","last_peered":"2023-10-08T15:40:23.696945+0000","last_clean":"2023-10-08T15:40:23.696945+0000","last_became_active":"2023-10-08T15:40:23.696465+0000","last_became_peered":"2023-10-08T15:40:23.696465+0000","last_unstale":"2023-10-08T15:40:23.696945+0000","last_undegraded":"2023-10-08T15:40:23.696945+0000","last_fullsized":"2023-10-08T15:40:23.696945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:21.202497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.707466+0000","last_change":"2023-10-08T15:40:23.707367+0000","last_active":"2023-10-08T15:40:23.707466+0000","last_peered":"2023-10-08T15:40:23.707466+0000","last_clean":"2023-10-08T15:40:23.707466+0000","last_became_active":"2023-10-08T15:40:23.706468+0000","last_became_peered":"2023-10-08T15:40:23.706468+0000","last_unstale":"2023-10-08T15:40:23.707466+0000","last_undegraded":"2023-10-08T15:40:23.707466+0000","last_fullsized":"2023-10-08T15:40:23.707466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703465+0000","last_change":"2023-10-08T15:40:23.703030+0000","last_active":"2023-10-08T15:40:23.703465+0000","last_peered":"2023-10-08T15:40:23.703465+0000","last_clean":"2023-10-08T15:40:23.703465+0000","last_became_active":"2023-10-08T15:40:23.702048+0000","last_became_peered":"2023-10-08T15:40:23.702048+0000","last_unstale":"2023-10-08T15:40:23.703465+0000","last_undegraded":"2023-10-08T15:40:23.703465+0000","last_fullsized":"2023-10-08T15:40:23.703465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:17.339499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.693260+0000","last_change":"2023-10-08T15:40:23.693188+0000","last_active":"2023-10-08T15:40:23.693260+0000","last_peered":"2023-10-08T15:40:23.693260+0000","last_clean":"2023-10-08T15:40:23.693260+0000","last_became_active":"2023-10-08T15:40:23.692944+0000","last_became_peered":"2023-10-08T15:40:23.692944+0000","last_unstale":"2023-10-08T15:40:23.693260+0000","last_undegraded":"2023-10-08T15:40:23.693260+0000","last_fullsized":"2023-10-08T15:40:23.693260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:00.135472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.701609+0000","last_change":"2023-10-08T15:40:23.701502+0000","last_active":"2023-10-08T15:40:23.701609+0000","last_peered":"2023-10-08T15:40:23.701609+0000","last_clean":"2023-10-08T15:40:23.701609+0000","last_became_active":"2023-10-08T15:40:23.701163+0000","last_became_peered":"2023-10-08T15:40:23.701163+0000","last_unstale":"2023-10-08T15:40:23.701609+0000","last_undegraded":"2023-10-08T15:40:23.701609+0000","last_fullsized":"2023-10-08T15:40:23.701609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:40.364973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.705950+0000","last_change":"2023-10-08T15:40:23.705746+0000","last_active":"2023-10-08T15:40:23.705950+0000","last_peered":"2023-10-08T15:40:23.705950+0000","last_clean":"2023-10-08T15:40:23.705950+0000","last_became_active":"2023-10-08T15:40:23.705532+0000","last_became_peered":"2023-10-08T15:40:23.705532+0000","last_unstale":"2023-10-08T15:40:23.705950+0000","last_undegraded":"2023-10-08T15:40:23.705950+0000","last_fullsized":"2023-10-08T15:40:23.705950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:34.476564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.699729+0000","last_change":"2023-10-08T15:40:23.699584+0000","last_active":"2023-10-08T15:40:23.699729+0000","last_peered":"2023-10-08T15:40:23.699729+0000","last_clean":"2023-10-08T15:40:23.699729+0000","last_became_active":"2023-10-08T15:40:23.697371+0000","last_became_peered":"2023-10-08T15:40:23.697371+0000","last_unstale":"2023-10-08T15:40:23.699729+0000","last_undegraded":"2023-10-08T15:40:23.699729+0000","last_fullsized":"2023-10-08T15:40:23.699729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:28.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.703480+0000","last_change":"2023-10-08T15:40:23.703199+0000","last_active":"2023-10-08T15:40:23.703480+0000","last_peered":"2023-10-08T15:40:23.703480+0000","last_clean":"2023-10-08T15:40:23.703480+0000","last_became_active":"2023-10-08T15:40:23.702381+0000","last_became_peered":"2023-10-08T15:40:23.702381+0000","last_unstale":"2023-10-08T15:40:23.703480+0000","last_undegraded":"2023-10-08T15:40:23.703480+0000","last_fullsized":"2023-10-08T15:40:23.703480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:09:22.939712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.708427+0000","last_change":"2023-10-08T15:40:23.704911+0000","last_active":"2023-10-08T15:40:23.708427+0000","last_peered":"2023-10-08T15:40:23.708427+0000","last_clean":"2023-10-08T15:40:23.708427+0000","last_became_active":"2023-10-08T15:40:23.702946+0000","last_became_peered":"2023-10-08T15:40:23.702946+0000","last_unstale":"2023-10-08T15:40:23.708427+0000","last_undegraded":"2023-10-08T15:40:23.708427+0000","last_fullsized":"2023-10-08T15:40:23.708427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:15.527765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.711664+0000","last_change":"2023-10-08T15:40:23.711593+0000","last_active":"2023-10-08T15:40:23.711664+0000","last_peered":"2023-10-08T15:40:23.711664+0000","last_clean":"2023-10-08T15:40:23.711664+0000","last_became_active":"2023-10-08T15:40:23.711030+0000","last_became_peered":"2023-10-08T15:40:23.711030+0000","last_unstale":"2023-10-08T15:40:23.711664+0000","last_undegraded":"2023-10-08T15:40:23.711664+0000","last_fullsized":"2023-10-08T15:40:23.711664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:02.587890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T15:40:23.704150+0000","last_change":"2023-10-08T15:40:23.704080+0000","last_active":"2023-10-08T15:40:23.704150+0000","last_peered":"2023-10-08T15:40:23.704150+0000","last_clean":"2023-10-08T15:40:23.704150+0000","last_became_active":"2023-10-08T15:40:23.703850+0000","last_became_peered":"2023-10-08T15:40:23.703850+0000","last_unstale":"2023-10-08T15:40:23.704150+0000","last_undegraded":"2023-10-08T15:40:23.704150+0000","last_fullsized":"2023-10-08T15:40:23.704150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:22.681788+0000","last_clean_scrub_stamp":"2023-10-08T15:40:22.681788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:16:47.870000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[]}} 2023-10-08T15:40:37.557 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T15:40:37.557 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T15:40:37.557 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T15:40:37.557 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T15:40:37.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.710+0000 7f602fe91700 1 Processor -- start 2023-10-08T15:40:37.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.711+0000 7f602fe91700 1 -- start start 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.711+0000 7f602fe91700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f602806f1a0 0x7f60280c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.711+0000 7f602fe91700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280b0160 0x7f6028070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.711+0000 7f602fe91700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60280ca270 con 0x7f60280afd90 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.711+0000 7f602fe91700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60280c87c0 con 0x7f602806f1a0 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.711+0000 7f602fe91700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602806e3e0 con 0x7f60280b0160 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.711+0000 7f602d42c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f602806f1a0 0x7f60280c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602d42c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f602806f1a0 0x7f60280c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33958/0 (socket says 172.21.15.29:33958) 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602d42c700 1 -- 172.21.15.29:0/1612615094 learned_addr learned my addr 172.21.15.29:0/1612615094 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602e42e700 1 --2- 172.21.15.29:0/1612615094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280b0160 0x7f6028070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602d42c700 1 -- 172.21.15.29:0/1612615094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280b0160 msgr2=0x7f6028070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602d42c700 1 --2- 172.21.15.29:0/1612615094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280b0160 0x7f6028070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602d42c700 1 -- 172.21.15.29:0/1612615094 >> v1:172.21.15.183:6789/0 conn(0x7f60280afd90 legacy=0x7f602815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602d42c700 1 -- 172.21.15.29:0/1612615094 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602806e6c0 con 0x7f602806f1a0 2023-10-08T15:40:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602d42c700 1 --2- 172.21.15.29:0/1612615094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f602806f1a0 0x7f60280c9c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f601c0099b0 tx=0x7f601c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4903f81625c98c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602cc2b700 1 -- 172.21.15.29:0/1612615094 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00b860 con 0x7f602806f1a0 2023-10-08T15:40:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602cc2b700 1 -- 172.21.15.29:0/1612615094 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c00b9c0 con 0x7f602806f1a0 2023-10-08T15:40:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.712+0000 7f602cc2b700 1 -- 172.21.15.29:0/1612615094 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00bd60 con 0x7f602806f1a0 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.713+0000 7f602fe91700 1 -- 172.21.15.29:0/1612615094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f602806f1a0 msgr2=0x7f60280c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.713+0000 7f602fe91700 1 --2- 172.21.15.29:0/1612615094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f602806f1a0 0x7f60280c9c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f601c0099b0 tx=0x7f601c009250 comp rx=0 tx=0).stop 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.713+0000 7f602fe91700 1 -- 172.21.15.29:0/1612615094 shutdown_connections 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.713+0000 7f602fe91700 1 --2- 172.21.15.29:0/1612615094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60280b0160 0x7f6028070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.713+0000 7f602fe91700 1 --2- 172.21.15.29:0/1612615094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f602806f1a0 0x7f60280c9c20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.713+0000 7f602fe91700 1 -- 172.21.15.29:0/1612615094 >> 172.21.15.29:0/1612615094 conn(0x7f60280ca4f0 msgr2=0x7f60280ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.713+0000 7f602fe91700 1 -- 172.21.15.29:0/1612615094 shutdown_connections 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.713+0000 7f602fe91700 1 -- 172.21.15.29:0/1612615094 wait complete. 2023-10-08T15:40:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.714+0000 7f602fe91700 1 Processor -- start 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.714+0000 7f602fe91700 1 -- start start 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602fe91700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f602806f1a0 0x7f60280c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602fe91700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280afd90 0x7f60280c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602fe91700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60280b0160 0x7f60280c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602fe91700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280c7400 con 0x7f60280b0160 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602fe91700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280c4b30 con 0x7f60280afd90 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602fe91700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60280c53d0 con 0x7f602806f1a0 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60280b0160 0x7f60280c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60280b0160 0x7f60280c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33974/0 (socket says 172.21.15.29:33974) 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 -- 172.21.15.29:0/2376788408 learned_addr learned my addr 172.21.15.29:0/2376788408 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602d42c700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280afd90 0x7f60280c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602dc2d700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f602806f1a0 0x7f60280c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 -- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f602806f1a0 msgr2=0x7f60280c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f602806f1a0 0x7f60280c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 -- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280afd90 msgr2=0x7f60280c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280afd90 0x7f60280c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 -- 172.21.15.29:0/2376788408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0094f0 con 0x7f60280b0160 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602e42e700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60280b0160 0x7f60280c5860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f602000d890 tx=0x7f6020008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f6025ffb700 1 -- 172.21.15.29:0/2376788408 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200125f0 con 0x7f60280b0160 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f6025ffb700 1 -- 172.21.15.29:0/2376788408 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6020012770 con 0x7f60280b0160 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60280c7610 con 0x7f60280b0160 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.715+0000 7f6025ffb700 1 -- 172.21.15.29:0/2376788408 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020012b30 con 0x7f60280b0160 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.716+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60280c5060 con 0x7f60280b0160 2023-10-08T15:40:37.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.716+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60280cd8a0 con 0x7f60280b0160 2023-10-08T15:40:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.717+0000 7f6025ffb700 1 -- 172.21.15.29:0/2376788408 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6020013480 con 0x7f60280b0160 2023-10-08T15:40:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.717+0000 7f6025ffb700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.717+0000 7f6025ffb700 1 -- 172.21.15.29:0/2376788408 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60200847c0 con 0x7f60280b0160 2023-10-08T15:40:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.718+0000 7f602dc2d700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.718+0000 7f602dc2d700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6014066f30 0x7f60140693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6018007fd0 tx=0x7f60180016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.722+0000 7f6025ffb700 1 -- 172.21.15.29:0/2376788408 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6020051a30 con 0x7f60280b0160 2023-10-08T15:40:37.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.956+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f602804c3c0 con 0x7f60280b0160 2023-10-08T15:40:37.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.957+0000 7f6025ffb700 1 -- 172.21.15.29:0/2376788408 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6020055050 con 0x7f60280b0160 2023-10-08T15:40:37.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:37.958 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T15:40:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6014066f30 msgr2=0x7f60140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6014066f30 0x7f60140693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6018007fd0 tx=0x7f60180016f0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60280b0160 msgr2=0x7f60280c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60280b0160 0x7f60280c5860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f602000d890 tx=0x7f6020008040 comp rx=0 tx=0).stop 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 shutdown_connections 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6014066f30 0x7f60140693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60280b0160 0x7f60280c5860 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f602806f1a0 0x7f60280c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 --2- 172.21.15.29:0/2376788408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60280afd90 0x7f60280c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 >> 172.21.15.29:0/2376788408 conn(0x7f60280ca4f0 msgr2=0x7f602815c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 shutdown_connections 2023-10-08T15:40:37.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:37.959+0000 7f602fe91700 1 -- 172.21.15.29:0/2376788408 wait complete. 2023-10-08T15:40:37.971 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T15:40:37.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.090+0000 7fbfa7270700 1 Processor -- start 2023-10-08T15:40:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.090+0000 7fbfa7270700 1 -- start start 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa7270700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbfa0157870 0x7fbfa015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa7270700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbfa015a620 0x7fbfa015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa7270700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa015cbb0 con 0x7fbfa015d580 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa7270700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa015bfa0 con 0x7fbfa0157870 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa7270700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa015c280 con 0x7fbfa015a620 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa500c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbfa0157870 0x7fbfa015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa580d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbfa015d580 0x7fbfa0158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43370/0 (socket says 172.21.15.29:43370) 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa580d700 1 -- 172.21.15.29:0/4233400297 learned_addr learned my addr 172.21.15.29:0/4233400297 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:38.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa480b700 1 --2- 172.21.15.29:0/4233400297 >> v2:172.21.15.183:3300/0 conn(0x7fbfa015a620 0x7fbfa015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbf9ffff700 1 -- 172.21.15.29:0/4233400297 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772216202 0 0) 0x7fbfa015cbb0 con 0x7fbfa015d580 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbf9ffff700 1 -- 172.21.15.29:0/4233400297 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf88003570 con 0x7fbfa015d580 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa500c700 1 -- 172.21.15.29:0/4233400297 >> v2:172.21.15.183:3300/0 conn(0x7fbfa015a620 msgr2=0x7fbfa015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa500c700 1 --2- 172.21.15.29:0/4233400297 >> v2:172.21.15.183:3300/0 conn(0x7fbfa015a620 0x7fbfa015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa500c700 1 -- 172.21.15.29:0/4233400297 >> v1:172.21.15.29:6789/0 conn(0x7fbfa015d580 legacy=0x7fbfa0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa500c700 1 -- 172.21.15.29:0/4233400297 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa015c560 con 0x7fbfa0157870 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbfa500c700 1 --2- 172.21.15.29:0/4233400297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa0157870 0x7fbfa015b6a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbfa015cb20 tx=0x7fbf90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78850b806b59d883 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbf9ffff700 1 -- 172.21.15.29:0/4233400297 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000e070 con 0x7fbfa0157870 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbf9ffff700 1 -- 172.21.15.29:0/4233400297 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9000bab0 con 0x7fbfa0157870 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.091+0000 7fbf9ffff700 1 -- 172.21.15.29:0/4233400297 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000be70 con 0x7fbfa0157870 2023-10-08T15:40:38.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.092+0000 7fbfa7270700 1 -- 172.21.15.29:0/4233400297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa0157870 msgr2=0x7fbfa015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.092+0000 7fbfa7270700 1 --2- 172.21.15.29:0/4233400297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa0157870 0x7fbfa015b6a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbfa015cb20 tx=0x7fbf90009780 comp rx=0 tx=0).stop 2023-10-08T15:40:38.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.092+0000 7fbfa7270700 1 -- 172.21.15.29:0/4233400297 shutdown_connections 2023-10-08T15:40:38.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.092+0000 7fbfa7270700 1 --2- 172.21.15.29:0/4233400297 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa0157870 0x7fbfa015b6a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.092+0000 7fbfa7270700 1 --2- 172.21.15.29:0/4233400297 >> v2:172.21.15.183:3300/0 conn(0x7fbfa015a620 0x7fbfa015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.092+0000 7fbfa7270700 1 -- 172.21.15.29:0/4233400297 >> 172.21.15.29:0/4233400297 conn(0x7fbfa0068ce0 msgr2=0x7fbfa00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.092+0000 7fbfa7270700 1 -- 172.21.15.29:0/4233400297 shutdown_connections 2023-10-08T15:40:38.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.092+0000 7fbfa7270700 1 -- 172.21.15.29:0/4233400297 wait complete. 2023-10-08T15:40:38.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.093+0000 7fbfa7270700 1 Processor -- start 2023-10-08T15:40:38.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.093+0000 7fbfa7270700 1 -- start start 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa7270700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfa0157870 0x7fbfa01478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa7270700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa015a620 0x7fbfa00d0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa7270700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfa015d580 0x7fbfa00d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa7270700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00b3110 con 0x7fbfa015a620 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa7270700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00b35a0 con 0x7fbfa015d580 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa7270700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa00b2500 con 0x7fbfa0157870 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa480b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa015a620 0x7fbfa00d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa480b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa015a620 0x7fbfa00d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33998/0 (socket says 172.21.15.29:33998) 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa480b700 1 -- 172.21.15.29:0/227627042 learned_addr learned my addr 172.21.15.29:0/227627042 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa500c700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfa0157870 0x7fbfa01478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa580d700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfa015d580 0x7fbfa00d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa480b700 1 -- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfa0157870 msgr2=0x7fbfa01478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa480b700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfa0157870 0x7fbfa01478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa480b700 1 -- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfa015d580 msgr2=0x7fbfa00d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa480b700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfa015d580 0x7fbfa00d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa480b700 1 -- 172.21.15.29:0/227627042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf90009a20 con 0x7fbfa015a620 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.094+0000 7fbfa580d700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfa015d580 0x7fbfa00d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.095+0000 7fbfa480b700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa015a620 0x7fbfa00d0280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400ec50 tx=0x7fbf940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.095+0000 7fbf9d7fa700 1 -- 172.21.15.29:0/227627042 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400c9d0 con 0x7fbfa015a620 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.095+0000 7fbf9d7fa700 1 -- 172.21.15.29:0/227627042 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9400cb30 con 0x7fbfa015a620 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.095+0000 7fbf9d7fa700 1 -- 172.21.15.29:0/227627042 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94013470 con 0x7fbfa015a620 2023-10-08T15:40:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.095+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa00b27e0 con 0x7fbfa015a620 2023-10-08T15:40:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.095+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa00b2da0 con 0x7fbfa015a620 2023-10-08T15:40:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.096+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa00b32c0 con 0x7fbfa015a620 2023-10-08T15:40:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.096+0000 7fbf9d7fa700 1 -- 172.21.15.29:0/227627042 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf94013860 con 0x7fbfa015a620 2023-10-08T15:40:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.097+0000 7fbf9d7fa700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbf8c066f30 0x7fbf8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.097+0000 7fbf9d7fa700 1 -- 172.21.15.29:0/227627042 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf94084850 con 0x7fbfa015a620 2023-10-08T15:40:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.097+0000 7fbfa500c700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbf8c066f30 0x7fbf8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.097+0000 7fbfa500c700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbf8c066f30 0x7fbf8c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf900099f0 tx=0x7fbf90019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.101+0000 7fbf9d7fa700 1 -- 172.21.15.29:0/227627042 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfa00b32c0 con 0x7fbfa015a620 2023-10-08T15:40:38.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.294+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfa004c3c0 con 0x7fbfa015a620 2023-10-08T15:40:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.295+0000 7fbf9d7fa700 1 -- 172.21.15.29:0/227627042 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fbf94051ac0 con 0x7fbfa015a620 2023-10-08T15:40:38.295 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:38.296 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbf8c066f30 msgr2=0x7fbf8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbf8c066f30 0x7fbf8c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf900099f0 tx=0x7fbf90019000 comp rx=0 tx=0).stop 2023-10-08T15:40:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa015a620 msgr2=0x7fbfa00d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa015a620 0x7fbfa00d0280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400ec50 tx=0x7fbf940091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 shutdown_connections 2023-10-08T15:40:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbf8c066f30 0x7fbf8c0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfa015d580 0x7fbfa00d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfa0157870 0x7fbfa01478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 --2- 172.21.15.29:0/227627042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbfa015a620 0x7fbfa00d0280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 >> 172.21.15.29:0/227627042 conn(0x7fbfa0068ce0 msgr2=0x7fbfa0155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 shutdown_connections 2023-10-08T15:40:38.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.297+0000 7fbfa7270700 1 -- 172.21.15.29:0/227627042 wait complete. 2023-10-08T15:40:38.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:40:20.956808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:40:22.081738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:38.310 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:38.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.431+0000 7f55d832c700 1 Processor -- start 2023-10-08T15:40:38.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.431+0000 7f55d832c700 1 -- start start 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.432+0000 7f55d832c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f55d015b9a0 0x7f55d00caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.432+0000 7f55d832c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.432+0000 7f55d832c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d015c8d0 con 0x7f55d0152300 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.432+0000 7f55d832c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d00b1400 con 0x7f55d015b9a0 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.432+0000 7f55d832c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d015be20 con 0x7f55d006d370 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.432+0000 7f55d60c8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f55d0152300 0x7f55d0158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51004/0 (socket says 172.21.15.29:51004) 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.432+0000 7f55d60c8700 1 -- 172.21.15.29:0/4092884432 learned_addr learned my addr 172.21.15.29:0/4092884432 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d68c9700 1 --2- 172.21.15.29:0/4092884432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d58c7700 1 --2- 172.21.15.29:0/4092884432 >> v2:172.21.15.183:3300/0 conn(0x7f55d015b9a0 0x7f55d00caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d50c6700 1 -- 172.21.15.29:0/4092884432 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239736768 0 0) 0x7f55d015c8d0 con 0x7f55d0152300 2023-10-08T15:40:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d50c6700 1 -- 172.21.15.29:0/4092884432 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b8003570 con 0x7f55d0152300 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d68c9700 1 -- 172.21.15.29:0/4092884432 >> v2:172.21.15.183:3300/0 conn(0x7f55d015b9a0 msgr2=0x7f55d00caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d68c9700 1 --2- 172.21.15.29:0/4092884432 >> v2:172.21.15.183:3300/0 conn(0x7f55d015b9a0 0x7f55d00caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d68c9700 1 -- 172.21.15.29:0/4092884432 >> v1:172.21.15.29:6789/0 conn(0x7f55d0152300 legacy=0x7f55d0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d68c9700 1 -- 172.21.15.29:0/4092884432 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d00c9370 con 0x7f55d006d370 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d58c7700 1 --2- 172.21.15.29:0/4092884432 >> v2:172.21.15.183:3300/0 conn(0x7f55d015b9a0 0x7f55d00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d68c9700 1 --2- 172.21.15.29:0/4092884432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d006d790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009e60 tx=0x7f55c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e4f851af419ab8c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d50c6700 1 -- 172.21.15.29:0/4092884432 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000e070 con 0x7f55d006d370 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d50c6700 1 -- 172.21.15.29:0/4092884432 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c000bab0 con 0x7f55d006d370 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.433+0000 7f55d50c6700 1 -- 172.21.15.29:0/4092884432 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c000be30 con 0x7f55d006d370 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.434+0000 7f55d832c700 1 -- 172.21.15.29:0/4092884432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 msgr2=0x7f55d006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.434+0000 7f55d832c700 1 --2- 172.21.15.29:0/4092884432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d006d790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009e60 tx=0x7f55c0009780 comp rx=0 tx=0).stop 2023-10-08T15:40:38.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.434+0000 7f55d832c700 1 -- 172.21.15.29:0/4092884432 shutdown_connections 2023-10-08T15:40:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.434+0000 7f55d832c700 1 --2- 172.21.15.29:0/4092884432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d006d790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.434+0000 7f55d832c700 1 --2- 172.21.15.29:0/4092884432 >> v2:172.21.15.183:3300/0 conn(0x7f55d015b9a0 0x7f55d00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.434+0000 7f55d832c700 1 -- 172.21.15.29:0/4092884432 >> 172.21.15.29:0/4092884432 conn(0x7f55d0069870 msgr2=0x7f55d0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.434+0000 7f55d832c700 1 -- 172.21.15.29:0/4092884432 shutdown_connections 2023-10-08T15:40:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.434+0000 7f55d832c700 1 -- 172.21.15.29:0/4092884432 wait complete. 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.435+0000 7f55d832c700 1 Processor -- start 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.435+0000 7f55d832c700 1 -- start start 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d832c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d014d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d832c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d0152300 0x7f55d0150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d832c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55d015b9a0 0x7f55d0150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d832c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00c84b0 con 0x7f55d015b9a0 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d832c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00c78a0 con 0x7f55d0152300 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d832c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00c7b80 con 0x7f55d006d370 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55d015b9a0 0x7f55d0150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55d015b9a0 0x7f55d0150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37788/0 (socket says 172.21.15.29:37788) 2023-10-08T15:40:38.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 -- 172.21.15.29:0/1204676442 learned_addr learned my addr 172.21.15.29:0/1204676442 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d58c7700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d0152300 0x7f55d0150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d60c8700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d014d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 -- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 msgr2=0x7f55d014d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d014d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 -- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d0152300 msgr2=0x7f55d0150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d0152300 0x7f55d0150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 -- 172.21.15.29:0/1204676442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c4009420 con 0x7f55d015b9a0 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d58c7700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d0152300 0x7f55d0150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55d68c9700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55d015b9a0 0x7f55d0150a50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55d00cebd0 tx=0x7f55c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55ce7fc700 1 -- 172.21.15.29:0/1204676442 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0012da0 con 0x7f55d015b9a0 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.436+0000 7f55ce7fc700 1 -- 172.21.15.29:0/1204676442 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c0021070 con 0x7f55d015b9a0 2023-10-08T15:40:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.437+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c0009a20 con 0x7f55d015b9a0 2023-10-08T15:40:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.437+0000 7f55ce7fc700 1 -- 172.21.15.29:0/1204676442 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0026680 con 0x7f55d015b9a0 2023-10-08T15:40:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.437+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d00c8140 con 0x7f55d015b9a0 2023-10-08T15:40:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.437+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d004c3c0 con 0x7f55d015b9a0 2023-10-08T15:40:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.438+0000 7f55ce7fc700 1 -- 172.21.15.29:0/1204676442 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55c0023030 con 0x7f55d015b9a0 2023-10-08T15:40:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.438+0000 7f55ce7fc700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f55bc066f30 0x7f55bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.438+0000 7f55ce7fc700 1 -- 172.21.15.29:0/1204676442 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55c0086690 con 0x7f55d015b9a0 2023-10-08T15:40:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.439+0000 7f55d60c8700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f55bc066f30 0x7f55bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.439+0000 7f55d60c8700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f55bc066f30 0x7f55bc0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55c80058d0 tx=0x7f55c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.443+0000 7f55ce7fc700 1 -- 172.21.15.29:0/1204676442 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55c0053900 con 0x7f55d015b9a0 2023-10-08T15:40:38.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.642+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55d00c85f0 con 0x7f55d015b9a0 2023-10-08T15:40:38.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.642+0000 7f55ce7fc700 1 -- 172.21.15.29:0/1204676442 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55c0056f20 con 0x7f55d015b9a0 2023-10-08T15:40:38.643 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:38.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.644+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f55bc066f30 msgr2=0x7f55bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.644+0000 7f55d832c700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f55bc066f30 0x7f55bc0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55c80058d0 tx=0x7f55c8009040 comp rx=0 tx=0).stop 2023-10-08T15:40:38.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.644+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55d015b9a0 msgr2=0x7f55d0150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.644+0000 7f55d832c700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55d015b9a0 0x7f55d0150a50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f55d00cebd0 tx=0x7f55c0019000 comp rx=0 tx=0).stop 2023-10-08T15:40:38.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.645+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 shutdown_connections 2023-10-08T15:40:38.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.645+0000 7f55d832c700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f55bc066f30 0x7f55bc0693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.645+0000 7f55d832c700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55d015b9a0 0x7f55d0150a50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.645+0000 7f55d832c700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55d006d370 0x7f55d014d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.645+0000 7f55d832c700 1 --2- 172.21.15.29:0/1204676442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55d0152300 0x7f55d0150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.645+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 >> 172.21.15.29:0/1204676442 conn(0x7f55d0069870 msgr2=0x7f55d00ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.645+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 shutdown_connections 2023-10-08T15:40:38.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.645+0000 7f55d832c700 1 -- 172.21.15.29:0/1204676442 wait complete. 2023-10-08T15:40:38.657 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.779+0000 7fdc2cc09700 1 Processor -- start 2023-10-08T15:40:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.779+0000 7fdc2cc09700 1 -- start start 2023-10-08T15:40:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2cc09700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc28159ec0 0x7fdc280af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2cc09700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc280b0790 con 0x7fdc2815a290 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2cc09700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc280ce1f0 con 0x7fdc2806acb0 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2cc09700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc280b0b20 con 0x7fdc28159ec0 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdc28159ec0 0x7fdc280af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc25d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdc2815a290 0x7fdc2806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51014/0 (socket says 172.21.15.29:51014) 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc25d9b700 1 -- 172.21.15.29:0/315361404 learned_addr learned my addr 172.21.15.29:0/315361404 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2559a700 1 -- 172.21.15.29:0/315361404 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586149697 0 0) 0x7fdc280b0790 con 0x7fdc2815a290 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2559a700 1 -- 172.21.15.29:0/315361404 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc14003570 con 0x7fdc2815a290 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2659c700 1 -- 172.21.15.29:0/315361404 >> v1:172.21.15.183:6789/0 conn(0x7fdc2806acb0 legacy=0x7fdc280cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2659c700 1 -- 172.21.15.29:0/315361404 >> v1:172.21.15.29:6789/0 conn(0x7fdc2815a290 legacy=0x7fdc2806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2659c700 1 -- 172.21.15.29:0/315361404 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280b04b0 con 0x7fdc28159ec0 2023-10-08T15:40:38.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2659c700 1 --2- 172.21.15.29:0/315361404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc280af940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc180098e0 tx=0x7fdc180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b946b98c3f67535a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2559a700 1 -- 172.21.15.29:0/315361404 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800b640 con 0x7fdc28159ec0 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2559a700 1 -- 172.21.15.29:0/315361404 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1800b7a0 con 0x7fdc28159ec0 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.780+0000 7fdc2559a700 1 -- 172.21.15.29:0/315361404 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800bb40 con 0x7fdc28159ec0 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.781+0000 7fdc2cc09700 1 -- 172.21.15.29:0/315361404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 msgr2=0x7fdc280af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.781+0000 7fdc2cc09700 1 --2- 172.21.15.29:0/315361404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc280af940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc180098e0 tx=0x7fdc180091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.781+0000 7fdc2cc09700 1 -- 172.21.15.29:0/315361404 shutdown_connections 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.781+0000 7fdc2cc09700 1 --2- 172.21.15.29:0/315361404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc280af940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.781+0000 7fdc2cc09700 1 -- 172.21.15.29:0/315361404 >> 172.21.15.29:0/315361404 conn(0x7fdc280d1880 msgr2=0x7fdc280cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.781+0000 7fdc2cc09700 1 -- 172.21.15.29:0/315361404 shutdown_connections 2023-10-08T15:40:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.781+0000 7fdc2cc09700 1 -- 172.21.15.29:0/315361404 wait complete. 2023-10-08T15:40:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.782+0000 7fdc2cc09700 1 Processor -- start 2023-10-08T15:40:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.782+0000 7fdc2cc09700 1 -- start start 2023-10-08T15:40:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc2cc09700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc2806acb0 0x7fdc28158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc2cc09700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc2815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc2cc09700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc2815a290 0x7fdc2815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc2cc09700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28158da0 con 0x7fdc28159ec0 2023-10-08T15:40:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc2cc09700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2815c490 con 0x7fdc2815a290 2023-10-08T15:40:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc2cc09700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2815c770 con 0x7fdc2806acb0 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc2815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc2815b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37808/0 (socket says 172.21.15.29:37808) 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 -- 172.21.15.29:0/3863107454 learned_addr learned my addr 172.21.15.29:0/3863107454 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc2659c700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc2806acb0 0x7fdc28158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc26d9d700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc2815a290 0x7fdc2815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 -- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc2806acb0 msgr2=0x7fdc28158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc2806acb0 0x7fdc28158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 -- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc2815a290 msgr2=0x7fdc2815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc2815a290 0x7fdc2815bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 -- 172.21.15.29:0/3863107454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc18009420 con 0x7fdc28159ec0 2023-10-08T15:40:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc26d9d700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc2815a290 0x7fdc2815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.783+0000 7fdc25d9b700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc2815b8b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000c590 tx=0x7fdc10007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.784+0000 7fdc1e7fc700 1 -- 172.21.15.29:0/3863107454 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10005cd0 con 0x7fdc28159ec0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.784+0000 7fdc1e7fc700 1 -- 172.21.15.29:0/3863107454 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10005e50 con 0x7fdc28159ec0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.784+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2815ca50 con 0x7fdc28159ec0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.784+0000 7fdc1e7fc700 1 -- 172.21.15.29:0/3863107454 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10007320 con 0x7fdc28159ec0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.784+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2815d010 con 0x7fdc28159ec0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.785+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2815d230 con 0x7fdc28159ec0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.785+0000 7fdc1e7fc700 1 -- 172.21.15.29:0/3863107454 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc1001b3b0 con 0x7fdc28159ec0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.785+0000 7fdc1e7fc700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdc08066f30 0x7fdc080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.785+0000 7fdc1e7fc700 1 -- 172.21.15.29:0/3863107454 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc10083c20 con 0x7fdc28159ec0 2023-10-08T15:40:38.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.786+0000 7fdc2659c700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdc08066f30 0x7fdc080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:38.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.786+0000 7fdc2659c700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdc08066f30 0x7fdc080693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc180093f0 tx=0x7fdc18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:38.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.790+0000 7fdc1e7fc700 1 -- 172.21.15.29:0/3863107454 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc10050e90 con 0x7fdc28159ec0 2023-10-08T15:40:38.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.979+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc2804c3c0 con 0x7fdc28159ec0 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.979+0000 7fdc1e7fc700 1 -- 172.21.15.29:0/3863107454 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc10017020 con 0x7fdc28159ec0 2023-10-08T15:40:38.980 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:40:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdc08066f30 msgr2=0x7fdc080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdc08066f30 0x7fdc080693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc180093f0 tx=0x7fdc18017000 comp rx=0 tx=0).stop 2023-10-08T15:40:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 msgr2=0x7fdc2815b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc2815b8b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000c590 tx=0x7fdc10007e00 comp rx=0 tx=0).stop 2023-10-08T15:40:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 shutdown_connections 2023-10-08T15:40:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdc08066f30 0x7fdc080693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc2815a290 0x7fdc2815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc2806acb0 0x7fdc28158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 --2- 172.21.15.29:0/3863107454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc28159ec0 0x7fdc2815b8b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.981+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 >> 172.21.15.29:0/3863107454 conn(0x7fdc280d1880 msgr2=0x7fdc280c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.982+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 shutdown_connections 2023-10-08T15:40:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:38.982+0000 7fdc2cc09700 1 -- 172.21.15.29:0/3863107454 wait complete. 2023-10-08T15:40:38.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.116+0000 7f489c10e700 1 Processor -- start 2023-10-08T15:40:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.116+0000 7f489c10e700 1 -- start start 2023-10-08T15:40:39.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f489c10e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4894159ec0 0x7f48940af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f489c10e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f489415a290 0x7f48940afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f489c10e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f489406a5a0 0x7f489406aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f489c10e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489406af60 con 0x7f489415a290 2023-10-08T15:40:39.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f489c10e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48940b0790 con 0x7f489406a5a0 2023-10-08T15:40:39.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f489c10e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940ce1f0 con 0x7f4894159ec0 2023-10-08T15:40:39.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f489415a290 0x7f48940afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f489415a290 0x7f48940afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37812/0 (socket says 172.21.15.29:37812) 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 -- 172.21.15.29:0/3107809551 learned_addr learned my addr 172.21.15.29:0/3107809551 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f4899eaa700 1 --2- 172.21.15.29:0/3107809551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4894159ec0 0x7f48940af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f489a6ab700 1 --2- 172.21.15.29:0/3107809551 >> v2:172.21.15.183:3300/0 conn(0x7f489406a5a0 0x7f489406aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 -- 172.21.15.29:0/3107809551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4894159ec0 msgr2=0x7f48940af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 --2- 172.21.15.29:0/3107809551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4894159ec0 0x7f48940af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 -- 172.21.15.29:0/3107809551 >> v2:172.21.15.183:3300/0 conn(0x7f489406a5a0 msgr2=0x7f489406aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 --2- 172.21.15.29:0/3107809551 >> v2:172.21.15.183:3300/0 conn(0x7f489406a5a0 0x7f489406aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 -- 172.21.15.29:0/3107809551 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940b0b20 con 0x7f489415a290 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f489a6ab700 1 --2- 172.21.15.29:0/3107809551 >> v2:172.21.15.183:3300/0 conn(0x7f489406a5a0 0x7f489406aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:39.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f48996a9700 1 --2- 172.21.15.29:0/3107809551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489415a290 0x7f48940afe80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48940b03c0 tx=0x7f4888009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf27916320f4c6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f4898ea8700 1 -- 172.21.15.29:0/3107809551 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800b860 con 0x7f489415a290 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f4898ea8700 1 -- 172.21.15.29:0/3107809551 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488800b9c0 con 0x7f489415a290 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.117+0000 7f4898ea8700 1 -- 172.21.15.29:0/3107809551 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800bd60 con 0x7f489415a290 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 -- 172.21.15.29:0/3107809551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489415a290 msgr2=0x7f48940afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 --2- 172.21.15.29:0/3107809551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489415a290 0x7f48940afe80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48940b03c0 tx=0x7f4888009250 comp rx=0 tx=0).stop 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 -- 172.21.15.29:0/3107809551 shutdown_connections 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 --2- 172.21.15.29:0/3107809551 >> v2:172.21.15.183:3300/0 conn(0x7f489406a5a0 0x7f489406aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 --2- 172.21.15.29:0/3107809551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4894159ec0 0x7f48940af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 --2- 172.21.15.29:0/3107809551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489415a290 0x7f48940afe80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 -- 172.21.15.29:0/3107809551 >> 172.21.15.29:0/3107809551 conn(0x7f48940d1880 msgr2=0x7f48940cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 -- 172.21.15.29:0/3107809551 shutdown_connections 2023-10-08T15:40:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.118+0000 7f489c10e700 1 -- 172.21.15.29:0/3107809551 wait complete. 2023-10-08T15:40:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.119+0000 7f489c10e700 1 Processor -- start 2023-10-08T15:40:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.119+0000 7f489c10e700 1 -- start start 2023-10-08T15:40:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f489c10e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489406a5a0 0x7f489416ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f489c10e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4894159ec0 0x7f4894156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f489c10e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489415a290 0x7f48941567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f489c10e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4894150a50 con 0x7f489406a5a0 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f489c10e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48941590b0 con 0x7f4894159ec0 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f489c10e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4894159390 con 0x7f489415a290 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489406a5a0 0x7f489416ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489406a5a0 0x7f489416ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37822/0 (socket says 172.21.15.29:37822) 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 -- 172.21.15.29:0/1798175208 learned_addr learned my addr 172.21.15.29:0/1798175208 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f489a6ab700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489415a290 0x7f48941567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f48996a9700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4894159ec0 0x7f4894156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 -- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489415a290 msgr2=0x7f48941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489415a290 0x7f48941567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 -- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4894159ec0 msgr2=0x7f4894156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4894159ec0 0x7f4894156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 -- 172.21.15.29:0/1798175208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48880094f0 con 0x7f489406a5a0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f48996a9700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4894159ec0 0x7f4894156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f489a6ab700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489415a290 0x7f48941567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.120+0000 7f4899eaa700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489406a5a0 0x7f489416ae40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f488400e190 tx=0x7f4884009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.121+0000 7f4891ffb700 1 -- 172.21.15.29:0/1798175208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400ee30 con 0x7f489406a5a0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.121+0000 7f4891ffb700 1 -- 172.21.15.29:0/1798175208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4884014420 con 0x7f489406a5a0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.121+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4894159670 con 0x7f489406a5a0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.121+0000 7f4891ffb700 1 -- 172.21.15.29:0/1798175208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840147e0 con 0x7f489406a5a0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.121+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489416a770 con 0x7f489406a5a0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.122+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4894150d30 con 0x7f489406a5a0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.122+0000 7f4891ffb700 1 -- 172.21.15.29:0/1798175208 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4884014b90 con 0x7f489406a5a0 2023-10-08T15:40:39.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.122+0000 7f4891ffb700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.122+0000 7f4891ffb700 1 -- 172.21.15.29:0/1798175208 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4884084d90 con 0x7f489406a5a0 2023-10-08T15:40:39.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.123+0000 7f48996a9700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.123+0000 7f48996a9700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4880066f30 0x7f48800693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48940b03c0 tx=0x7f4888017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.127+0000 7f4891ffb700 1 -- 172.21.15.29:0/1798175208 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4884052000 con 0x7f489406a5a0 2023-10-08T15:40:39.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.319+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f489404c3c0 con 0x7f489406a5a0 2023-10-08T15:40:39.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.320+0000 7f4891ffb700 1 -- 172.21.15.29:0/1798175208 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4884009a60 con 0x7f489406a5a0 2023-10-08T15:40:39.321 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:40:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4880066f30 msgr2=0x7f48800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4880066f30 0x7f48800693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48940b03c0 tx=0x7f4888017000 comp rx=0 tx=0).stop 2023-10-08T15:40:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489406a5a0 msgr2=0x7f489416ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489406a5a0 0x7f489416ae40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f488400e190 tx=0x7f4884009920 comp rx=0 tx=0).stop 2023-10-08T15:40:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 shutdown_connections 2023-10-08T15:40:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4880066f30 0x7f48800693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f489415a290 0x7f48941567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f489406a5a0 0x7f489416ae40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 --2- 172.21.15.29:0/1798175208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4894159ec0 0x7f4894156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 >> 172.21.15.29:0/1798175208 conn(0x7f48940d1880 msgr2=0x7f48940afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:39.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 shutdown_connections 2023-10-08T15:40:39.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.322+0000 7f489c10e700 1 -- 172.21.15.29:0/1798175208 wait complete. 2023-10-08T15:40:39.334 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:39.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.453+0000 7f0e1d28c700 1 Processor -- start 2023-10-08T15:40:39.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.453+0000 7f0e1d28c700 1 -- start start 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.453+0000 7f0e1d28c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e18157870 0x7f0e1815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e1d28c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1815cbb0 con 0x7f0e1815a620 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e1d28c700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1815bfa0 con 0x7f0e18157c40 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e1d28c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1815c280 con 0x7f0e18157870 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e16ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e18157870 0x7f0e1815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e167fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0e1815a620 0x7f0e1815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51024/0 (socket says 172.21.15.29:51024) 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e167fc700 1 -- 172.21.15.29:0/795138919 learned_addr learned my addr 172.21.15.29:0/795138919 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e16ffd700 1 -- 172.21.15.29:0/795138919 >> v1:172.21.15.183:6789/0 conn(0x7f0e18157c40 legacy=0x7f0e18158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e16ffd700 1 -- 172.21.15.29:0/795138919 >> v1:172.21.15.29:6789/0 conn(0x7f0e1815a620 legacy=0x7f0e1815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e16ffd700 1 -- 172.21.15.29:0/795138919 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1815c560 con 0x7f0e18157870 2023-10-08T15:40:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e15ffb700 1 -- 172.21.15.29:0/795138919 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769252617 0 0) 0x7f0e1815cbb0 con 0x7f0e1815a620 2023-10-08T15:40:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e16ffd700 1 --2- 172.21.15.29:0/795138919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157870 0x7f0e1815b6a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009e60 tx=0x7f0e10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bf06853791aa1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e15ffb700 1 -- 172.21.15.29:0/795138919 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000e070 con 0x7f0e18157870 2023-10-08T15:40:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e15ffb700 1 -- 172.21.15.29:0/795138919 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1000bbf0 con 0x7f0e18157870 2023-10-08T15:40:39.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.454+0000 7f0e15ffb700 1 -- 172.21.15.29:0/795138919 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10012430 con 0x7f0e18157870 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.455+0000 7f0e1d28c700 1 -- 172.21.15.29:0/795138919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157870 msgr2=0x7f0e1815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.455+0000 7f0e1d28c700 1 --2- 172.21.15.29:0/795138919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157870 0x7f0e1815b6a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009e60 tx=0x7f0e10009780 comp rx=0 tx=0).stop 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.455+0000 7f0e1d28c700 1 -- 172.21.15.29:0/795138919 shutdown_connections 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.455+0000 7f0e1d28c700 1 --2- 172.21.15.29:0/795138919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157870 0x7f0e1815b6a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.455+0000 7f0e1d28c700 1 -- 172.21.15.29:0/795138919 >> 172.21.15.29:0/795138919 conn(0x7f0e18068ce0 msgr2=0x7f0e180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.455+0000 7f0e1d28c700 1 -- 172.21.15.29:0/795138919 shutdown_connections 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.455+0000 7f0e1d28c700 1 -- 172.21.15.29:0/795138919 wait complete. 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.456+0000 7f0e1d28c700 1 Processor -- start 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.456+0000 7f0e1d28c700 1 -- start start 2023-10-08T15:40:39.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e1d28c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e18157870 0x7f0e1813f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e1d28c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157c40 0x7f0e1816a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e1d28c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1815a620 0x7f0e1814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e1d28c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18150830 con 0x7f0e18157c40 2023-10-08T15:40:39.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e1d28c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180b22f0 con 0x7f0e1815a620 2023-10-08T15:40:39.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e1d28c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1814edf0 con 0x7f0e18157870 2023-10-08T15:40:39.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157c40 0x7f0e1816a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157c40 0x7f0e1816a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37848/0 (socket says 172.21.15.29:37848) 2023-10-08T15:40:39.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 -- 172.21.15.29:0/3370679145 learned_addr learned my addr 172.21.15.29:0/3370679145 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e16ffd700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e18157870 0x7f0e1813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e177fe700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1815a620 0x7f0e1814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 -- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e18157870 msgr2=0x7f0e1813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e18157870 0x7f0e1813f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 -- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1815a620 msgr2=0x7f0e1814fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1815a620 0x7f0e1814fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 -- 172.21.15.29:0/3370679145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10009a20 con 0x7f0e18157c40 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e177fe700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1815a620 0x7f0e1814fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.457+0000 7f0e167fc700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157c40 0x7f0e1816a4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000c5e0 tx=0x7f0e00000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.458+0000 7f0e0effd700 1 -- 172.21.15.29:0/3370679145 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00005b30 con 0x7f0e18157c40 2023-10-08T15:40:39.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.458+0000 7f0e0effd700 1 -- 172.21.15.29:0/3370679145 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e00005c90 con 0x7f0e18157c40 2023-10-08T15:40:39.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.458+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e180b19c0 con 0x7f0e18157c40 2023-10-08T15:40:39.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.458+0000 7f0e0effd700 1 -- 172.21.15.29:0/3370679145 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00007300 con 0x7f0e18157c40 2023-10-08T15:40:39.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.458+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e180b1f80 con 0x7f0e18157c40 2023-10-08T15:40:39.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.458+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1804c3c0 con 0x7f0e18157c40 2023-10-08T15:40:39.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.459+0000 7f0e0effd700 1 -- 172.21.15.29:0/3370679145 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e000076b0 con 0x7f0e18157c40 2023-10-08T15:40:39.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.459+0000 7f0e0effd700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.460+0000 7f0e0effd700 1 -- 172.21.15.29:0/3370679145 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e00083a70 con 0x7f0e18157c40 2023-10-08T15:40:39.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.460+0000 7f0e16ffd700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.460+0000 7f0e16ffd700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e100099f0 tx=0x7f0e10018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.464+0000 7f0e0effd700 1 -- 172.21.15.29:0/3370679145 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e00050ce0 con 0x7f0e18157c40 2023-10-08T15:40:39.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.701+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e180b2430 con 0x7f0e18157c40 2023-10-08T15:40:39.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.702+0000 7f0e0effd700 1 -- 172.21.15.29:0/3370679145 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f0e00017090 con 0x7f0e18157c40 2023-10-08T15:40:39.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:39.847 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:23.085169+0000","modified":"2023-10-08T15:40:26.715893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:40:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 msgr2=0x7f0df80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e100099f0 tx=0x7f0e10018000 comp rx=0 tx=0).stop 2023-10-08T15:40:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157c40 msgr2=0x7f0e1816a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157c40 0x7f0e1816a4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000c5e0 tx=0x7f0e00000fe0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 shutdown_connections 2023-10-08T15:40:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e1815a620 0x7f0e1814fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e18157870 0x7f0e1813f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 --2- 172.21.15.29:0/3370679145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e18157c40 0x7f0e1816a4c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 >> 172.21.15.29:0/3370679145 conn(0x7f0e18068ce0 msgr2=0x7f0e180b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:39.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 shutdown_connections 2023-10-08T15:40:39.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.704+0000 7f0e1d28c700 1 -- 172.21.15.29:0/3370679145 wait complete. 2023-10-08T15:40:39.850 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2023-10-08T15:40:39.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:39.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.971+0000 7f741a5db700 1 Processor -- start 2023-10-08T15:40:39.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.972+0000 7f741a5db700 1 -- start start 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.972+0000 7f741a5db700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7414157870 0x7f741415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.972+0000 7f741a5db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157c40 0x7f7414158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.972+0000 7f741a5db700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741415cbb0 con 0x7f741415a620 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.972+0000 7f741a5db700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741415bfa0 con 0x7f7414157870 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.972+0000 7f741a5db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741415c280 con 0x7f7414157c40 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.972+0000 7f7413fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7414157870 0x7f741415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7413fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7414157870 0x7f741415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37860/0 (socket says 172.21.15.29:37860) 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7413fff700 1 -- 172.21.15.29:0/566398658 learned_addr learned my addr 172.21.15.29:0/566398658 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:39.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7418b78700 1 --2- 172.21.15.29:0/566398658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157c40 0x7f7414158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7413fff700 1 -- 172.21.15.29:0/566398658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157c40 msgr2=0x7f7414158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7413fff700 1 --2- 172.21.15.29:0/566398658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157c40 0x7f7414158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7413fff700 1 -- 172.21.15.29:0/566398658 >> v1:172.21.15.183:6789/0 conn(0x7f741415a620 legacy=0x7f741415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7413fff700 1 -- 172.21.15.29:0/566398658 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741415c560 con 0x7f7414157870 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7418b78700 1 --2- 172.21.15.29:0/566398658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157c40 0x7f7414158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7413fff700 1 --2- 172.21.15.29:0/566398658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157870 0x7f741415b6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74040099b0 tx=0x7f7404009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf65838645a8a9e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7412ffd700 1 -- 172.21.15.29:0/566398658 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400b820 con 0x7f7414157870 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7412ffd700 1 -- 172.21.15.29:0/566398658 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400b980 con 0x7f7414157870 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.973+0000 7f7412ffd700 1 -- 172.21.15.29:0/566398658 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400bd20 con 0x7f7414157870 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.974+0000 7f741a5db700 1 -- 172.21.15.29:0/566398658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157870 msgr2=0x7f741415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.974+0000 7f741a5db700 1 --2- 172.21.15.29:0/566398658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157870 0x7f741415b6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74040099b0 tx=0x7f7404009250 comp rx=0 tx=0).stop 2023-10-08T15:40:39.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.974+0000 7f741a5db700 1 -- 172.21.15.29:0/566398658 shutdown_connections 2023-10-08T15:40:39.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.974+0000 7f741a5db700 1 --2- 172.21.15.29:0/566398658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157c40 0x7f7414158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.974+0000 7f741a5db700 1 --2- 172.21.15.29:0/566398658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157870 0x7f741415b6a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.974+0000 7f741a5db700 1 -- 172.21.15.29:0/566398658 >> 172.21.15.29:0/566398658 conn(0x7f7414068ce0 msgr2=0x7f74140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:39.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.974+0000 7f741a5db700 1 -- 172.21.15.29:0/566398658 shutdown_connections 2023-10-08T15:40:39.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.974+0000 7f741a5db700 1 -- 172.21.15.29:0/566398658 wait complete. 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.975+0000 7f741a5db700 1 Processor -- start 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.975+0000 7f741a5db700 1 -- start start 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f741a5db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157870 0x7f74141562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f741a5db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157c40 0x7f74141605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f741a5db700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f741415a620 0x7f7414160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f741a5db700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74140cd600 con 0x7f7414157c40 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f741a5db700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74140c7030 con 0x7f741415a620 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f741a5db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741415d840 con 0x7f7414157870 2023-10-08T15:40:39.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157c40 0x7f74141605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157c40 0x7f74141605c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37868/0 (socket says 172.21.15.29:37868) 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 -- 172.21.15.29:0/1960376006 learned_addr learned my addr 172.21.15.29:0/1960376006 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f7413fff700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157870 0x7f74141562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f7418b78700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f741415a620 0x7f7414160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 -- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157870 msgr2=0x7f74141562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157870 0x7f74141562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 -- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f741415a620 msgr2=0x7f7414160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f741415a620 0x7f7414160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 -- 172.21.15.29:0/1960376006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040094f0 con 0x7f7414157c40 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f7418b78700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f741415a620 0x7f7414160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f74137fe700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157c40 0x7f74141605c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00b5e0 tx=0x7f73fc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f740bfff700 1 -- 172.21.15.29:0/1960376006 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00f510 con 0x7f7414157c40 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f740bfff700 1 -- 172.21.15.29:0/1960376006 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc00f6b0 con 0x7f7414157c40 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74140c6790 con 0x7f7414157c40 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f740bfff700 1 -- 172.21.15.29:0/1960376006 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00fa70 con 0x7f7414157c40 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.976+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74140c6d50 con 0x7f7414157c40 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.977+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741415d9f0 con 0x7f7414157c40 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.978+0000 7f740bfff700 1 -- 172.21.15.29:0/1960376006 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73fc01a400 con 0x7f7414157c40 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.978+0000 7f740bfff700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.978+0000 7f740bfff700 1 -- 172.21.15.29:0/1960376006 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73fc083ff0 con 0x7f7414157c40 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.979+0000 7f7413fff700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:39.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.979+0000 7f7413fff700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f73f4066f30 0x7f73f40693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74040099b0 tx=0x7f7404016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:39.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:39.983+0000 7f740bfff700 1 -- 172.21.15.29:0/1960376006 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f741415d9f0 con 0x7f7414157c40 2023-10-08T15:40:40.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.176+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f741415d9b0 con 0x7f7414157c40 2023-10-08T15:40:40.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.177+0000 7f740bfff700 1 -- 172.21.15.29:0/1960376006 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f73fc054d10 con 0x7f7414157c40 2023-10-08T15:40:40.177 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:40.177 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:40.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.178+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f73f4066f30 msgr2=0x7f73f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.178+0000 7f741a5db700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f73f4066f30 0x7f73f40693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74040099b0 tx=0x7f7404016000 comp rx=0 tx=0).stop 2023-10-08T15:40:40.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.178+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157c40 msgr2=0x7f74141605c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.178+0000 7f741a5db700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157c40 0x7f74141605c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00b5e0 tx=0x7f73fc0090f0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.179+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 shutdown_connections 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.179+0000 7f741a5db700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f73f4066f30 0x7f73f40693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.179+0000 7f741a5db700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f741415a620 0x7f7414160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.179+0000 7f741a5db700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7414157870 0x7f74141562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.179+0000 7f741a5db700 1 --2- 172.21.15.29:0/1960376006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7414157c40 0x7f74141605c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.179+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 >> 172.21.15.29:0/1960376006 conn(0x7f7414068ce0 msgr2=0x7f74140b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.179+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 shutdown_connections 2023-10-08T15:40:40.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.179+0000 7f741a5db700 1 -- 172.21.15.29:0/1960376006 wait complete. 2023-10-08T15:40:40.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:40:20.956808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:40:22.081738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:40.192 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:40.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.314+0000 7fa2a81cd700 1 Processor -- start 2023-10-08T15:40:40.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.314+0000 7fa2a81cd700 1 -- start start 2023-10-08T15:40:40.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a81cd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00ab910 0x7fa2a00caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a81cd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2a00abce0 0x7fa2a00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a81cd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a00c3430 con 0x7fa2a015a730 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a81cd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a00c9100 con 0x7fa2a00abce0 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a81cd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0158050 con 0x7fa2a00ab910 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a676a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2a00abce0 0x7fa2a00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a676a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2a00abce0 0x7fa2a00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37880/0 (socket says 172.21.15.29:37880) 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a676a700 1 -- 172.21.15.29:0/4076438036 learned_addr learned my addr 172.21.15.29:0/4076438036 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a5f69700 1 --2- 172.21.15.29:0/4076438036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00ab910 0x7fa2a00caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a676a700 1 -- 172.21.15.29:0/4076438036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00ab910 msgr2=0x7fa2a00caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:40.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a676a700 1 --2- 172.21.15.29:0/4076438036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00ab910 0x7fa2a00caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a676a700 1 -- 172.21.15.29:0/4076438036 >> v1:172.21.15.183:6789/0 conn(0x7fa2a015a730 legacy=0x7fa2a00c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a676a700 1 -- 172.21.15.29:0/4076438036 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a015abc0 con 0x7fa2a00abce0 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a5f69700 1 --2- 172.21.15.29:0/4076438036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00ab910 0x7fa2a00caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a676a700 1 --2- 172.21.15.29:0/4076438036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a00abce0 0x7fa2a00cb970 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa29800bc80 tx=0x7fa29800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9082852c8fe2a423 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a4f67700 1 -- 172.21.15.29:0/4076438036 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800be90 con 0x7fa2a00abce0 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a4f67700 1 -- 172.21.15.29:0/4076438036 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800ddc0 con 0x7fa2a00abce0 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.315+0000 7fa2a4f67700 1 -- 172.21.15.29:0/4076438036 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980196b0 con 0x7fa2a00abce0 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.316+0000 7fa2a81cd700 1 -- 172.21.15.29:0/4076438036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a00abce0 msgr2=0x7fa2a00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.316+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/4076438036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a00abce0 0x7fa2a00cb970 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa29800bc80 tx=0x7fa29800b4f0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.316+0000 7fa2a81cd700 1 -- 172.21.15.29:0/4076438036 shutdown_connections 2023-10-08T15:40:40.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.316+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/4076438036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a00abce0 0x7fa2a00cb970 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.316+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/4076438036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00ab910 0x7fa2a00caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.316+0000 7fa2a81cd700 1 -- 172.21.15.29:0/4076438036 >> 172.21.15.29:0/4076438036 conn(0x7fa2a0067660 msgr2=0x7fa2a0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:40.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.316+0000 7fa2a81cd700 1 -- 172.21.15.29:0/4076438036 shutdown_connections 2023-10-08T15:40:40.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.316+0000 7fa2a81cd700 1 -- 172.21.15.29:0/4076438036 wait complete. 2023-10-08T15:40:40.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.317+0000 7fa2a81cd700 1 Processor -- start 2023-10-08T15:40:40.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.317+0000 7fa2a81cd700 1 -- start start 2023-10-08T15:40:40.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a81cd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2a00ab910 0x7fa2a01481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a81cd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00abce0 0x7fa2a0156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a81cd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a015a730 0x7fa2a006df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a81cd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0154840 con 0x7fa2a015a730 2023-10-08T15:40:40.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a81cd700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a01586f0 con 0x7fa2a00ab910 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a81cd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0154ae0 con 0x7fa2a00abce0 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a676a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a015a730 0x7fa2a006df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a676a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a015a730 0x7fa2a006df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37892/0 (socket says 172.21.15.29:37892) 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a676a700 1 -- 172.21.15.29:0/1134734602 learned_addr learned my addr 172.21.15.29:0/1134734602 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a5f69700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2a00ab910 0x7fa2a01481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a5768700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00abce0 0x7fa2a0156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a676a700 1 -- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00abce0 msgr2=0x7fa2a0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a676a700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00abce0 0x7fa2a0156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a676a700 1 -- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2a00ab910 msgr2=0x7fa2a01481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a676a700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2a00ab910 0x7fa2a01481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.318+0000 7fa2a676a700 1 -- 172.21.15.29:0/1134734602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29800b790 con 0x7fa2a015a730 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.319+0000 7fa2a676a700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a015a730 0x7fa2a006df60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa29800b530 tx=0x7fa29801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.319+0000 7fa29dffb700 1 -- 172.21.15.29:0/1134734602 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800be90 con 0x7fa2a015a730 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.319+0000 7fa29dffb700 1 -- 172.21.15.29:0/1134734602 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa298010b30 con 0x7fa2a015a730 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.319+0000 7fa29dffb700 1 -- 172.21.15.29:0/1134734602 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298023410 con 0x7fa2a015a730 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.319+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a0154dc0 con 0x7fa2a015a730 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.319+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a0156770 con 0x7fa2a015a730 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.320+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a004c3c0 con 0x7fa2a015a730 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.320+0000 7fa29dffb700 1 -- 172.21.15.29:0/1134734602 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa298023840 con 0x7fa2a015a730 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.321+0000 7fa29dffb700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa28c066f30 0x7fa28c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.321+0000 7fa29dffb700 1 -- 172.21.15.29:0/1134734602 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa298014070 con 0x7fa2a015a730 2023-10-08T15:40:40.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.321+0000 7fa2a5f69700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa28c066f30 0x7fa28c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.321+0000 7fa2a5f69700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa28c066f30 0x7fa28c0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa2900076a0 tx=0x7fa290009930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:40.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.325+0000 7fa29dffb700 1 -- 172.21.15.29:0/1134734602 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa298055e90 con 0x7fa2a015a730 2023-10-08T15:40:40.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.516+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2a00c7b80 con 0x7fa2a015a730 2023-10-08T15:40:40.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.516+0000 7fa29dffb700 1 -- 172.21.15.29:0/1134734602 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2980594b0 con 0x7fa2a015a730 2023-10-08T15:40:40.517 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:40.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa28c066f30 msgr2=0x7fa28c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa28c066f30 0x7fa28c0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa2900076a0 tx=0x7fa290009930 comp rx=0 tx=0).stop 2023-10-08T15:40:40.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a015a730 msgr2=0x7fa2a006df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a015a730 0x7fa2a006df60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa29800b530 tx=0x7fa29801b000 comp rx=0 tx=0).stop 2023-10-08T15:40:40.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 shutdown_connections 2023-10-08T15:40:40.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa28c066f30 0x7fa28c0693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a015a730 0x7fa2a006df60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2a00ab910 0x7fa2a01481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 --2- 172.21.15.29:0/1134734602 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2a00abce0 0x7fa2a0156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 >> 172.21.15.29:0/1134734602 conn(0x7fa2a0067660 msgr2=0x7fa2a0149ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:40.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 shutdown_connections 2023-10-08T15:40:40.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.518+0000 7fa2a81cd700 1 -- 172.21.15.29:0/1134734602 wait complete. 2023-10-08T15:40:40.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:40.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.653+0000 7f9748e09700 1 Processor -- start 2023-10-08T15:40:40.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.653+0000 7f9748e09700 1 -- start start 2023-10-08T15:40:40.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f9748e09700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 0x7f9744070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f9748e09700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9744070c40 0x7f974415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f9748e09700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9744068510 con 0x7f9744141570 2023-10-08T15:40:40.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f9748e09700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97440c8400 con 0x7f9744070c40 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f9748e09700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97440b0de0 con 0x7f97440b0970 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9744141570 0x7f974406eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51026/0 (socket says 172.21.15.29:51026) 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974259c700 1 -- 172.21.15.29:0/3507700491 learned_addr learned my addr 172.21.15.29:0/3507700491 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f9741d9b700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 0x7f9744070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f9742d9d700 1 --2- 172.21.15.29:0/3507700491 >> v2:172.21.15.183:3300/0 conn(0x7f9744070c40 0x7f974415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130227768 0 0) 0x7f9744068510 con 0x7f9744141570 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f972c003570 con 0x7f9744141570 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795823831 0 0) 0x7f972c003570 con 0x7f9744141570 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 msgr2=0x7f9744070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 0x7f9744070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 >> v2:172.21.15.183:3300/0 conn(0x7f9744070c40 msgr2=0x7f974415bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 --2- 172.21.15.29:0/3507700491 >> v2:172.21.15.183:3300/0 conn(0x7f9744070c40 0x7f974415bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744067660 con 0x7f9744141570 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f9734001470 con 0x7f9744141570 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 >> v1:172.21.15.29:6789/0 conn(0x7f9744141570 legacy=0x7f974406eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f972c003a60 0x7f972c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f972c004810 0x7f972c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 0x7f972c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440c8400 con 0x7f972c004810 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440b0de0 con 0x7f972c003a60 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c00ba60 con 0x7f97440b0970 2023-10-08T15:40:40.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.654+0000 7f9741d9b700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f972c004810 0x7f972c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f974259c700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f972c003a60 0x7f972c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9742d9d700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 0x7f972c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9741d9b700 1 -- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 msgr2=0x7f972c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9741d9b700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 0x7f972c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9741d9b700 1 -- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f972c003a60 msgr2=0x7f972c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9741d9b700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f972c003a60 0x7f972c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9741d9b700 1 -- 172.21.15.29:0/3507700491 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c003570 con 0x7f972c004810 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9742d9d700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97440b0970 0x7f972c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9741d9b700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f972c004810 0x7f972c004c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9738009c30 tx=0x7f97380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ca2a47d816daf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800e710 con 0x7f972c004810 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800e870 con 0x7f972c004810 2023-10-08T15:40:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f974159a700 1 -- 172.21.15.29:0/3507700491 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800ec30 con 0x7f972c004810 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9748e09700 1 -- 172.21.15.29:0/3507700491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f972c004810 msgr2=0x7f972c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9748e09700 1 --2- 172.21.15.29:0/3507700491 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f972c004810 0x7f972c004c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9738009c30 tx=0x7f97380091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.655+0000 7f9742d9d700 1 -- 172.21.15.29:0/3507700491 reap_dead start 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.656+0000 7f9748e09700 1 -- 172.21.15.29:0/3507700491 shutdown_connections 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.656+0000 7f9748e09700 1 -- 172.21.15.29:0/3507700491 >> 172.21.15.29:0/3507700491 conn(0x7f97440cdaa0 msgr2=0x7f97440cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.656+0000 7f9748e09700 1 -- 172.21.15.29:0/3507700491 shutdown_connections 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.656+0000 7f9748e09700 1 -- 172.21.15.29:0/3507700491 wait complete. 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.657+0000 7f9748e09700 1 Processor -- start 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.657+0000 7f9748e09700 1 -- start start 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.657+0000 7f9748e09700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f972c004810 0x7f97441573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.657+0000 7f9748e09700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f974415a940 0x7f974415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.657+0000 7f9748e09700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9744159530 0x7f97441599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.657+0000 7f9748e09700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744157930 con 0x7f9744159530 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.657+0000 7f9748e09700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97441590a0 con 0x7f974415a940 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.657+0000 7f9748e09700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974415cb10 con 0x7f972c004810 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9744159530 0x7f97441599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9744159530 0x7f97441599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37912/0 (socket says 172.21.15.29:37912) 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 -- 172.21.15.29:0/2859699651 learned_addr learned my addr 172.21.15.29:0/2859699651 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f974259c700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f972c004810 0x7f97441573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9741d9b700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f974415a940 0x7f974415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 -- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f972c004810 msgr2=0x7f97441573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f972c004810 0x7f97441573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 -- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f974415a940 msgr2=0x7f974415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f974415a940 0x7f974415adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 -- 172.21.15.29:0/2859699651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744158490 con 0x7f9744159530 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9741d9b700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f974415a940 0x7f974415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9742d9d700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9744159530 0x7f97441599a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f974406e900 tx=0x7f973c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f97327fc700 1 -- 172.21.15.29:0/2859699651 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c01b070 con 0x7f9744159530 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f97327fc700 1 -- 172.21.15.29:0/2859699651 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c00f040 con 0x7f9744159530 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9744158770 con 0x7f9744159530 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f97327fc700 1 -- 172.21.15.29:0/2859699651 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c00e050 con 0x7f9744159530 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.658+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9744158d30 con 0x7f9744159530 2023-10-08T15:40:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.659+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974404c3c0 con 0x7f9744159530 2023-10-08T15:40:40.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.660+0000 7f97327fc700 1 -- 172.21.15.29:0/2859699651 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f973c015650 con 0x7f9744159530 2023-10-08T15:40:40.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.661+0000 7f97327fc700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9724066f30 0x7f97240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.661+0000 7f97327fc700 1 -- 172.21.15.29:0/2859699651 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f973c085c60 con 0x7f9744159530 2023-10-08T15:40:40.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.661+0000 7f974259c700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9724066f30 0x7f97240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.661+0000 7f974259c700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9724066f30 0x7f97240693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9734001d20 tx=0x7f9734001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:40.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.664+0000 7f97327fc700 1 -- 172.21.15.29:0/2859699651 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f973c052f50 con 0x7f9744159530 2023-10-08T15:40:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.855+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f974406e930 con 0x7f9744159530 2023-10-08T15:40:40.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.855+0000 7f97327fc700 1 -- 172.21.15.29:0/2859699651 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f973c056570 con 0x7f9744159530 2023-10-08T15:40:40.856 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:40:40.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9724066f30 msgr2=0x7f97240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9724066f30 0x7f97240693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9734001d20 tx=0x7f9734001e90 comp rx=0 tx=0).stop 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9744159530 msgr2=0x7f97441599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9744159530 0x7f97441599a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f974406e900 tx=0x7f973c00b040 comp rx=0 tx=0).stop 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 shutdown_connections 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9724066f30 0x7f97240693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9744159530 0x7f97441599a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f972c004810 0x7f97441573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 --2- 172.21.15.29:0/2859699651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f974415a940 0x7f974415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 >> 172.21.15.29:0/2859699651 conn(0x7f97440cdaa0 msgr2=0x7f97440c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 shutdown_connections 2023-10-08T15:40:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.858+0000 7f9748e09700 1 -- 172.21.15.29:0/2859699651 wait complete. 2023-10-08T15:40:40.871 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.992+0000 7f21b7c51700 1 Processor -- start 2023-10-08T15:40:40.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.993+0000 7f21b7c51700 1 -- start start 2023-10-08T15:40:40.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.993+0000 7f21b7c51700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b0159ec0 0x7f21b00af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.993+0000 7f21b7c51700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21b006acb0 0x7f21b00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.993+0000 7f21b7c51700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b00b0790 con 0x7f21b015a290 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.993+0000 7f21b7c51700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b00ce1f0 con 0x7f21b006acb0 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.993+0000 7f21b7c51700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00b0b20 con 0x7f21b0159ec0 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b61ee700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f21b006acb0 0x7f21b00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b51ec700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f21b015a290 0x7f21b006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51028/0 (socket says 172.21.15.29:51028) 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b51ec700 1 -- 172.21.15.29:0/2010039396 learned_addr learned my addr 172.21.15.29:0/2010039396 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b59ed700 1 --2- 172.21.15.29:0/2010039396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b0159ec0 0x7f21b00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b49eb700 1 -- 172.21.15.29:0/2010039396 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962600738 0 0) 0x7f21b00b0790 con 0x7f21b015a290 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b49eb700 1 -- 172.21.15.29:0/2010039396 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2198003570 con 0x7f21b015a290 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b61ee700 1 -- 172.21.15.29:0/2010039396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b0159ec0 msgr2=0x7f21b00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:40.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b61ee700 1 --2- 172.21.15.29:0/2010039396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b0159ec0 0x7f21b00af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b61ee700 1 -- 172.21.15.29:0/2010039396 >> v1:172.21.15.29:6789/0 conn(0x7f21b015a290 legacy=0x7f21b006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b61ee700 1 -- 172.21.15.29:0/2010039396 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00b04b0 con 0x7f21b006acb0 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b61ee700 1 --2- 172.21.15.29:0/2010039396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b006acb0 0x7f21b00afe80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21a80098e0 tx=0x7f21a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca15b99b08455795 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b49eb700 1 -- 172.21.15.29:0/2010039396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8011630 con 0x7f21b006acb0 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b49eb700 1 -- 172.21.15.29:0/2010039396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8011790 con 0x7f21b006acb0 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.994+0000 7f21b49eb700 1 -- 172.21.15.29:0/2010039396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8011b30 con 0x7f21b006acb0 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.995+0000 7f21b7c51700 1 -- 172.21.15.29:0/2010039396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b006acb0 msgr2=0x7f21b00afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.995+0000 7f21b7c51700 1 --2- 172.21.15.29:0/2010039396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b006acb0 0x7f21b00afe80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21a80098e0 tx=0x7f21a80091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.995+0000 7f21b7c51700 1 -- 172.21.15.29:0/2010039396 shutdown_connections 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.995+0000 7f21b7c51700 1 --2- 172.21.15.29:0/2010039396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b006acb0 0x7f21b00afe80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.995+0000 7f21b7c51700 1 --2- 172.21.15.29:0/2010039396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b0159ec0 0x7f21b00af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:40.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.995+0000 7f21b7c51700 1 -- 172.21.15.29:0/2010039396 >> 172.21.15.29:0/2010039396 conn(0x7f21b00d1880 msgr2=0x7f21b00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:40.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.995+0000 7f21b7c51700 1 -- 172.21.15.29:0/2010039396 shutdown_connections 2023-10-08T15:40:40.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.995+0000 7f21b7c51700 1 -- 172.21.15.29:0/2010039396 wait complete. 2023-10-08T15:40:41.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.996+0000 7f21b7c51700 1 Processor -- start 2023-10-08T15:40:41.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.996+0000 7f21b7c51700 1 -- start start 2023-10-08T15:40:41.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b7c51700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b006acb0 0x7f21b0155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b7c51700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b0159ec0 0x7f21b00c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b7c51700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21b015a290 0x7f21b00c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b7c51700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b016ade0 con 0x7f21b0159ec0 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b7c51700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00ca600 con 0x7f21b015a290 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b7c51700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00c99f0 con 0x7f21b006acb0 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b0159ec0 0x7f21b00c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b0159ec0 0x7f21b00c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37932/0 (socket says 172.21.15.29:37932) 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 -- 172.21.15.29:0/1993035203 learned_addr learned my addr 172.21.15.29:0/1993035203 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b59ed700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b006acb0 0x7f21b0155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b61ee700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21b015a290 0x7f21b00c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 -- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b006acb0 msgr2=0x7f21b0155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b006acb0 0x7f21b0155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 -- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21b015a290 msgr2=0x7f21b00c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21b015a290 0x7f21b00c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 -- 172.21.15.29:0/1993035203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8009420 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b51ec700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b0159ec0 0x7f21b00c8e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21a400c590 tx=0x7f21a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21adffb700 1 -- 172.21.15.29:0/1993035203 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4005b30 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21adffb700 1 -- 172.21.15.29:0/1993035203 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a4005cb0 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.997+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b00c9cd0 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.998+0000 7f21adffb700 1 -- 172.21.15.29:0/1993035203 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4007320 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.998+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b00ca290 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.999+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b004c3c0 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.999+0000 7f21adffb700 1 -- 172.21.15.29:0/1993035203 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21a401b3b0 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:40.999+0000 7f21adffb700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f219c066f60 0x7f219c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.000+0000 7f21adffb700 1 -- 172.21.15.29:0/1993035203 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21a4083a00 con 0x7f21b0159ec0 2023-10-08T15:40:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.000+0000 7f21b59ed700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f219c066f60 0x7f219c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.000+0000 7f21b59ed700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f219c066f60 0x7f219c069410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21a000f570 tx=0x7f21a000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:41.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.004+0000 7f21adffb700 1 -- 172.21.15.29:0/1993035203 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21a4050bd0 con 0x7f21b0159ec0 2023-10-08T15:40:41.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.194+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21b00ca740 con 0x7f21b0159ec0 2023-10-08T15:40:41.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.195+0000 7f21adffb700 1 -- 172.21.15.29:0/1993035203 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21a4017020 con 0x7f21b0159ec0 2023-10-08T15:40:41.195 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:40:41.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f219c066f60 msgr2=0x7f219c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f219c066f60 0x7f219c069410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21a000f570 tx=0x7f21a000b040 comp rx=0 tx=0).stop 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b0159ec0 msgr2=0x7f21b00c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b0159ec0 0x7f21b00c8e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21a400c590 tx=0x7f21a4007e00 comp rx=0 tx=0).stop 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 shutdown_connections 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f219c066f60 0x7f219c069410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21b015a290 0x7f21b00c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21b006acb0 0x7f21b0155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 --2- 172.21.15.29:0/1993035203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b0159ec0 0x7f21b00c8e30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 >> 172.21.15.29:0/1993035203 conn(0x7f21b00d1880 msgr2=0x7f21b00cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 shutdown_connections 2023-10-08T15:40:41.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.197+0000 7f21b7c51700 1 -- 172.21.15.29:0/1993035203 wait complete. 2023-10-08T15:40:41.209 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:41.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.327+0000 7f8a74e78700 1 Processor -- start 2023-10-08T15:40:41.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.327+0000 7f8a74e78700 1 -- start start 2023-10-08T15:40:41.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a74e78700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700cd6e0 0x7f8a700cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a74e78700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8a700cdab0 0x7f8a7015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a74e78700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8a7015dda0 0x7f8a7015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a74e78700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7015e850 con 0x7f8a7015dda0 2023-10-08T15:40:41.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a74e78700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700cd030 con 0x7f8a700cdab0 2023-10-08T15:40:41.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a74e78700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700cb7c0 con 0x7f8a700cd6e0 2023-10-08T15:40:41.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8a7015dda0 0x7f8a7015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700cd6e0 0x7f8a700cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8a7015dda0 0x7f8a7015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37934/0 (socket says 172.21.15.29:37934) 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6f7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700cd6e0 0x7f8a700cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:40354/0 (socket says 172.21.15.29:40354) 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6ffff700 1 -- 172.21.15.29:0/1069305166 learned_addr learned my addr 172.21.15.29:0/1069305166 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6effd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8a700cdab0 0x7f8a7015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6ffff700 1 -- 172.21.15.29:0/1069305166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700cd6e0 msgr2=0x7f8a700cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6ffff700 1 --2- 172.21.15.29:0/1069305166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700cd6e0 0x7f8a700cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6ffff700 1 -- 172.21.15.29:0/1069305166 >> v2:172.21.15.183:3300/0 conn(0x7f8a700cdab0 msgr2=0x7f8a7015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6ffff700 1 --2- 172.21.15.29:0/1069305166 >> v2:172.21.15.183:3300/0 conn(0x7f8a700cdab0 0x7f8a7015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6ffff700 1 -- 172.21.15.29:0/1069305166 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7015e290 con 0x7f8a7015dda0 2023-10-08T15:40:41.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.328+0000 7f8a6effd700 1 --2- 172.21.15.29:0/1069305166 >> v2:172.21.15.183:3300/0 conn(0x7f8a700cdab0 0x7f8a7015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a6ffff700 1 --2- 172.21.15.29:0/1069305166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a7015dda0 0x7f8a7015cbd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a70089b50 tx=0x7f8a68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eef885a24042b75 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a6e7fc700 1 -- 172.21.15.29:0/1069305166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800e070 con 0x7f8a7015dda0 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a6e7fc700 1 -- 172.21.15.29:0/1069305166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6800b970 con 0x7f8a7015dda0 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a6e7fc700 1 -- 172.21.15.29:0/1069305166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680092e0 con 0x7f8a7015dda0 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 -- 172.21.15.29:0/1069305166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a7015dda0 msgr2=0x7f8a7015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 --2- 172.21.15.29:0/1069305166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a7015dda0 0x7f8a7015cbd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a70089b50 tx=0x7f8a68009840 comp rx=0 tx=0).stop 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 -- 172.21.15.29:0/1069305166 shutdown_connections 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 --2- 172.21.15.29:0/1069305166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a7015dda0 0x7f8a7015cbd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 --2- 172.21.15.29:0/1069305166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700cd6e0 0x7f8a700cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 --2- 172.21.15.29:0/1069305166 >> v2:172.21.15.183:3300/0 conn(0x7f8a700cdab0 0x7f8a7015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 -- 172.21.15.29:0/1069305166 >> 172.21.15.29:0/1069305166 conn(0x7f8a70067660 msgr2=0x7f8a70067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:41.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 -- 172.21.15.29:0/1069305166 shutdown_connections 2023-10-08T15:40:41.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.329+0000 7f8a74e78700 1 -- 172.21.15.29:0/1069305166 wait complete. 2023-10-08T15:40:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.331+0000 7f8a74e78700 1 Processor -- start 2023-10-08T15:40:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.331+0000 7f8a74e78700 1 -- start start 2023-10-08T15:40:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.331+0000 7f8a74e78700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a700cd6e0 0x7f8a70156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.331+0000 7f8a74e78700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a700cdab0 0x7f8a700b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.331+0000 7f8a74e78700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a7015dda0 0x7f8a700cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.331+0000 7f8a74e78700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700b4b00 con 0x7f8a700cdab0 2023-10-08T15:40:41.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.331+0000 7f8a74e78700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700b52e0 con 0x7f8a700cd6e0 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.331+0000 7f8a74e78700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700b55c0 con 0x7f8a7015dda0 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a700cdab0 0x7f8a700b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a700cdab0 0x7f8a700b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37946/0 (socket says 172.21.15.29:37946) 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 -- 172.21.15.29:0/4107510543 learned_addr learned my addr 172.21.15.29:0/4107510543 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6f7fe700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a700cd6e0 0x7f8a70156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6ffff700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a7015dda0 0x7f8a700cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 -- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a7015dda0 msgr2=0x7f8a700cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a7015dda0 0x7f8a700cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 -- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a700cd6e0 msgr2=0x7f8a70156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a700cd6e0 0x7f8a70156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 -- 172.21.15.29:0/4107510543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64009420 con 0x7f8a700cdab0 2023-10-08T15:40:41.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a6effd700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a700cdab0 0x7f8a700b4420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400ec80 tx=0x7f8a640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a577fe700 1 -- 172.21.15.29:0/4107510543 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400c920 con 0x7f8a700cdab0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a577fe700 1 -- 172.21.15.29:0/4107510543 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6400ca80 con 0x7f8a700cdab0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a68009ae0 con 0x7f8a700cdab0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a577fe700 1 -- 172.21.15.29:0/4107510543 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400ce00 con 0x7f8a700cdab0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.332+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a700cf4a0 con 0x7f8a700cdab0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.333+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a700b5a60 con 0x7f8a700cdab0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.333+0000 7f8a577fe700 1 -- 172.21.15.29:0/4107510543 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a64013680 con 0x7f8a700cdab0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.334+0000 7f8a577fe700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8a5c066f30 0x7f8a5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.334+0000 7f8a577fe700 1 -- 172.21.15.29:0/4107510543 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a64084910 con 0x7f8a700cdab0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.334+0000 7f8a6f7fe700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8a5c066f30 0x7f8a5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.334+0000 7f8a6f7fe700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8a5c066f30 0x7f8a5c0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009d10 tx=0x7f8a600091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:41.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.338+0000 7f8a577fe700 1 -- 172.21.15.29:0/4107510543 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a64051b80 con 0x7f8a700cdab0 2023-10-08T15:40:41.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.575+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a700b5140 con 0x7f8a700cdab0 2023-10-08T15:40:41.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.575+0000 7f8a577fe700 1 -- 172.21.15.29:0/4107510543 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f8a700b5140 con 0x7f8a700cdab0 2023-10-08T15:40:41.576 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:41.576 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:23.085169+0000","modified":"2023-10-08T15:40:26.715893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:40:41.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8a5c066f30 msgr2=0x7f8a5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8a5c066f30 0x7f8a5c0693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009d10 tx=0x7f8a600091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a700cdab0 msgr2=0x7f8a700b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a700cdab0 0x7f8a700b4420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400ec80 tx=0x7f8a640091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 shutdown_connections 2023-10-08T15:40:41.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8a5c066f30 0x7f8a5c0693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a7015dda0 0x7f8a700cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a700cd6e0 0x7f8a70156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 --2- 172.21.15.29:0/4107510543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a700cdab0 0x7f8a700b4420 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 >> 172.21.15.29:0/4107510543 conn(0x7f8a70067660 msgr2=0x7f8a700c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:41.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 shutdown_connections 2023-10-08T15:40:41.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.577+0000 7f8a74e78700 1 -- 172.21.15.29:0/4107510543 wait complete. 2023-10-08T15:40:41.579 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2023-10-08T15:40:41.590 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:41.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.708+0000 7fb4b152a700 1 Processor -- start 2023-10-08T15:40:41.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.708+0000 7fb4b152a700 1 -- start start 2023-10-08T15:40:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.709+0000 7fb4b152a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4ac0cbc00 0x7fb4ac0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.709+0000 7fb4b152a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac15de60 con 0x7fb4ac0b0e50 2023-10-08T15:40:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.709+0000 7fb4b152a700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac15e140 con 0x7fb4ac0b1220 2023-10-08T15:40:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.709+0000 7fb4b152a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac15e420 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.709+0000 7fb4ab7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb4ac0cbc00 0x7fb4ac0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.709+0000 7fb4aaffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb4ac0b0e50 0x7fb4ac06d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51038/0 (socket says 172.21.15.29:51038) 2023-10-08T15:40:41.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.709+0000 7fb4aaffd700 1 -- 172.21.15.29:0/3768548203 learned_addr learned my addr 172.21.15.29:0/3768548203 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4ab7fe700 1 -- 172.21.15.29:0/3768548203 >> v1:172.21.15.183:6789/0 conn(0x7fb4ac0b1220 legacy=0x7fb4ac0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4ab7fe700 1 -- 172.21.15.29:0/3768548203 >> v1:172.21.15.29:6789/0 conn(0x7fb4ac0b0e50 legacy=0x7fb4ac06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4ab7fe700 1 -- 172.21.15.29:0/3768548203 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac15e700 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4a9ffb700 1 -- 172.21.15.29:0/3768548203 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563211078 0 0) 0x7fb4ac15de60 con 0x7fb4ac0b0e50 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4ab7fe700 1 --2- 172.21.15.29:0/3768548203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c9180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009e60 tx=0x7fb49c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fbde7191a424a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4a9ffb700 1 -- 172.21.15.29:0/3768548203 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00e070 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4a9ffb700 1 -- 172.21.15.29:0/3768548203 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00bc30 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4a9ffb700 1 -- 172.21.15.29:0/3768548203 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c012430 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4b152a700 1 -- 172.21.15.29:0/3768548203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 msgr2=0x7fb4ac0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4b152a700 1 --2- 172.21.15.29:0/3768548203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c9180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009e60 tx=0x7fb49c009780 comp rx=0 tx=0).stop 2023-10-08T15:40:41.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4b152a700 1 -- 172.21.15.29:0/3768548203 shutdown_connections 2023-10-08T15:40:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4b152a700 1 --2- 172.21.15.29:0/3768548203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c9180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.710+0000 7fb4b152a700 1 -- 172.21.15.29:0/3768548203 >> 172.21.15.29:0/3768548203 conn(0x7fb4ac069870 msgr2=0x7fb4ac069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.711+0000 7fb4b152a700 1 -- 172.21.15.29:0/3768548203 shutdown_connections 2023-10-08T15:40:41.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.711+0000 7fb4b152a700 1 -- 172.21.15.29:0/3768548203 wait complete. 2023-10-08T15:40:41.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.712+0000 7fb4b152a700 1 Processor -- start 2023-10-08T15:40:41.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.712+0000 7fb4b152a700 1 -- start start 2023-10-08T15:40:41.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4b152a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac0b0e50 0x7fb4ac16a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4b152a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0b1220 0x7fb4ac0c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4b152a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4b152a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac16ac20 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4b152a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac14aef0 con 0x7fb4ac0b0e50 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4b152a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac15bdf0 con 0x7fb4ac0b1220 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37974/0 (socket says 172.21.15.29:37974) 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 -- 172.21.15.29:0/1243984166 learned_addr learned my addr 172.21.15.29:0/1243984166 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4aaffd700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac0b0e50 0x7fb4ac16a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4aa7fc700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0b1220 0x7fb4ac0c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 -- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0b1220 msgr2=0x7fb4ac0c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0b1220 0x7fb4ac0c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 -- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac0b0e50 msgr2=0x7fb4ac16a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac0b0e50 0x7fb4ac16a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 -- 172.21.15.29:0/1243984166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c009a20 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4ab7fe700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c8a30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0099f0 tx=0x7fb49c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4a2ffd700 1 -- 172.21.15.29:0/1243984166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0070a0 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4a2ffd700 1 -- 172.21.15.29:0/1243984166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c0263f0 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac15c0d0 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4a2ffd700 1 -- 172.21.15.29:0/1243984166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c026770 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.713+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac15c690 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.714+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac04c3c0 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.715+0000 7fb4a2ffd700 1 -- 172.21.15.29:0/1243984166 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb49c026b60 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.715+0000 7fb4a2ffd700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb48c066f30 0x7fb48c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.715+0000 7fb4a2ffd700 1 -- 172.21.15.29:0/1243984166 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb49c0860b0 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.716+0000 7fb4aaffd700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb48c066f30 0x7fb48c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:41.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.716+0000 7fb4aaffd700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb48c066f30 0x7fb48c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0c4520 tx=0x7fb4a4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:41.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.720+0000 7fb4a2ffd700 1 -- 172.21.15.29:0/1243984166 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb49c053320 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.913+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4ac068ba0 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.913+0000 7fb4a2ffd700 1 -- 172.21.15.29:0/1243984166 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb49c056940 con 0x7fb4ac0cbc00 2023-10-08T15:40:41.914 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:41.914 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:41.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.915+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb48c066f30 msgr2=0x7fb48c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.915+0000 7fb4b152a700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb48c066f30 0x7fb48c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0c4520 tx=0x7fb4a4007d30 comp rx=0 tx=0).stop 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.915+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 msgr2=0x7fb4ac0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.915+0000 7fb4b152a700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c8a30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0099f0 tx=0x7fb49c019000 comp rx=0 tx=0).stop 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.916+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 shutdown_connections 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.916+0000 7fb4b152a700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb48c066f30 0x7fb48c0693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.916+0000 7fb4b152a700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4ac0cbc00 0x7fb4ac0c8a30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.916+0000 7fb4b152a700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac0b0e50 0x7fb4ac16a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.916+0000 7fb4b152a700 1 --2- 172.21.15.29:0/1243984166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0b1220 0x7fb4ac0c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.916+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 >> 172.21.15.29:0/1243984166 conn(0x7fb4ac069870 msgr2=0x7fb4ac0c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.916+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 shutdown_connections 2023-10-08T15:40:41.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:41.916+0000 7fb4b152a700 1 -- 172.21.15.29:0/1243984166 wait complete. 2023-10-08T15:40:41.928 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.046+0000 7f8b506a9700 1 Processor -- start 2023-10-08T15:40:42.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.046+0000 7f8b506a9700 1 -- start start 2023-10-08T15:40:42.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.047+0000 7f8b506a9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b4815a620 0x7f8b4815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.047+0000 7f8b506a9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4815cbb0 con 0x7f8b4815d580 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.047+0000 7f8b506a9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4815bfa0 con 0x7f8b48157870 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.047+0000 7f8b506a9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4815bdb0 con 0x7f8b4815a620 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.047+0000 7f8b4dc44700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b4815a620 0x7f8b4815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.047+0000 7f8b4dc44700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b4815a620 0x7f8b4815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37980/0 (socket says 172.21.15.29:37980) 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.047+0000 7f8b4ec46700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8b4815d580 0x7f8b48158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51040/0 (socket says 172.21.15.29:51040) 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.047+0000 7f8b4dc44700 1 -- 172.21.15.29:0/3051476567 learned_addr learned my addr 172.21.15.29:0/3051476567 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b4dc44700 1 -- 172.21.15.29:0/3051476567 >> v1:172.21.15.183:6789/0 conn(0x7f8b48157870 legacy=0x7f8b4815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b4dc44700 1 -- 172.21.15.29:0/3051476567 >> v1:172.21.15.29:6789/0 conn(0x7f8b4815d580 legacy=0x7f8b48158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b4dc44700 1 -- 172.21.15.29:0/3051476567 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4815c280 con 0x7f8b4815a620 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b4d443700 1 -- 172.21.15.29:0/3051476567 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780533573 0 0) 0x7f8b4815cbb0 con 0x7f8b4815d580 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b4dc44700 1 --2- 172.21.15.29:0/3051476567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815a620 0x7f8b4815d040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0099b0 tx=0x7f8b3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18650c00c285ac9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b4d443700 1 -- 172.21.15.29:0/3051476567 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00b860 con 0x7f8b4815a620 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b4d443700 1 -- 172.21.15.29:0/3051476567 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c00b9c0 con 0x7f8b4815a620 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b4d443700 1 -- 172.21.15.29:0/3051476567 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c00bd60 con 0x7f8b4815a620 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b506a9700 1 -- 172.21.15.29:0/3051476567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815a620 msgr2=0x7f8b4815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.048+0000 7f8b506a9700 1 --2- 172.21.15.29:0/3051476567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815a620 0x7f8b4815d040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0099b0 tx=0x7f8b3c009250 comp rx=0 tx=0).stop 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.049+0000 7f8b506a9700 1 -- 172.21.15.29:0/3051476567 shutdown_connections 2023-10-08T15:40:42.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.049+0000 7f8b506a9700 1 --2- 172.21.15.29:0/3051476567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815a620 0x7f8b4815d040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.049+0000 7f8b506a9700 1 -- 172.21.15.29:0/3051476567 >> 172.21.15.29:0/3051476567 conn(0x7f8b48068ce0 msgr2=0x7f8b480690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:42.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.049+0000 7f8b506a9700 1 -- 172.21.15.29:0/3051476567 shutdown_connections 2023-10-08T15:40:42.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.049+0000 7f8b506a9700 1 -- 172.21.15.29:0/3051476567 wait complete. 2023-10-08T15:40:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.050+0000 7f8b506a9700 1 Processor -- start 2023-10-08T15:40:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.050+0000 7f8b506a9700 1 -- start start 2023-10-08T15:40:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.050+0000 7f8b506a9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b48157870 0x7f8b4814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.050+0000 7f8b506a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b4815a620 0x7f8b480cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b506a9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815d580 0x7f8b4816df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b506a9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4816ee30 con 0x7f8b4815d580 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b506a9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480cf9a0 con 0x7f8b48157870 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b506a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4816eb50 con 0x7f8b4815a620 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815d580 0x7f8b4816df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815d580 0x7f8b4816df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37982/0 (socket says 172.21.15.29:37982) 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 -- 172.21.15.29:0/1146297393 learned_addr learned my addr 172.21.15.29:0/1146297393 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4e445700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b48157870 0x7f8b4814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4dc44700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b4815a620 0x7f8b480cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 -- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b4815a620 msgr2=0x7f8b480cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b4815a620 0x7f8b480cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 -- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b48157870 msgr2=0x7f8b4814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b48157870 0x7f8b4814b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 -- 172.21.15.29:0/1146297393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c0094f0 con 0x7f8b4815d580 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4dc44700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b4815a620 0x7f8b480cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b4ec46700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815d580 0x7f8b4816df20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000ccf0 tx=0x7f8b400019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b467fc700 1 -- 172.21.15.29:0/1146297393 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40005df0 con 0x7f8b4815d580 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b467fc700 1 -- 172.21.15.29:0/1146297393 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000a710 con 0x7f8b4815d580 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b480cf350 con 0x7f8b4815d580 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b467fc700 1 -- 172.21.15.29:0/1146297393 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000aad0 con 0x7f8b4815d580 2023-10-08T15:40:42.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.051+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4814bae0 con 0x7f8b4815d580 2023-10-08T15:40:42.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.052+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b480cfb30 con 0x7f8b4815d580 2023-10-08T15:40:42.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.053+0000 7f8b467fc700 1 -- 172.21.15.29:0/1146297393 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b400070f0 con 0x7f8b4815d580 2023-10-08T15:40:42.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.053+0000 7f8b467fc700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.053+0000 7f8b467fc700 1 -- 172.21.15.29:0/1146297393 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b40084520 con 0x7f8b4815d580 2023-10-08T15:40:42.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.053+0000 7f8b4e445700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.054+0000 7f8b4e445700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b34066f30 0x7f8b340693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b38003a80 tx=0x7f8b38007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.058+0000 7f8b467fc700 1 -- 172.21.15.29:0/1146297393 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b40051810 con 0x7f8b4815d580 2023-10-08T15:40:42.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.292+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b4804c3c0 con 0x7f8b4815d580 2023-10-08T15:40:42.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.293+0000 7f8b467fc700 1 -- 172.21.15.29:0/1146297393 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f8b40082e60 con 0x7f8b4815d580 2023-10-08T15:40:42.293 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:42.294 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:23.085169+0000","modified":"2023-10-08T15:40:26.715893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:40:42.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b34066f30 msgr2=0x7f8b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b34066f30 0x7f8b340693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b38003a80 tx=0x7f8b38007ec0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815d580 msgr2=0x7f8b4816df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815d580 0x7f8b4816df20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000ccf0 tx=0x7f8b400019f0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 shutdown_connections 2023-10-08T15:40:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b34066f30 0x7f8b340693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b4815d580 0x7f8b4816df20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b48157870 0x7f8b4814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 --2- 172.21.15.29:0/1146297393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b4815a620 0x7f8b480cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 >> 172.21.15.29:0/1146297393 conn(0x7f8b48068ce0 msgr2=0x7f8b4814c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:42.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 shutdown_connections 2023-10-08T15:40:42.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.295+0000 7f8b506a9700 1 -- 172.21.15.29:0/1146297393 wait complete. 2023-10-08T15:40:42.298 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2023-10-08T15:40:42.709 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T15:40:23.085169+0000', 'modified': '2023-10-08T15:40:26.715893+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6837/1226540974', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6835', 'nonce': 1226540974}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1226540974}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T15:40:42.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T15:40:42.710 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T15:40:42.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.834+0000 7f1314128700 1 Processor -- start 2023-10-08T15:40:42.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.834+0000 7f1314128700 1 -- start start 2023-10-08T15:40:42.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1314128700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15a620 0x7f130c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1314128700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f130c15d580 0x7f130c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1314128700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c15cbb0 con 0x7f130c157870 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1314128700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c15bdb0 con 0x7f130c15d580 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1314128700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c15bfa0 con 0x7f130c15a620 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1311ec4700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f130c157870 0x7f130c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51048/0 (socket says 172.21.15.29:51048) 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f13126c5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f130c15d580 0x7f130c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1311ec4700 1 -- 172.21.15.29:0/1491069623 learned_addr learned my addr 172.21.15.29:0/1491069623 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1310ec2700 1 -- 172.21.15.29:0/1491069623 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928537139 0 0) 0x7f130c15cbb0 con 0x7f130c157870 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1310ec2700 1 -- 172.21.15.29:0/1491069623 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f8003570 con 0x7f130c157870 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f13116c3700 1 --2- 172.21.15.29:0/1491069623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15a620 0x7f130c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f13126c5700 1 -- 172.21.15.29:0/1491069623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15a620 msgr2=0x7f130c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f13126c5700 1 --2- 172.21.15.29:0/1491069623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15a620 0x7f130c15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f13126c5700 1 -- 172.21.15.29:0/1491069623 >> v1:172.21.15.29:6789/0 conn(0x7f130c157870 legacy=0x7f130c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f13126c5700 1 -- 172.21.15.29:0/1491069623 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c15c280 con 0x7f130c15d580 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f13126c5700 1 --2- 172.21.15.29:0/1491069623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15d580 0x7f130c158110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f13040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafae69070866ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1310ec2700 1 -- 172.21.15.29:0/1491069623 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400b640 con 0x7f130c15d580 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1310ec2700 1 -- 172.21.15.29:0/1491069623 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130400b7a0 con 0x7f130c15d580 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.835+0000 7f1310ec2700 1 -- 172.21.15.29:0/1491069623 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400bb20 con 0x7f130c15d580 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.836+0000 7f1314128700 1 -- 172.21.15.29:0/1491069623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15d580 msgr2=0x7f130c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.836+0000 7f1314128700 1 --2- 172.21.15.29:0/1491069623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15d580 0x7f130c158110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f13040091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.836+0000 7f1314128700 1 -- 172.21.15.29:0/1491069623 shutdown_connections 2023-10-08T15:40:42.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.836+0000 7f1314128700 1 --2- 172.21.15.29:0/1491069623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15d580 0x7f130c158110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.836+0000 7f1314128700 1 --2- 172.21.15.29:0/1491069623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15a620 0x7f130c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.836+0000 7f1314128700 1 -- 172.21.15.29:0/1491069623 >> 172.21.15.29:0/1491069623 conn(0x7f130c068ce0 msgr2=0x7f130c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:42.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.836+0000 7f1314128700 1 -- 172.21.15.29:0/1491069623 shutdown_connections 2023-10-08T15:40:42.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.836+0000 7f1314128700 1 -- 172.21.15.29:0/1491069623 wait complete. 2023-10-08T15:40:42.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.837+0000 7f1314128700 1 Processor -- start 2023-10-08T15:40:42.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.837+0000 7f1314128700 1 -- start start 2023-10-08T15:40:42.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f1314128700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f130c157870 0x7f130c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f1314128700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15a620 0x7f130c15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f1314128700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15d580 0x7f130c15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f1314128700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c154700 con 0x7f130c15a620 2023-10-08T15:40:42.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f1314128700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c153ac0 con 0x7f130c157870 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f1314128700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c153d60 con 0x7f130c15d580 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13116c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15a620 0x7f130c15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13116c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15a620 0x7f130c15e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38010/0 (socket says 172.21.15.29:38010) 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13116c3700 1 -- 172.21.15.29:0/3367387282 learned_addr learned my addr 172.21.15.29:0/3367387282 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f1311ec4700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f130c157870 0x7f130c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13126c5700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15d580 0x7f130c15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13116c3700 1 -- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15d580 msgr2=0x7f130c15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13116c3700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15d580 0x7f130c15ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13116c3700 1 -- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f130c157870 msgr2=0x7f130c155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13116c3700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f130c157870 0x7f130c155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.838+0000 7f13116c3700 1 -- 172.21.15.29:0/3367387282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009420 con 0x7f130c15a620 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.839+0000 7f13116c3700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15a620 0x7f130c15e590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c880 tx=0x7f12fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.839+0000 7f1301ffb700 1 -- 172.21.15.29:0/3367387282 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc011600 con 0x7f130c15a620 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.839+0000 7f1301ffb700 1 -- 172.21.15.29:0/3367387282 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc011780 con 0x7f130c15a620 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.839+0000 7f1314128700 1 -- 172.21.15.29:0/3367387282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c154040 con 0x7f130c15a620 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.839+0000 7f1301ffb700 1 -- 172.21.15.29:0/3367387282 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc011b40 con 0x7f130c15a620 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.839+0000 7f1314128700 1 -- 172.21.15.29:0/3367387282 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c0b06c0 con 0x7f130c15a620 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.840+0000 7f1301ffb700 1 -- 172.21.15.29:0/3367387282 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12fc010350 con 0x7f130c15a620 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.841+0000 7f1301ffb700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.841+0000 7f1301ffb700 1 -- 172.21.15.29:0/3367387282 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12fc084330 con 0x7f130c15a620 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.841+0000 7f1311ec4700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.841+0000 7f1311ec4700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f12f0066f30 0x7f12f00693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1308005c50 tx=0x7f1308009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.842+0000 7f131d420b80 1 Processor -- start 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f131d420b80 1 -- start start 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f131d420b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6ad0a50 0x5587b6ad0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f131d420b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6af9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f131d420b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6af9f60 0x5587b6acccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f131d420b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b6a27a70 con 0x5587b6b1ad00 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f131d420b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b6a25270 con 0x5587b6af9f60 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f131d420b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587b6a21060 con 0x5587b6ad0a50 2023-10-08T15:40:42.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f13116c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6af9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f13116c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6af9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38022/0 (socket says 172.21.15.29:38022) 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f13116c3700 1 -- 172.21.15.29:0/1240924636 learned_addr learned my addr 172.21.15.29:0/1240924636 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f1311ec4700 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6ad0a50 0x5587b6ad0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.843+0000 7f13126c5700 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6af9f60 0x5587b6acccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f13116c3700 1 -- 172.21.15.29:0/1240924636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6ad0a50 msgr2=0x5587b6ad0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f13116c3700 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6ad0a50 0x5587b6ad0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f13116c3700 1 -- 172.21.15.29:0/1240924636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6af9f60 msgr2=0x5587b6acccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f13116c3700 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6af9f60 0x5587b6acccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f13116c3700 1 -- 172.21.15.29:0/1240924636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b68bb270 con 0x5587b6b1ad00 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f13116c3700 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6af9a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f12fc082820 tx=0x7f12fc0827b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5a8885da0bdfc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f12f6ffd700 1 -- 172.21.15.29:0/1240924636 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc055260 con 0x5587b6b1ad00 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f12f6ffd700 1 -- 172.21.15.29:0/1240924636 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0584b0 con 0x5587b6b1ad00 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f12f6ffd700 1 -- 172.21.15.29:0/1240924636 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc05c200 con 0x5587b6b1ad00 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f131d420b80 1 -- 172.21.15.29:0/1240924636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 msgr2=0x5587b6af9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f131d420b80 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6af9a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f12fc082820 tx=0x7f12fc0827b0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f131d420b80 1 -- 172.21.15.29:0/1240924636 shutdown_connections 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f131d420b80 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6af9f60 0x5587b6acccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f131d420b80 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6ad0a50 0x5587b6ad0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f131d420b80 1 --2- 172.21.15.29:0/1240924636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6af9a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.844+0000 7f131d420b80 1 -- 172.21.15.29:0/1240924636 >> 172.21.15.29:0/1240924636 conn(0x5587b6ad2370 msgr2=0x5587b6ad2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.845+0000 7f131d420b80 1 -- 172.21.15.29:0/1240924636 shutdown_connections 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.845+0000 7f131d420b80 1 -- 172.21.15.29:0/1240924636 wait complete. 2023-10-08T15:40:42.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.845+0000 7f131d420b80 1 -- start start 2023-10-08T15:40:42.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.845+0000 7f131d420b80 1 Processor -- start 2023-10-08T15:40:42.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f131d420b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 0x5587b6b121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f131d420b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 0x5587b6af64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f131d420b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6b008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f131d420b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b69cc890 con 0x5587b6b1ad00 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f131d420b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b69e7ea0 con 0x5587b6ad0a50 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f131d420b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587b68a3e30 con 0x5587b6af9f60 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f131d420b80 10 client.0 _ll_register_callbacks cb 0x5587b6a94110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f13126c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6b008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f13126c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6b008c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38038/0 (socket says 172.21.15.29:38038) 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f13126c5700 1 -- 172.21.15.29:0/1822099315 learned_addr learned my addr 172.21.15.29:0/1822099315 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f13116c3700 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 0x5587b6af64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f1311ec4700 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 0x5587b6b121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.846+0000 7f13126c5700 1 -- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 msgr2=0x5587b6af64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f13126c5700 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 0x5587b6af64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f13126c5700 1 -- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 msgr2=0x5587b6b121d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f13126c5700 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 0x5587b6b121d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f13126c5700 1 -- 172.21.15.29:0/1822099315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c0b06c0 con 0x5587b6b1ad00 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f13126c5700 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6b008c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f130c06b530 tx=0x7f1304017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedf4b25d003f225 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f12ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f12ebfff700 1 -- 172.21.15.29:0/1822099315 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304020070 con 0x5587b6b1ad00 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f12ebfff700 1 -- 172.21.15.29:0/1822099315 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f130401a700 con 0x5587b6b1ad00 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 1 -- 172.21.15.29:0/1822099315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587b6ac5b70 con 0x5587b6b1ad00 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f12ebfff700 1 -- 172.21.15.29:0/1822099315 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f130401aad0 con 0x5587b6b1ad00 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 10 client.4662 fetch_fsmap learned FSMap version 8 2023-10-08T15:40:42.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 1 -- 172.21.15.29:0/1822099315 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5587b685dfe0 con 0x5587b6b1ad00 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f12ebfff700 1 -- 172.21.15.29:0/1822099315 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5587b6ac5b70 con 0x5587b6b1ad00 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f12ebfff700 1 -- 172.21.15.29:0/1822099315 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f130401ac30 con 0x5587b6b1ad00 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 10 client.4662 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 20 client.4662 populate_metadata read hostname 'smithi029' 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] conn(0x5587b6b19fa0 0x5587b6b1a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 4 client.4662 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.847+0000 7f131d420b80 1 -- 172.21.15.29:0/1822099315 --> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5587b6aa2aa0 con 0x5587b6b19fa0 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.848+0000 7f1311ec4700 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] conn(0x5587b6b19fa0 0x5587b6b1a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.848+0000 7f12ebfff700 10 client.4662 ms_handle_connect on v2:172.21.15.183:6835/1226540974 2023-10-08T15:40:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.848+0000 7f1311ec4700 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] conn(0x5587b6b19fa0 0x5587b6b1a370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a669fa6c58e86a server_cookie=40836fdbe83cf0b8 in_seq=0 out_seq=0 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f12ebfff700 1 -- 172.21.15.29:0/1822099315 <== mds.0 v2:172.21.15.183:6835/1226540974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5587b6aa2aa0 con 0x5587b6b19fa0 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f12ebfff700 10 client.4662 handle_command_reply: tid=0 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 client.4662 shutdown 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 -- 172.21.15.29:0/1822099315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 msgr2=0x5587b6b008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6b008c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f130c06b530 tx=0x7f1304017000 comp rx=0 tx=0).stop 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 -- 172.21.15.29:0/1822099315 shutdown_connections 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] conn(0x5587b6b19fa0 0x5587b6b1a370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6b1ad00 0x5587b6b008c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 0x5587b6b121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f12ebfff700 0 client.4662 ms_handle_reset on v2:172.21.15.183:6835/1226540974 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 --2- 172.21.15.29:0/1822099315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 0x5587b6af64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 -- 172.21.15.29:0/1822099315 >> 172.21.15.29:0/1822099315 conn(0x5587b6ad2370 msgr2=0x5587b6b16550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:42.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 -- 172.21.15.29:0/1822099315 shutdown_connections 2023-10-08T15:40:42.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 1 -- 172.21.15.29:0/1822099315 wait complete. 2023-10-08T15:40:42.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.849+0000 7f131d420b80 20 client.4662 trim_cache size 0 max 16384 2023-10-08T15:40:42.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.866+0000 7f131d420b80 1 Processor -- start 2023-10-08T15:40:42.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.866+0000 7f131d420b80 1 -- start start 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f131d420b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6ad0a50 0x5587b6b26270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f131d420b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 0x5587b6b00530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f131d420b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6b1ad00 0x5587b6b251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f131d420b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b6b16370 con 0x5587b6ad0a50 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f131d420b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b6ad17e0 con 0x5587b6b1ad00 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f131d420b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587b6acdea0 con 0x5587b6af9f60 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6ad0a50 0x5587b6b26270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6ad0a50 0x5587b6b26270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38050/0 (socket says 172.21.15.29:38050) 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 -- 172.21.15.29:0/3013885567 learned_addr learned my addr 172.21.15.29:0/3013885567 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f13126c5700 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6b1ad00 0x5587b6b251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f13116c3700 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 0x5587b6b00530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 -- 172.21.15.29:0/3013885567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 msgr2=0x5587b6b00530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 0x5587b6b00530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 -- 172.21.15.29:0/3013885567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6b1ad00 msgr2=0x5587b6b251c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6b1ad00 0x5587b6b251c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 -- 172.21.15.29:0/3013885567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b6ace8b0 con 0x5587b6ad0a50 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f1311ec4700 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6ad0a50 0x5587b6b26270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f130800e880 tx=0x7f1308013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba163e202c3b62f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f12f77fe700 1 -- 172.21.15.29:0/3013885567 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080142c0 con 0x5587b6ad0a50 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f12f77fe700 1 -- 172.21.15.29:0/3013885567 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308015d00 con 0x5587b6ad0a50 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.867+0000 7f12f77fe700 1 -- 172.21.15.29:0/3013885567 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308004dc0 con 0x5587b6ad0a50 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 -- 172.21.15.29:0/3013885567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6ad0a50 msgr2=0x5587b6b26270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6ad0a50 0x5587b6b26270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f130800e880 tx=0x7f1308013000 comp rx=0 tx=0).stop 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 -- 172.21.15.29:0/3013885567 shutdown_connections 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6b1ad00 0x5587b6b251c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6ad0a50 0x5587b6b26270 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 --2- 172.21.15.29:0/3013885567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6af9f60 0x5587b6b00530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 -- 172.21.15.29:0/3013885567 >> 172.21.15.29:0/3013885567 conn(0x5587b6ad2370 msgr2=0x5587b6acec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 -- 172.21.15.29:0/3013885567 shutdown_connections 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 -- 172.21.15.29:0/3013885567 wait complete. 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 -- start start 2023-10-08T15:40:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.868+0000 7f131d420b80 1 Processor -- start 2023-10-08T15:40:42.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f131d420b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 0x5587b6b29a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f131d420b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6af9f60 0x5587b6b00910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f131d420b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6b1ad00 0x5587b6b74890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f131d420b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b6b7fd60 con 0x5587b6af9f60 2023-10-08T15:40:42.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f131d420b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b6b7d980 con 0x5587b6ad0a50 2023-10-08T15:40:42.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f131d420b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587b6b00e50 con 0x5587b6b1ad00 2023-10-08T15:40:42.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f131d420b80 10 client.0 _ll_register_callbacks cb 0x5587b6a94110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f13116c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6af9f60 0x5587b6b00910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f13116c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6af9f60 0x5587b6b00910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38066/0 (socket says 172.21.15.29:38066) 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f13116c3700 1 -- 172.21.15.29:0/2911863673 learned_addr learned my addr 172.21.15.29:0/2911863673 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f13126c5700 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6b1ad00 0x5587b6b74890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.869+0000 7f1311ec4700 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 0x5587b6b29a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f13116c3700 1 -- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6b1ad00 msgr2=0x5587b6b74890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f13116c3700 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6b1ad00 0x5587b6b74890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f13116c3700 1 -- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 msgr2=0x5587b6b29a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f13116c3700 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 0x5587b6b29a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f13116c3700 1 -- 172.21.15.29:0/2911863673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130800f040 con 0x5587b6af9f60 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f13116c3700 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6af9f60 0x5587b6b00910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c850 tx=0x7f12fc06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dc75dc360d5526 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:42.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f12ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f12ebfff700 1 -- 172.21.15.29:0/2911863673 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc082070 con 0x5587b6af9f60 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f12ebfff700 1 -- 172.21.15.29:0/2911863673 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12fc060020 con 0x5587b6af9f60 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 1 -- 172.21.15.29:0/2911863673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12fc0584b0 con 0x5587b6af9f60 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f12ebfff700 1 -- 172.21.15.29:0/2911863673 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12fc05c200 con 0x5587b6af9f60 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 10 client.4668 fetch_fsmap learned FSMap version 8 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 1 -- 172.21.15.29:0/2911863673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5587b69ef780 con 0x5587b6af9f60 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f12ebfff700 1 -- 172.21.15.29:0/2911863673 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc073070 con 0x5587b6af9f60 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f12ebfff700 1 -- 172.21.15.29:0/2911863673 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f12fc054750 con 0x5587b6af9f60 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 10 client.4668 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 20 client.4668 populate_metadata read hostname 'smithi029' 2023-10-08T15:40:42.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] conn(0x5587b6af4910 0x5587b6af4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 4 client.4668 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.870+0000 7f131d420b80 1 -- 172.21.15.29:0/2911863673 --> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5587b69c3e00 con 0x5587b6af4910 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f1311ec4700 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] conn(0x5587b6af4910 0x5587b6af4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f12ebfff700 10 client.4668 ms_handle_connect on v2:172.21.15.183:6835/1226540974 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f1311ec4700 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] conn(0x5587b6af4910 0x5587b6af4ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ade57632afd2c1a9 server_cookie=f6a84ba86b60e75a in_seq=0 out_seq=0 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f12ebfff700 1 -- 172.21.15.29:0/2911863673 <== mds.0 v2:172.21.15.183:6835/1226540974 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x5587b69c3e00 con 0x5587b6af4910 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f12ebfff700 10 client.4668 handle_command_reply: tid=0 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 client.4668 shutdown 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 -- 172.21.15.29:0/2911863673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6af9f60 msgr2=0x5587b6b00910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6af9f60 0x5587b6b00910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c850 tx=0x7f12fc06f000 comp rx=0 tx=0).stop 2023-10-08T15:40:42.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 -- 172.21.15.29:0/2911863673 shutdown_connections 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:6835/1226540974,v1:172.21.15.183:6837/1226540974] conn(0x5587b6af4910 0x5587b6af4ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5587b6b1ad00 0x5587b6b74890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5587b6ad0a50 0x5587b6b29a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f12ebfff700 0 client.4668 ms_handle_reset on v2:172.21.15.183:6835/1226540974 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 --2- 172.21.15.29:0/2911863673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5587b6af9f60 0x5587b6b00910 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 -- 172.21.15.29:0/2911863673 >> 172.21.15.29:0/2911863673 conn(0x5587b6ad2370 msgr2=0x5587b6ad4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 -- 172.21.15.29:0/2911863673 shutdown_connections 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.871+0000 7f131d420b80 1 -- 172.21.15.29:0/2911863673 wait complete. 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f131d420b80 20 client.4668 trim_cache size 0 max 16384 2023-10-08T15:40:42.879 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4273, 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 19.183871228000001, 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 8, 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 20, 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 20, 2023-10-08T15:40:42.880 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 25.19204577 2023-10-08T15:40:42.881 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:40:42.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 -- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f12f0066f30 msgr2=0x7f12f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f12f0066f30 0x7f12f00693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1308005c50 tx=0x7f1308009040 comp rx=0 tx=0).stop 2023-10-08T15:40:42.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 -- 172.21.15.29:0/3367387282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15a620 msgr2=0x7f130c15e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15a620 0x7f130c15e590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c880 tx=0x7f12fc008040 comp rx=0 tx=0).stop 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 -- 172.21.15.29:0/3367387282 shutdown_connections 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f130c15d580 0x7f130c15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f130c157870 0x7f130c155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 --2- 172.21.15.29:0/3367387282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c15a620 0x7f130c15e590 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 -- 172.21.15.29:0/3367387282 >> 172.21.15.29:0/3367387282 conn(0x7f130c068ce0 msgr2=0x7f130c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 -- 172.21.15.29:0/3367387282 shutdown_connections 2023-10-08T15:40:42.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:42.872+0000 7f1314128700 1 -- 172.21.15.29:0/3367387282 wait complete. 2023-10-08T15:40:42.884 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T15:40:42.906 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T15:40:42.906 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-08T15:40:42.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:42.906 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T15:40:42.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:42.921 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-08T15:40:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2023-10-08T15:40:42.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:40:42.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:42.990 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T15:40:43.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.044 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-08T15:40:43.110 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2023-10-08T15:40:43.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:40:43.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.111 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-10-08T15:40:43.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.129 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-10-08T15:40:43.200 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2023-10-08T15:40:43.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:40:43.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.201 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-10-08T15:40:43.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.257 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-10-08T15:40:43.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:40:43.326 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2023-10-08T15:40:43.326 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-08T15:40:43.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:40:43.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.445+0000 7f5f40dd7700 1 Processor -- start 2023-10-08T15:40:43.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.445+0000 7f5f40dd7700 1 -- start start 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.446+0000 7f5f40dd7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f3c15a620 0x7f5f3c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.446+0000 7f5f40dd7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c15cbb0 con 0x7f5f3c15d580 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.446+0000 7f5f40dd7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c15bfa0 con 0x7f5f3c157870 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.446+0000 7f5f40dd7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c15bdb0 con 0x7f5f3c15a620 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f39d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f3c15a620 0x7f5f3c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f3ad9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5f3c15d580 0x7f5f3c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51062/0 (socket says 172.21.15.29:51062) 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f3ad9d700 1 -- 172.21.15.29:0/3183488536 learned_addr learned my addr 172.21.15.29:0/3183488536 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f39d9b700 1 -- 172.21.15.29:0/3183488536 >> v1:172.21.15.183:6789/0 conn(0x7f5f3c157870 legacy=0x7f5f3c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f39d9b700 1 -- 172.21.15.29:0/3183488536 >> v1:172.21.15.29:6789/0 conn(0x7f5f3c15d580 legacy=0x7f5f3c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f3959a700 1 -- 172.21.15.29:0/3183488536 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627364507 0 0) 0x7f5f3c15cbb0 con 0x7f5f3c15d580 2023-10-08T15:40:43.448 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f39d9b700 1 -- 172.21.15.29:0/3183488536 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c15c280 con 0x7f5f3c15a620 2023-10-08T15:40:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f39d9b700 1 --2- 172.21.15.29:0/3183488536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c15d040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5f240098e0 tx=0x7f5f240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484b5909f4592ba5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f3959a700 1 -- 172.21.15.29:0/3183488536 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24009e80 con 0x7f5f3c15a620 2023-10-08T15:40:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f3959a700 1 -- 172.21.15.29:0/3183488536 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2400b860 con 0x7f5f3c15a620 2023-10-08T15:40:43.449 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.447+0000 7f5f3959a700 1 -- 172.21.15.29:0/3183488536 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400bbe0 con 0x7f5f3c15a620 2023-10-08T15:40:43.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.448+0000 7f5f40dd7700 1 -- 172.21.15.29:0/3183488536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 msgr2=0x7f5f3c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.448+0000 7f5f40dd7700 1 --2- 172.21.15.29:0/3183488536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c15d040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5f240098e0 tx=0x7f5f240091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.448+0000 7f5f40dd7700 1 -- 172.21.15.29:0/3183488536 shutdown_connections 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.448+0000 7f5f40dd7700 1 --2- 172.21.15.29:0/3183488536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c15d040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.448+0000 7f5f40dd7700 1 -- 172.21.15.29:0/3183488536 >> 172.21.15.29:0/3183488536 conn(0x7f5f3c068ce0 msgr2=0x7f5f3c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.448+0000 7f5f40dd7700 1 -- 172.21.15.29:0/3183488536 shutdown_connections 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.448+0000 7f5f40dd7700 1 -- 172.21.15.29:0/3183488536 wait complete. 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.449+0000 7f5f40dd7700 1 Processor -- start 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.449+0000 7f5f40dd7700 1 -- start start 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f40dd7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f3c157870 0x7f5f3c16b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f40dd7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c13d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:43.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f40dd7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3c15d580 0x7f5f3c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f40dd7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c16b6e0 con 0x7f5f3c15a620 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f40dd7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c13dd10 con 0x7f5f3c15d580 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f40dd7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c152f30 con 0x7f5f3c157870 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c13d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c13d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38082/0 (socket says 172.21.15.29:38082) 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 -- 172.21.15.29:0/1940535076 learned_addr learned my addr 172.21.15.29:0/1940535076 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f3a59c700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f3c157870 0x7f5f3c16b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f3ad9d700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3c15d580 0x7f5f3c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 -- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f3c157870 msgr2=0x7f5f3c16b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f3c157870 0x7f5f3c16b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 -- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3c15d580 msgr2=0x7f5f3c1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:43.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3c15d580 0x7f5f3c1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:43.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 -- 172.21.15.29:0/1940535076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009420 con 0x7f5f3c15a620 2023-10-08T15:40:43.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f39d9b700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c13d7d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c06b530 tx=0x7f5f24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:43.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f327fc700 1 -- 172.21.15.29:0/1940535076 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2401f070 con 0x7f5f3c15a620 2023-10-08T15:40:43.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f327fc700 1 -- 172.21.15.29:0/1940535076 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f24000c90 con 0x7f5f3c15a620 2023-10-08T15:40:43.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c1531d0 con 0x7f5f3c15a620 2023-10-08T15:40:43.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f327fc700 1 -- 172.21.15.29:0/1940535076 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24025420 con 0x7f5f3c15a620 2023-10-08T15:40:43.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.450+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c153810 con 0x7f5f3c15a620 2023-10-08T15:40:43.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.451+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c153ad0 con 0x7f5f3c15a620 2023-10-08T15:40:43.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.452+0000 7f5f327fc700 1 -- 172.21.15.29:0/1940535076 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f24023070 con 0x7f5f3c15a620 2023-10-08T15:40:43.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.452+0000 7f5f327fc700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5f1c066f30 0x7f5f1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:43.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.452+0000 7f5f327fc700 1 -- 172.21.15.29:0/1940535076 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f24085990 con 0x7f5f3c15a620 2023-10-08T15:40:43.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.452+0000 7f5f3a59c700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5f1c066f30 0x7f5f1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:43.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.453+0000 7f5f3a59c700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5f1c066f30 0x7f5f1c0693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0d1060 tx=0x7f5f34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:43.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.456+0000 7f5f327fc700 1 -- 172.21.15.29:0/1940535076 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f24052c00 con 0x7f5f3c15a620 2023-10-08T15:40:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.695+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f3c04c3c0 con 0x7f5f3c15a620 2023-10-08T15:40:43.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.696+0000 7f5f327fc700 1 -- 172.21.15.29:0/1940535076 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5f24056220 con 0x7f5f3c15a620 2023-10-08T15:40:43.696 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:40:43.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5f1c066f30 msgr2=0x7f5f1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5f1c066f30 0x7f5f1c0693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0d1060 tx=0x7f5f34009040 comp rx=0 tx=0).stop 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 msgr2=0x7f5f3c13d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c13d7d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c06b530 tx=0x7f5f24017000 comp rx=0 tx=0).stop 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 shutdown_connections 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5f1c066f30 0x7f5f1c0693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3c15d580 0x7f5f3c1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f3c157870 0x7f5f3c16b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 --2- 172.21.15.29:0/1940535076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f3c15a620 0x7f5f3c13d7d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 >> 172.21.15.29:0/1940535076 conn(0x7f5f3c068ce0 msgr2=0x7f5f3c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 shutdown_connections 2023-10-08T15:40:43.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:43.698+0000 7f5f40dd7700 1 -- 172.21.15.29:0/1940535076 wait complete. 2023-10-08T15:40:43.710 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:40:43.710 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:40:43.710 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-08T15:40:43.710 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T15:40:43.710 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:43.711 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:40:43.711 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:40:43.711 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:40:43.711 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:40:43.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.711 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-08T15:40:43.726 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:43.726 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:43.726 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:43.726 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42467sec preferred_lft 42467sec 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-08T15:40:43.727 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:43.728 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:43.728 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:43.728 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2023-10-08T15:40:43.728 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:43.728 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:43.728 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2023-10-08T15:40:43.728 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T15:40:43.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.729 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:43.729 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:43.729 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2023-10-08T15:40:43.729 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2023-10-08T15:40:43.729 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2023-10-08T15:40:43.729 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T15:40:43.729 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:43.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.902 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:40:43.929 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-08T15:40:43.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:43.930 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-08T15:40:44.058 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-08T15:40:44.058 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:40:44.058 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T15:40:44.058 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T15:40:44.058 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:40:44.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:44.059 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:44.059 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:44.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T15:40:44.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T15:40:44.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T15:40:44.059 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:44.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:44.296 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T15:40:44.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:44.311 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-10-08T15:40:44.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:44.366 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:44.366 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:44.366 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:40:44.367 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T15:40:44.367 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:44.457 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T15:40:44.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:44.457 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:44.457 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:44.457 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T15:40:44.457 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T15:40:44.458 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T15:40:44.458 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T15:40:44.458 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T15:40:44.458 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:44.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:44.649 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:44.649 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:44.649 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-08T15:40:44.650 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T15:40:44.650 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:44.743 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:44.743 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:44.758 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:40:44.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:44.759 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:44.814 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T15:40:44.814 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:40:44.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:44.906 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:44.906 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:45.001 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:45.001 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:45.001 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:40:45.001 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:40:45.002 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:40:45.002 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:40:45.002 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:40:45.002 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:40:45.023 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:45.023 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-10-08T15:40:45.024 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=aa16b01f-3858-4fc7-9751-d7cb76fff138" will pass to kernel 2023-10-08T15:40:45.026 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T15:40:45.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.026 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:40:45.052 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-08T15:40:45.052 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:40:45.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.210+0000 7f401ed91700 1 Processor -- start 2023-10-08T15:40:45.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.210+0000 7f401ed91700 1 -- start start 2023-10-08T15:40:45.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.210+0000 7f401ed91700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f401815a620 0x7f401815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:45.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.210+0000 7f401ed91700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401815cbb0 con 0x7f401815d580 2023-10-08T15:40:45.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.210+0000 7f401ed91700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401815bfa0 con 0x7f4018157870 2023-10-08T15:40:45.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f401ed91700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401815bdb0 con 0x7f401815a620 2023-10-08T15:40:45.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f401d32e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f401815d580 0x7f4018158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51066/0 (socket says 172.21.15.29:51066) 2023-10-08T15:40:45.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f401d32e700 1 -- 172.21.15.29:0/3299051079 learned_addr learned my addr 172.21.15.29:0/3299051079 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:45.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f4017fff700 1 --2- 172.21.15.29:0/3299051079 >> v2:172.21.15.183:3300/0 conn(0x7f401815a620 0x7f401815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f40177fe700 1 -- 172.21.15.29:0/3299051079 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402288465 0 0) 0x7f401815cbb0 con 0x7f401815d580 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f40177fe700 1 -- 172.21.15.29:0/3299051079 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4004003570 con 0x7f401815d580 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f4017fff700 1 -- 172.21.15.29:0/3299051079 >> v1:172.21.15.183:6789/0 conn(0x7f4018157870 legacy=0x7f401815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f40177fe700 1 -- 172.21.15.29:0/3299051079 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647577596 0 0) 0x7f401815bfa0 con 0x7f4018157870 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f4017fff700 1 -- 172.21.15.29:0/3299051079 >> v1:172.21.15.29:6789/0 conn(0x7f401815d580 legacy=0x7f4018158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f4017fff700 1 -- 172.21.15.29:0/3299051079 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401815c280 con 0x7f401815a620 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.211+0000 7f4017fff700 1 --2- 172.21.15.29:0/3299051079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f401815a620 0x7f401815d040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f40080098e0 tx=0x7f40080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61b65e2310e4cb97 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f40177fe700 1 -- 172.21.15.29:0/3299051079 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800b640 con 0x7f401815a620 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f40177fe700 1 -- 172.21.15.29:0/3299051079 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400800b7a0 con 0x7f401815a620 2023-10-08T15:40:45.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f40177fe700 1 -- 172.21.15.29:0/3299051079 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800bb40 con 0x7f401815a620 2023-10-08T15:40:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f401ed91700 1 -- 172.21.15.29:0/3299051079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f401815a620 msgr2=0x7f401815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f401ed91700 1 --2- 172.21.15.29:0/3299051079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f401815a620 0x7f401815d040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f40080098e0 tx=0x7f40080091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f401ed91700 1 -- 172.21.15.29:0/3299051079 shutdown_connections 2023-10-08T15:40:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f401ed91700 1 --2- 172.21.15.29:0/3299051079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f401815a620 0x7f401815d040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f401ed91700 1 -- 172.21.15.29:0/3299051079 >> 172.21.15.29:0/3299051079 conn(0x7f4018068ce0 msgr2=0x7f40180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f401ed91700 1 -- 172.21.15.29:0/3299051079 shutdown_connections 2023-10-08T15:40:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.212+0000 7f401ed91700 1 -- 172.21.15.29:0/3299051079 wait complete. 2023-10-08T15:40:45.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.213+0000 7f401ed91700 1 Processor -- start 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.214+0000 7f401ed91700 1 -- start start 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.214+0000 7f401ed91700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4018157870 0x7f40180b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.214+0000 7f401ed91700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f401815a620 0x7f401814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.214+0000 7f401ed91700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f401815d580 0x7f40180d0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.214+0000 7f401ed91700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40180b22c0 con 0x7f401815d580 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.214+0000 7f401ed91700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401814e370 con 0x7f4018157870 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.214+0000 7f401ed91700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40180b16b0 con 0x7f401815a620 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f401815d580 0x7f40180d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f401815d580 0x7f40180d0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38098/0 (socket says 172.21.15.29:38098) 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 -- 172.21.15.29:0/2832543734 learned_addr learned my addr 172.21.15.29:0/2832543734 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401cb2d700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4018157870 0x7f40180b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:45.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f4017fff700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f401815a620 0x7f401814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 -- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f401815a620 msgr2=0x7f401814de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f401815a620 0x7f401814de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 -- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4018157870 msgr2=0x7f40180b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4018157870 0x7f40180b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 -- 172.21.15.29:0/2832543734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008009420 con 0x7f401815d580 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401d32e700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f401815d580 0x7f40180d0430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f400000c560 tx=0x7f4000007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f4014ff9700 1 -- 172.21.15.29:0/2832543734 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000005c00 con 0x7f401815d580 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f4014ff9700 1 -- 172.21.15.29:0/2832543734 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4000005d60 con 0x7f401815d580 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40180b1990 con 0x7f401815d580 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f4014ff9700 1 -- 172.21.15.29:0/2832543734 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000007300 con 0x7f401815d580 2023-10-08T15:40:45.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.215+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40180b1f50 con 0x7f401815d580 2023-10-08T15:40:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.216+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40180b2430 con 0x7f401815d580 2023-10-08T15:40:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.217+0000 7f4014ff9700 1 -- 172.21.15.29:0/2832543734 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f400001b3b0 con 0x7f401815d580 2023-10-08T15:40:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.217+0000 7f4014ff9700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3ff8066f30 0x7f3ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:45.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.217+0000 7f4014ff9700 1 -- 172.21.15.29:0/2832543734 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40000838e0 con 0x7f401815d580 2023-10-08T15:40:45.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.217+0000 7f401cb2d700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3ff8066f30 0x7f3ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:45.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.218+0000 7f401cb2d700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3ff8066f30 0x7f3ff80693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4010001560 tx=0x7f40100016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:45.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.221+0000 7f4014ff9700 1 -- 172.21.15.29:0/2832543734 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4000050b80 con 0x7f401815d580 2023-10-08T15:40:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.462+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f401804c3c0 con 0x7f401815d580 2023-10-08T15:40:45.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.463+0000 7f4014ff9700 1 -- 172.21.15.29:0/2832543734 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4000017020 con 0x7f401815d580 2023-10-08T15:40:45.463 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:40:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3ff8066f30 msgr2=0x7f3ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:45.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3ff8066f30 0x7f3ff80693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4010001560 tx=0x7f40100016f0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f401815d580 msgr2=0x7f40180d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f401815d580 0x7f40180d0430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f400000c560 tx=0x7f4000007d90 comp rx=0 tx=0).stop 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 shutdown_connections 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3ff8066f30 0x7f3ff80693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f401815d580 0x7f40180d0430 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4018157870 0x7f40180b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 --2- 172.21.15.29:0/2832543734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f401815a620 0x7f401814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 >> 172.21.15.29:0/2832543734 conn(0x7f4018068ce0 msgr2=0x7f4018159920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 shutdown_connections 2023-10-08T15:40:45.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:45.465+0000 7f401ed91700 1 -- 172.21.15.29:0/2832543734 wait complete. 2023-10-08T15:40:45.477 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:40:45.477 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:40:45.477 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-08T15:40:45.477 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-08T15:40:45.477 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T15:40:45.477 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:40:45.477 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:40:45.478 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:40:45.478 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-08T15:40:45.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.478 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2023-10-08T15:40:45.494 INFO:teuthology.orchestra.run.smithi029.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42466sec preferred_lft 42466sec 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:45.495 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 3e:15:f1:4d:13:04 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a0a1:d2ff:feb5:830d/64 scope link 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 3e:15:f1:4d:13:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::3c15:f1ff:fe4d:1304/64 scope link tentative 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.496 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:40:45.558 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-08T15:40:45.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.560 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-08T15:40:45.617 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-08T15:40:45.617 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:40:45.617 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T15:40:45.617 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T15:40:45.617 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:40:45.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.618 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:45.618 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:45.618 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T15:40:45.618 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T15:40:45.618 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T15:40:45.618 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:45.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.719 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T15:40:45.733 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T15:40:45.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.734 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-10-08T15:40:45.789 INFO:teuthology.orchestra.run.smithi029.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-08T15:40:45.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.789 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:45.789 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:45.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T15:40:45.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-08T15:40:45.790 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:45.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.879 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T15:40:45.924 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:45.924 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:45.924 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:45.924 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.924 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:45.924 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.925 INFO:teuthology.orchestra.run.smithi029.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:40:45.925 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether be:cd:b8:7c:8b:7d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T15:40:45.925 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T15:40:45.925 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.925 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::bccd:b8ff:fe7c:8b7d/64 scope link tentative 2023-10-08T15:40:45.925 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.941 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T15:40:45.977 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:45.977 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether be:cd:b8:7c:8b:7d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::bccd:b8ff:fe7c:8b7d/64 scope link tentative 2023-10-08T15:40:45.978 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:45.993 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-08T15:40:45.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:45.994 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:45.994 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:45.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-08T15:40:45.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T15:40:45.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-08T15:40:45.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-08T15:40:45.994 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-08T15:40:45.994 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:46.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:46.210 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:40:46.210 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:40:46.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.1 up 2023-10-08T15:40:46.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T15:40:46.210 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:40:46.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:46.292 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-08T15:40:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-08T15:40:46.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:46.318 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-08T15:40:46.362 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-08T15:40:46.471 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:40:46.471 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:46.513 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:46.513 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:46.531 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:46.532 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:46.532 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:40:46.532 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 2@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:40:46.532 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:40:46.532 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:40:46.532 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:40:46.532 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:40:46.555 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 2@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-10-08T15:40:46.556 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=aa16b01f-3858-4fc7-9751-d7cb76fff138" will pass to kernel 2023-10-08T15:40:46.558 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T15:40:46.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:46.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-08T15:40:46.624 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-08T15:40:46.624 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:40:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.782+0000 7f685b356700 1 Processor -- start 2023-10-08T15:40:46.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.782+0000 7f685b356700 1 -- start start 2023-10-08T15:40:46.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.783+0000 7f685b356700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6854159cf0 0x7f685415e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:46.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.783+0000 7f685b356700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68540cca20 con 0x7f685415a0c0 2023-10-08T15:40:46.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.783+0000 7f685b356700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685415ea40 con 0x7f68540cf1c0 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.783+0000 7f685b356700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6854067660 con 0x7f6854159cf0 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.783+0000 7f68590f2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6854159cf0 0x7f685415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.783+0000 7f68588f1700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f685415a0c0 0x7f68540ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51072/0 (socket says 172.21.15.29:51072) 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.783+0000 7f68588f1700 1 -- 172.21.15.29:0/2136720713 learned_addr learned my addr 172.21.15.29:0/2136720713 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f68590f2700 1 -- 172.21.15.29:0/2136720713 >> v1:172.21.15.183:6789/0 conn(0x7f68540cf1c0 legacy=0x7f6854068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f68590f2700 1 -- 172.21.15.29:0/2136720713 >> v1:172.21.15.29:6789/0 conn(0x7f685415a0c0 legacy=0x7f68540ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f68590f2700 1 -- 172.21.15.29:0/2136720713 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854067f00 con 0x7f6854159cf0 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f68590f2700 1 --2- 172.21.15.29:0/2136720713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6854159cf0 0x7f685415e500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f684c0098e0 tx=0x7f684c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f9bc589d946e6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:46.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f6853fff700 1 -- 172.21.15.29:0/2136720713 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c009e80 con 0x7f6854159cf0 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f6853fff700 1 -- 172.21.15.29:0/2136720713 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c00b860 con 0x7f6854159cf0 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f6853fff700 1 -- 172.21.15.29:0/2136720713 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c00bbe0 con 0x7f6854159cf0 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f685b356700 1 -- 172.21.15.29:0/2136720713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6854159cf0 msgr2=0x7f685415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.784+0000 7f685b356700 1 --2- 172.21.15.29:0/2136720713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6854159cf0 0x7f685415e500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f684c0098e0 tx=0x7f684c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.785+0000 7f685b356700 1 -- 172.21.15.29:0/2136720713 shutdown_connections 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.785+0000 7f685b356700 1 --2- 172.21.15.29:0/2136720713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6854159cf0 0x7f685415e500 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.785+0000 7f685b356700 1 -- 172.21.15.29:0/2136720713 >> 172.21.15.29:0/2136720713 conn(0x7f685406c6e0 msgr2=0x7f6854069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.785+0000 7f685b356700 1 -- 172.21.15.29:0/2136720713 shutdown_connections 2023-10-08T15:40:46.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.785+0000 7f685b356700 1 -- 172.21.15.29:0/2136720713 wait complete. 2023-10-08T15:40:46.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.786+0000 7f685b356700 1 Processor -- start 2023-10-08T15:40:46.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.786+0000 7f685b356700 1 -- start start 2023-10-08T15:40:46.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f685b356700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68540cf1c0 0x7f685416b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:46.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f685b356700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6854159cf0 0x7f68540c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:46.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f685b356700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685415a0c0 0x7f68540ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:46.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f685b356700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685416b700 con 0x7f685415a0c0 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f685b356700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68540c8cb0 con 0x7f68540cf1c0 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f685b356700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68540c7de0 con 0x7f6854159cf0 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685415a0c0 0x7f68540ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685415a0c0 0x7f68540ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38112/0 (socket says 172.21.15.29:38112) 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 -- 172.21.15.29:0/544460530 learned_addr learned my addr 172.21.15.29:0/544460530 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68590f2700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68540cf1c0 0x7f685416b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68588f1700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6854159cf0 0x7f68540c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 -- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6854159cf0 msgr2=0x7f68540c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:46.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6854159cf0 0x7f68540c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 -- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68540cf1c0 msgr2=0x7f685416b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68540cf1c0 0x7f685416b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 -- 172.21.15.29:0/544460530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c009420 con 0x7f685415a0c0 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68598f3700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685415a0c0 0x7f68540ca540 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f684400c930 tx=0x7f6844001750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68517fa700 1 -- 172.21.15.29:0/544460530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844012630 con 0x7f685415a0c0 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68517fa700 1 -- 172.21.15.29:0/544460530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68440127d0 con 0x7f685415a0c0 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68540c80a0 con 0x7f685415a0c0 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f68517fa700 1 -- 172.21.15.29:0/544460530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844012b90 con 0x7f685415a0c0 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.787+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68540c8660 con 0x7f685415a0c0 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.788+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685416b8d0 con 0x7f685415a0c0 2023-10-08T15:40:46.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.789+0000 7f68517fa700 1 -- 172.21.15.29:0/544460530 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f684401a3a0 con 0x7f685415a0c0 2023-10-08T15:40:46.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.789+0000 7f68517fa700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6840066f30 0x7f68400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:46.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.789+0000 7f68517fa700 1 -- 172.21.15.29:0/544460530 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6844084540 con 0x7f685415a0c0 2023-10-08T15:40:46.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.789+0000 7f68590f2700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6840066f30 0x7f68400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:46.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.790+0000 7f68590f2700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6840066f30 0x7f68400693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f684c0093f0 tx=0x7f684c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:46.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:46.794+0000 7f68517fa700 1 -- 172.21.15.29:0/544460530 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f685416b8d0 con 0x7f685415a0c0 2023-10-08T15:40:47.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.031+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f685416b8d0 con 0x7f685415a0c0 2023-10-08T15:40:47.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.031+0000 7f68517fa700 1 -- 172.21.15.29:0/544460530 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f685416b8d0 con 0x7f685415a0c0 2023-10-08T15:40:47.033 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:40:47.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6840066f30 msgr2=0x7f68400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:47.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6840066f30 0x7f68400693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f684c0093f0 tx=0x7f684c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:47.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685415a0c0 msgr2=0x7f68540ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685415a0c0 0x7f68540ca540 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f684400c930 tx=0x7f6844001750 comp rx=0 tx=0).stop 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 shutdown_connections 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6840066f30 0x7f68400693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f685415a0c0 0x7f68540ca540 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68540cf1c0 0x7f685416b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 --2- 172.21.15.29:0/544460530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6854159cf0 0x7f68540c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 >> 172.21.15.29:0/544460530 conn(0x7f685406c6e0 msgr2=0x7f68540c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 shutdown_connections 2023-10-08T15:40:47.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:47.034+0000 7f685b356700 1 -- 172.21.15.29:0/544460530 wait complete. 2023-10-08T15:40:47.047 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:40:47.047 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:40:47.047 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-10-08T15:40:47.047 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T15:40:47.047 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T15:40:47.047 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:40:47.047 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:40:47.047 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:40:47.048 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:40:47.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.048 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-10-08T15:40:47.066 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42453sec preferred_lft 42453sec 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-10-08T15:40:47.067 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:47.068 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T15:40:47.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.068 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:47.068 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:47.068 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add name ceph-brx type bridge 2023-10-08T15:40:47.068 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr flush dev ceph-brx 2023-10-08T15:40:47.068 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set ceph-brx up 2023-10-08T15:40:47.068 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T15:40:47.068 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:47.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.238 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:40:47.279 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-10-08T15:40:47.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.281 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-10-08T15:40:47.351 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-10-08T15:40:47.352 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:40:47.352 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:40:47.352 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T15:40:47.352 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:40:47.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.352 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:47.352 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:47.352 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:40:47.352 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:40:47.353 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:40:47.353 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:47.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.592 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-10-08T15:40:47.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.607 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2023-10-08T15:40:47.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.662 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:47.662 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:47.662 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T15:40:47.662 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-08T15:40:47.662 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:47.752 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-08T15:40:47.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.752 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:47.752 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:47.753 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-08T15:40:47.753 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T15:40:47.753 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-08T15:40:47.753 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-08T15:40:47.753 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-08T15:40:47.753 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:47.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:47.942 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:47.942 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:47.942 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-10-08T15:40:47.942 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T15:40:47.942 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:48.034 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:48.034 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T15:40:48.048 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:40:48.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:48.049 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T15:40:48.103 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T15:40:48.103 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:40:48.103 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:48.194 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:48.195 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:48.278 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:48.278 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:48.278 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:40:48.278 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with new device syntax: 1@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:40:48.278 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:40:48.278 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:40:48.278 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:40:48.278 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:40:48.298 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with new device syntax: 1@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-10-08T15:40:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=aa16b01f-3858-4fc7-9751-d7cb76fff138" will pass to kernel 2023-10-08T15:40:48.301 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T15:40:48.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:48.301 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T15:40:48.326 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-08T15:40:48.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:40:48.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.456+0000 7fae99123700 1 Processor -- start 2023-10-08T15:40:48.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.456+0000 7fae99123700 1 -- start start 2023-10-08T15:40:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae99123700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae94157870 0x7fae9415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:48.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae99123700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fae94157c40 0x7fae94158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae99123700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9415cbb0 con 0x7fae9415a620 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae99123700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9415bfa0 con 0x7fae94157c40 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae99123700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9415c280 con 0x7fae94157870 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae92d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae94157870 0x7fae9415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae9359e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fae94157c40 0x7fae94158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae9259c700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fae9415a620 0x7fae9415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:37242/0 (socket says 172.21.15.29:37242) 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae92d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae94157870 0x7fae9415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:59496/0 (socket says 172.21.15.29:59496) 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.457+0000 7fae9259c700 1 -- 172.21.15.29:0/2914558266 learned_addr learned my addr 172.21.15.29:0/2914558266 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:48.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.458+0000 7fae92d9d700 1 -- 172.21.15.29:0/2914558266 >> v2:172.21.15.183:3300/0 conn(0x7fae94157c40 msgr2=0x7fae94158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.458+0000 7fae92d9d700 1 --2- 172.21.15.29:0/2914558266 >> v2:172.21.15.183:3300/0 conn(0x7fae94157c40 0x7fae94158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.458+0000 7fae92d9d700 1 -- 172.21.15.29:0/2914558266 >> v1:172.21.15.183:6789/0 conn(0x7fae9415a620 legacy=0x7fae9415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.458+0000 7fae92d9d700 1 -- 172.21.15.29:0/2914558266 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9415c560 con 0x7fae94157870 2023-10-08T15:40:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.458+0000 7fae92d9d700 1 --2- 172.21.15.29:0/2914558266 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae94157870 0x7fae9415b6a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae84009e60 tx=0x7fae84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a61a653a0570a856 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.458+0000 7fae91d9b700 1 -- 172.21.15.29:0/2914558266 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400e070 con 0x7fae94157870 2023-10-08T15:40:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.458+0000 7fae91d9b700 1 -- 172.21.15.29:0/2914558266 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8400bb60 con 0x7fae94157870 2023-10-08T15:40:48.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.458+0000 7fae91d9b700 1 -- 172.21.15.29:0/2914558266 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84012430 con 0x7fae94157870 2023-10-08T15:40:48.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.459+0000 7fae99123700 1 -- 172.21.15.29:0/2914558266 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae94157870 msgr2=0x7fae9415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.459+0000 7fae99123700 1 --2- 172.21.15.29:0/2914558266 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae94157870 0x7fae9415b6a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae84009e60 tx=0x7fae84009780 comp rx=0 tx=0).stop 2023-10-08T15:40:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.459+0000 7fae99123700 1 -- 172.21.15.29:0/2914558266 shutdown_connections 2023-10-08T15:40:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.459+0000 7fae99123700 1 --2- 172.21.15.29:0/2914558266 >> v2:172.21.15.183:3300/0 conn(0x7fae94157c40 0x7fae94158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.459+0000 7fae99123700 1 --2- 172.21.15.29:0/2914558266 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae94157870 0x7fae9415b6a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.459+0000 7fae99123700 1 -- 172.21.15.29:0/2914558266 >> 172.21.15.29:0/2914558266 conn(0x7fae94068ce0 msgr2=0x7fae940690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.459+0000 7fae99123700 1 -- 172.21.15.29:0/2914558266 shutdown_connections 2023-10-08T15:40:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.459+0000 7fae99123700 1 -- 172.21.15.29:0/2914558266 wait complete. 2023-10-08T15:40:48.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.460+0000 7fae99123700 1 Processor -- start 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.460+0000 7fae99123700 1 -- start start 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae99123700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae94157870 0x7fae941602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae99123700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae94157c40 0x7fae940c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae99123700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae9415a620 0x7fae940c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae99123700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9416b830 con 0x7fae94157870 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae99123700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9415d850 con 0x7fae94157c40 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae99123700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae94156470 con 0x7fae9415a620 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae94157870 0x7fae941602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae94157870 0x7fae941602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45866/0 (socket says 172.21.15.29:45866) 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 -- 172.21.15.29:0/747088306 learned_addr learned my addr 172.21.15.29:0/747088306 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:48.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae9359e700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae9415a620 0x7fae940c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae9259c700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae94157c40 0x7fae940c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 -- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae9415a620 msgr2=0x7fae940c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae9415a620 0x7fae940c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 -- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae94157c40 msgr2=0x7fae940c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae94157c40 0x7fae940c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 -- 172.21.15.29:0/747088306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae84009a20 con 0x7fae94157870 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae9359e700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae9415a620 0x7fae940c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae92d9d700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae94157870 0x7fae941602b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fae840097c0 tx=0x7fae84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.461+0000 7fae8affd700 1 -- 172.21.15.29:0/747088306 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84012da0 con 0x7fae94157870 2023-10-08T15:40:48.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.462+0000 7fae8affd700 1 -- 172.21.15.29:0/747088306 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84027470 con 0x7fae94157870 2023-10-08T15:40:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.462+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae940c6800 con 0x7fae94157870 2023-10-08T15:40:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.462+0000 7fae8affd700 1 -- 172.21.15.29:0/747088306 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84027830 con 0x7fae94157870 2023-10-08T15:40:48.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.462+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae940c6dc0 con 0x7fae94157870 2023-10-08T15:40:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.463+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae940d1760 con 0x7fae94157870 2023-10-08T15:40:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.463+0000 7fae8affd700 1 -- 172.21.15.29:0/747088306 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae84024070 con 0x7fae94157870 2023-10-08T15:40:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.463+0000 7fae8affd700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae74066f30 0x7fae740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.464+0000 7fae8affd700 1 -- 172.21.15.29:0/747088306 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae84086c10 con 0x7fae94157870 2023-10-08T15:40:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.464+0000 7fae9259c700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae74066f30 0x7fae740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:48.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.464+0000 7fae9259c700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae74066f30 0x7fae740693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fae940cdb60 tx=0x7fae7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:48.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.468+0000 7fae8affd700 1 -- 172.21.15.29:0/747088306 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae84053e80 con 0x7fae94157870 2023-10-08T15:40:48.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.707+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fae9404c3c0 con 0x7fae94157870 2023-10-08T15:40:48.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.708+0000 7fae8affd700 1 -- 172.21.15.29:0/747088306 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fae8402c060 con 0x7fae94157870 2023-10-08T15:40:48.709 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:40:48.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae74066f30 msgr2=0x7fae740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:48.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae74066f30 0x7fae740693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fae940cdb60 tx=0x7fae7c009040 comp rx=0 tx=0).stop 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae94157870 msgr2=0x7fae941602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae94157870 0x7fae941602b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fae840097c0 tx=0x7fae84019000 comp rx=0 tx=0).stop 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 shutdown_connections 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fae74066f30 0x7fae740693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae9415a620 0x7fae940c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae94157870 0x7fae941602b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 --2- 172.21.15.29:0/747088306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae94157c40 0x7fae940c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 >> 172.21.15.29:0/747088306 conn(0x7fae94068ce0 msgr2=0x7fae9415abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 shutdown_connections 2023-10-08T15:40:48.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:48.710+0000 7fae99123700 1 -- 172.21.15.29:0/747088306 wait complete. 2023-10-08T15:40:48.723 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T15:40:48.723 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:40:48.723 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-10-08T15:40:48.723 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-08T15:40:48.723 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T15:40:48.723 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T15:40:48.724 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T15:40:48.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:40:48.724 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-08T15:40:48.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:48.724 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-10-08T15:40:48.740 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:48.740 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:48.740 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:48.740 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:48.740 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:48.740 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:40:48.741 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42452sec preferred_lft 42452sec 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:2f:27:f5:c4:ba brd ff:ff:ff:ff:ff:ff 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::f8f9:ecff:fe70:2278/64 scope link 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:48.742 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:40:48.743 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:2f:27:f5:c4:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T15:40:48.743 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::2f:27ff:fef5:c4ba/64 scope link tentative 2023-10-08T15:40:48.743 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:48.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:48.743 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:40:48.803 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-10-08T15:40:48.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:48.804 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-10-08T15:40:48.860 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-10-08T15:40:48.860 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:40:48.860 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:40:48.860 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T15:40:48.860 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:40:48.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:48.861 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:48.861 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:48.861 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:40:48.861 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:40:48.861 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:40:48.861 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:48.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:48.960 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-10-08T15:40:48.974 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T15:40:48.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:48.974 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2023-10-08T15:40:49.028 INFO:teuthology.orchestra.run.smithi183.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-08T15:40:49.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:49.029 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:49.029 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:49.029 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T15:40:49.029 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-08T15:40:49.029 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:49.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:49.116 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T15:40:49.156 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:49.156 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:49.156 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:49.156 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:49.157 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:49.157 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:49.157 INFO:teuthology.orchestra.run.smithi183.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:40:49.157 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether da:cd:9b:28:6b:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T15:40:49.157 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T15:40:49.157 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:49.157 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::d8cd:9bff:fe28:6b90/64 scope link tentative 2023-10-08T15:40:49.157 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:49.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:49.167 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T15:40:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:40:49.237 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:40:49.237 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether da:cd:9b:28:6b:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::d8cd:9bff:fe28:6b90/64 scope link tentative 2023-10-08T15:40:49.238 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:40:49.245 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-08T15:40:49.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:49.245 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:49.246 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:49.246 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-08T15:40:49.246 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T15:40:49.246 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-08T15:40:49.246 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-08T15:40:49.246 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-08T15:40:49.246 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:49.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:49.463 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:40:49.463 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:40:49.463 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.1 up 2023-10-08T15:40:49.463 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T15:40:49.463 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:40:49.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:49.542 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-08T15:40:49.556 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-08T15:40:49.556 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:40:49.556 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-08T15:40:49.610 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-08T15:40:49.611 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:40:49.611 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:49.691 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:49.691 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:49.709 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:49.709 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:49.710 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:40:49.710 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with new device syntax: 3@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:40:49.710 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:40:49.710 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:40:49.710 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:40:49.710 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:40:49.730 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:40:49.730 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:40:49.730 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:40:49.731 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with new device syntax: 3@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:40:49.731 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:40:49.731 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:40:49.731 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:40:49.731 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:40:49.731 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-10-08T15:40:49.731 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-10-08T15:40:49.731 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=aa16b01f-3858-4fc7-9751-d7cb76fff138" will pass to kernel 2023-10-08T15:40:49.733 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T15:40:49.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:49.733 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-08T15:40:49.797 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T15:40:49.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:49.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.945+0000 7f3bb6846700 1 Processor -- start 2023-10-08T15:40:49.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.945+0000 7f3bb6846700 1 -- start start 2023-10-08T15:40:49.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3bb6846700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb01523e0 0x7f3bb006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:49.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3bb6846700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb006c010 con 0x7f3bb0152010 2023-10-08T15:40:49.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3bb6846700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb006bd10 con 0x7f3bb0158e50 2023-10-08T15:40:49.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3bb6846700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb015c060 con 0x7f3bb01523e0 2023-10-08T15:40:49.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3baffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3bb0152010 0x7f3bb015b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56252/0 (socket says 172.21.15.29:56252) 2023-10-08T15:40:49.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3baffff700 1 -- 172.21.15.29:0/2719814860 learned_addr learned my addr 172.21.15.29:0/2719814860 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:49.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3baf7fe700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb01523e0 0x7f3bb006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17071334 0 0) 0x7f3bb006c010 con 0x7f3bb0152010 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.946+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b9c003570 con 0x7f3bb0152010 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523259704 0 0) 0x7f3bb006bd10 con 0x7f3bb0158e50 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb006c010 con 0x7f3bb0158e50 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755649101 0 0) 0x7f3b9c003570 con 0x7f3bb0152010 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb01523e0 msgr2=0x7f3bb006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb01523e0 0x7f3bb006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 >> v1:172.21.15.183:6789/0 conn(0x7f3bb0158e50 legacy=0x7f3bb00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb015c340 con 0x7f3bb0152010 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f3ba0001470 con 0x7f3bb0152010 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 >> v1:172.21.15.29:6789/0 conn(0x7f3bb0152010 legacy=0x7f3bb015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:49.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b9c003c20 0x7f3b9c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb01523e0 0x7f3b9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c004d50 0x7f3b9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb015c060 con 0x7f3b9c003c20 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c00bbf0 con 0x7f3b9c004d50 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c00bdb0 con 0x7f3bb01523e0 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baffff700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b9c003c20 0x7f3b9c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baf7fe700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb01523e0 0x7f3b9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3bb4de3700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c004d50 0x7f3b9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baffff700 1 -- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb01523e0 msgr2=0x7f3b9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baffff700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb01523e0 0x7f3b9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baffff700 1 -- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c004d50 msgr2=0x7f3b9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baffff700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c004d50 0x7f3b9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baffff700 1 -- 172.21.15.29:0/2719814860 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c003570 con 0x7f3b9c003c20 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.947+0000 7f3baffff700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b9c003c20 0x7f3b9c004010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0007fd0 tx=0x7f3ba0001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303956b5c7f2e760 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000cae0 con 0x7f3b9c003c20 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000cc60 con 0x7f3b9c003c20 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3baeffd700 1 -- 172.21.15.29:0/2719814860 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0005920 con 0x7f3b9c003c20 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3bb6846700 1 -- 172.21.15.29:0/2719814860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b9c003c20 msgr2=0x7f3b9c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3bb6846700 1 --2- 172.21.15.29:0/2719814860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b9c003c20 0x7f3b9c004010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0007fd0 tx=0x7f3ba0001d40 comp rx=0 tx=0).stop 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3bb4de3700 1 -- 172.21.15.29:0/2719814860 reap_dead start 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3bb6846700 1 -- 172.21.15.29:0/2719814860 shutdown_connections 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3bb6846700 1 -- 172.21.15.29:0/2719814860 >> 172.21.15.29:0/2719814860 conn(0x7f3bb0069870 msgr2=0x7f3bb0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3bb6846700 1 -- 172.21.15.29:0/2719814860 shutdown_connections 2023-10-08T15:40:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.948+0000 7f3bb6846700 1 -- 172.21.15.29:0/2719814860 wait complete. 2023-10-08T15:40:49.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.949+0000 7f3bb6846700 1 Processor -- start 2023-10-08T15:40:49.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3bb6846700 1 -- start start 2023-10-08T15:40:49.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3bb6846700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c003c20 0x7f3bb00b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:49.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3bb6846700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bb00c6d20 0x7f3bb014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:49.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3bb6846700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb0156c30 0x7f3bb0157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:49.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3bb6846700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb01575c0 con 0x7f3bb00c6d20 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3bb6846700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00c7270 con 0x7f3b9c003c20 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3bb6846700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0067700 con 0x7f3bb0156c30 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bb00c6d20 0x7f3bb014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bb00c6d20 0x7f3bb014f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45894/0 (socket says 172.21.15.29:45894) 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3baf7fe700 1 -- 172.21.15.29:0/573505614 learned_addr learned my addr 172.21.15.29:0/573505614 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.950+0000 7f3baffff700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c003c20 0x7f3bb00b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3bb4de3700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb0156c30 0x7f3bb0157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3baf7fe700 1 -- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb0156c30 msgr2=0x7f3bb0157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3baf7fe700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb0156c30 0x7f3bb0157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3baf7fe700 1 -- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c003c20 msgr2=0x7f3bb00b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3baf7fe700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c003c20 0x7f3bb00b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:49.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3baf7fe700 1 -- 172.21.15.29:0/573505614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00679e0 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3baf7fe700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bb00c6d20 0x7f3bb014f570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3b98011b40 tx=0x7f3b980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3ba7fff700 1 -- 172.21.15.29:0/573505614 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800f940 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3ba7fff700 1 -- 172.21.15.29:0/573505614 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9800faa0 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb0067cc0 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3ba7fff700 1 -- 172.21.15.29:0/573505614 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800fe20 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.951+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb00b4520 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.952+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0067f00 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.952+0000 7f3ba7fff700 1 -- 172.21.15.29:0/573505614 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b98014650 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.953+0000 7f3ba7fff700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b90066f60 0x7f3b90069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.953+0000 7f3ba7fff700 1 -- 172.21.15.29:0/573505614 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b98018030 con 0x7f3bb00c6d20 2023-10-08T15:40:49.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.953+0000 7f3baffff700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b90066f60 0x7f3b90069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:49.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.954+0000 7f3baffff700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b90066f60 0x7f3b90069410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000ff0 tx=0x7f3ba0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:49.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:49.957+0000 7f3ba7fff700 1 -- 172.21.15.29:0/573505614 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bb0067f00 con 0x7f3bb00c6d20 2023-10-08T15:40:50.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.150+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bb00cd960 con 0x7f3bb00c6d20 2023-10-08T15:40:50.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.151+0000 7f3ba7fff700 1 -- 172.21.15.29:0/573505614 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f3b98022090 con 0x7f3bb00c6d20 2023-10-08T15:40:50.153 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:50.153 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b90066f60 msgr2=0x7f3b90069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b90066f60 0x7f3b90069410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000ff0 tx=0x7f3ba0015000 comp rx=0 tx=0).stop 2023-10-08T15:40:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bb00c6d20 msgr2=0x7f3bb014f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bb00c6d20 0x7f3bb014f570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3b98011b40 tx=0x7f3b980091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 shutdown_connections 2023-10-08T15:40:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b90066f60 0x7f3b90069410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bb0156c30 0x7f3bb0157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b9c003c20 0x7f3bb00b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 --2- 172.21.15.29:0/573505614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bb00c6d20 0x7f3bb014f570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.153+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 >> 172.21.15.29:0/573505614 conn(0x7f3bb0069870 msgr2=0x7f3bb01514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:50.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.154+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 shutdown_connections 2023-10-08T15:40:50.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.154+0000 7f3bb6846700 1 -- 172.21.15.29:0/573505614 wait complete. 2023-10-08T15:40:50.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:40:20.956808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:40:22.081738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:50.168 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:50.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.288+0000 7f061f24d700 1 Processor -- start 2023-10-08T15:40:50.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.288+0000 7f061f24d700 1 -- start start 2023-10-08T15:40:50.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f061f24d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0618159ec0 0x7f06180af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f061f24d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f061815a290 0x7f06180afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f061f24d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06180b0790 con 0x7f061806a5a0 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f061f24d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06180ce1f0 con 0x7f061815a290 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f061f24d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06180b0b20 con 0x7f0618159ec0 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f061d7ea700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f061806a5a0 0x7f061815db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56262/0 (socket says 172.21.15.29:56262) 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f061d7ea700 1 -- 172.21.15.29:0/240693121 learned_addr learned my addr 172.21.15.29:0/240693121 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f061cfe9700 1 --2- 172.21.15.29:0/240693121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0618159ec0 0x7f06180af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.289+0000 7f0617fff700 1 --2- 172.21.15.29:0/240693121 >> v2:172.21.15.183:3300/0 conn(0x7f061815a290 0x7f06180afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f06177fe700 1 -- 172.21.15.29:0/240693121 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206955891 0 0) 0x7f06180b0790 con 0x7f061806a5a0 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f06177fe700 1 -- 172.21.15.29:0/240693121 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0604003570 con 0x7f061806a5a0 2023-10-08T15:40:50.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f061cfe9700 1 -- 172.21.15.29:0/240693121 >> v2:172.21.15.183:3300/0 conn(0x7f061815a290 msgr2=0x7f06180afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f061cfe9700 1 --2- 172.21.15.29:0/240693121 >> v2:172.21.15.183:3300/0 conn(0x7f061815a290 0x7f06180afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f061cfe9700 1 -- 172.21.15.29:0/240693121 >> v1:172.21.15.29:6789/0 conn(0x7f061806a5a0 legacy=0x7f061815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f061cfe9700 1 -- 172.21.15.29:0/240693121 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06180b04b0 con 0x7f0618159ec0 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f0617fff700 1 --2- 172.21.15.29:0/240693121 >> v2:172.21.15.183:3300/0 conn(0x7f061815a290 0x7f06180afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f061cfe9700 1 --2- 172.21.15.29:0/240693121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0618159ec0 0x7f06180af940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06100098e0 tx=0x7f06100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541658bfbde1445a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f06177fe700 1 -- 172.21.15.29:0/240693121 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610011630 con 0x7f0618159ec0 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f06177fe700 1 -- 172.21.15.29:0/240693121 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610011790 con 0x7f0618159ec0 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.290+0000 7f06177fe700 1 -- 172.21.15.29:0/240693121 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610011b10 con 0x7f0618159ec0 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.291+0000 7f061f24d700 1 -- 172.21.15.29:0/240693121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0618159ec0 msgr2=0x7f06180af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.291+0000 7f061f24d700 1 --2- 172.21.15.29:0/240693121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0618159ec0 0x7f06180af940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06100098e0 tx=0x7f06100091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.291+0000 7f061f24d700 1 -- 172.21.15.29:0/240693121 shutdown_connections 2023-10-08T15:40:50.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.291+0000 7f061f24d700 1 --2- 172.21.15.29:0/240693121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0618159ec0 0x7f06180af940 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.291+0000 7f061f24d700 1 --2- 172.21.15.29:0/240693121 >> v2:172.21.15.183:3300/0 conn(0x7f061815a290 0x7f06180afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.291+0000 7f061f24d700 1 -- 172.21.15.29:0/240693121 >> 172.21.15.29:0/240693121 conn(0x7f06180d1880 msgr2=0x7f06180cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:50.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.291+0000 7f061f24d700 1 -- 172.21.15.29:0/240693121 shutdown_connections 2023-10-08T15:40:50.295 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.291+0000 7f061f24d700 1 -- 172.21.15.29:0/240693121 wait complete. 2023-10-08T15:40:50.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.292+0000 7f061f24d700 1 Processor -- start 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.292+0000 7f061f24d700 1 -- start start 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061f24d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061806a5a0 0x7f06180c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061f24d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0618159ec0 0x7f0618153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061f24d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f061815a290 0x7f06180c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061f24d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180cb270 con 0x7f061815a290 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061f24d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180c9620 con 0x7f0618159ec0 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061f24d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06180c9ff0 con 0x7f061806a5a0 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061d7ea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f061815a290 0x7f06180c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061d7ea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f061815a290 0x7f06180c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45906/0 (socket says 172.21.15.29:45906) 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061d7ea700 1 -- 172.21.15.29:0/3719704690 learned_addr learned my addr 172.21.15.29:0/3719704690 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f0617fff700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0618159ec0 0x7f0618153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061cfe9700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061806a5a0 0x7f06180c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061d7ea700 1 -- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061806a5a0 msgr2=0x7f06180c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061d7ea700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061806a5a0 0x7f06180c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061d7ea700 1 -- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0618159ec0 msgr2=0x7f0618153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061d7ea700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0618159ec0 0x7f0618153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f061d7ea700 1 -- 172.21.15.29:0/3719704690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608009a20 con 0x7f061815a290 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.293+0000 7f0617fff700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0618159ec0 0x7f0618153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.294+0000 7f061d7ea700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f061815a290 0x7f06180c6da0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06000010e0 tx=0x7f0600007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.294+0000 7f0614ff9700 1 -- 172.21.15.29:0/3719704690 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600005c00 con 0x7f061815a290 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.294+0000 7f0614ff9700 1 -- 172.21.15.29:0/3719704690 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600005d60 con 0x7f061815a290 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.294+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0610009420 con 0x7f061815a290 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.294+0000 7f0614ff9700 1 -- 172.21.15.29:0/3719704690 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000072e0 con 0x7f061815a290 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.294+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06180c8fd0 con 0x7f061815a290 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.295+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06180c8e30 con 0x7f061815a290 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.295+0000 7f0614ff9700 1 -- 172.21.15.29:0/3719704690 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0600012400 con 0x7f061815a290 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.296+0000 7f0614ff9700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f05f8066f30 0x7f05f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.296+0000 7f0614ff9700 1 -- 172.21.15.29:0/3719704690 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06000839a0 con 0x7f061815a290 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.296+0000 7f061cfe9700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f05f8066f30 0x7f05f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.296+0000 7f061cfe9700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f05f8066f30 0x7f05f80693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06100091e0 tx=0x7f0610017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.300+0000 7f0614ff9700 1 -- 172.21.15.29:0/3719704690 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f060004b5a0 con 0x7f061815a290 2023-10-08T15:40:50.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.492+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06180c9790 con 0x7f061815a290 2023-10-08T15:40:50.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.493+0000 7f0614ff9700 1 -- 172.21.15.29:0/3719704690 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0600017020 con 0x7f061815a290 2023-10-08T15:40:50.494 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.494+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f05f8066f30 msgr2=0x7f05f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.494+0000 7f061f24d700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f05f8066f30 0x7f05f80693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06100091e0 tx=0x7f0610017000 comp rx=0 tx=0).stop 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.494+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f061815a290 msgr2=0x7f06180c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.494+0000 7f061f24d700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f061815a290 0x7f06180c6da0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06000010e0 tx=0x7f0600007dd0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.495+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 shutdown_connections 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.495+0000 7f061f24d700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f05f8066f30 0x7f05f80693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.495+0000 7f061f24d700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f061815a290 0x7f06180c6da0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.495+0000 7f061f24d700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061806a5a0 0x7f06180c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.495+0000 7f061f24d700 1 --2- 172.21.15.29:0/3719704690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0618159ec0 0x7f0618153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.495+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 >> 172.21.15.29:0/3719704690 conn(0x7f06180d1880 msgr2=0x7f0618155990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.495+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 shutdown_connections 2023-10-08T15:40:50.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.495+0000 7f061f24d700 1 -- 172.21.15.29:0/3719704690 wait complete. 2023-10-08T15:40:50.508 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.629+0000 7f3e8876c700 1 Processor -- start 2023-10-08T15:40:50.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.629+0000 7f3e8876c700 1 -- start start 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.629+0000 7f3e8876c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3e80159ec0 0x7f3e800af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e8876c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3e8006acb0 0x7f3e800afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e8876c700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e800b0790 con 0x7f3e8015a290 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e8876c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800ce1f0 con 0x7f3e8006acb0 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e8876c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800b0b20 con 0x7f3e80159ec0 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86d09700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3e8006acb0 0x7f3e800afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86d09700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3e8006acb0 0x7f3e800afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45914/0 (socket says 172.21.15.29:45914) 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86d09700 1 -- 172.21.15.29:0/802791272 learned_addr learned my addr 172.21.15.29:0/802791272 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86508700 1 --2- 172.21.15.29:0/802791272 >> v2:172.21.15.183:3300/0 conn(0x7f3e80159ec0 0x7f3e800af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86d09700 1 -- 172.21.15.29:0/802791272 >> v2:172.21.15.183:3300/0 conn(0x7f3e80159ec0 msgr2=0x7f3e800af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86d09700 1 --2- 172.21.15.29:0/802791272 >> v2:172.21.15.183:3300/0 conn(0x7f3e80159ec0 0x7f3e800af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86d09700 1 -- 172.21.15.29:0/802791272 >> v1:172.21.15.183:6789/0 conn(0x7f3e8015a290 legacy=0x7f3e8006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:50.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86d09700 1 -- 172.21.15.29:0/802791272 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800b04b0 con 0x7f3e8006acb0 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e86d09700 1 --2- 172.21.15.29:0/802791272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8006acb0 0x7f3e800afe80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3e800898e0 tx=0x7f3e70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e33b4d790a3545 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e85506700 1 -- 172.21.15.29:0/802791272 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000b820 con 0x7f3e8006acb0 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e85506700 1 -- 172.21.15.29:0/802791272 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000b980 con 0x7f3e8006acb0 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.630+0000 7f3e85506700 1 -- 172.21.15.29:0/802791272 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000bd20 con 0x7f3e8006acb0 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.631+0000 7f3e8876c700 1 -- 172.21.15.29:0/802791272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8006acb0 msgr2=0x7f3e800afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.631+0000 7f3e8876c700 1 --2- 172.21.15.29:0/802791272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8006acb0 0x7f3e800afe80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3e800898e0 tx=0x7f3e70009250 comp rx=0 tx=0).stop 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.631+0000 7f3e8876c700 1 -- 172.21.15.29:0/802791272 shutdown_connections 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.631+0000 7f3e8876c700 1 --2- 172.21.15.29:0/802791272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8006acb0 0x7f3e800afe80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.631+0000 7f3e8876c700 1 --2- 172.21.15.29:0/802791272 >> v2:172.21.15.183:3300/0 conn(0x7f3e80159ec0 0x7f3e800af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.631+0000 7f3e8876c700 1 -- 172.21.15.29:0/802791272 >> 172.21.15.29:0/802791272 conn(0x7f3e800d1880 msgr2=0x7f3e800cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:50.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.631+0000 7f3e8876c700 1 -- 172.21.15.29:0/802791272 shutdown_connections 2023-10-08T15:40:50.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.631+0000 7f3e8876c700 1 -- 172.21.15.29:0/802791272 wait complete. 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.632+0000 7f3e8876c700 1 Processor -- start 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.632+0000 7f3e8876c700 1 -- start start 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e8876c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8006acb0 0x7f3e800ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e8876c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e80159ec0 0x7f3e80154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e8876c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8015a290 0x7f3e80156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e8876c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800c9960 con 0x7f3e80159ec0 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e8876c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800c8de0 con 0x7f3e8015a290 2023-10-08T15:40:50.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e8876c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800c90c0 con 0x7f3e8006acb0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e80159ec0 0x7f3e80154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e80159ec0 0x7f3e80154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45930/0 (socket says 172.21.15.29:45930) 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 -- 172.21.15.29:0/4025176664 learned_addr learned my addr 172.21.15.29:0/4025176664 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e86508700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8006acb0 0x7f3e800ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e86d09700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8015a290 0x7f3e80156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 -- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8006acb0 msgr2=0x7f3e800ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8006acb0 0x7f3e800ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 -- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8015a290 msgr2=0x7f3e80156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8015a290 0x7f3e80156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 -- 172.21.15.29:0/4025176664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700094f0 con 0x7f3e80159ec0 2023-10-08T15:40:50.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e86d09700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8015a290 0x7f3e80156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e85d07700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e80159ec0 0x7f3e80154860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400b5e0 tx=0x7f3e740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e7e7fc700 1 -- 172.21.15.29:0/4025176664 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400f510 con 0x7f3e80159ec0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e7e7fc700 1 -- 172.21.15.29:0/4025176664 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7400f670 con 0x7f3e80159ec0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e800c93a0 con 0x7f3e80159ec0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e7e7fc700 1 -- 172.21.15.29:0/4025176664 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400fa30 con 0x7f3e80159ec0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.633+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e800cadf0 con 0x7f3e80159ec0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.634+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8004c3c0 con 0x7f3e80159ec0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.635+0000 7f3e7e7fc700 1 -- 172.21.15.29:0/4025176664 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e7401a400 con 0x7f3e80159ec0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.635+0000 7f3e7e7fc700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3e6c066f30 0x7f3e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.635+0000 7f3e7e7fc700 1 -- 172.21.15.29:0/4025176664 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e74084000 con 0x7f3e80159ec0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.635+0000 7f3e86508700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3e6c066f30 0x7f3e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.636+0000 7f3e86508700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3e6c066f30 0x7f3e6c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800f610 tx=0x7f3e780077f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.639+0000 7f3e7e7fc700 1 -- 172.21.15.29:0/4025176664 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e74054d80 con 0x7f3e80159ec0 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.830+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e800ceab0 con 0x7f3e80159ec0 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.831+0000 7f3e7e7fc700 1 -- 172.21.15.29:0/4025176664 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e74054910 con 0x7f3e80159ec0 2023-10-08T15:40:50.832 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:40:50.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3e6c066f30 msgr2=0x7f3e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3e6c066f30 0x7f3e6c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800f610 tx=0x7f3e780077f0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e80159ec0 msgr2=0x7f3e80154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e80159ec0 0x7f3e80154860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400b5e0 tx=0x7f3e740090f0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 shutdown_connections 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3e6c066f30 0x7f3e6c0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8015a290 0x7f3e80156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8006acb0 0x7f3e800ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 --2- 172.21.15.29:0/4025176664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e80159ec0 0x7f3e80154860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 >> 172.21.15.29:0/4025176664 conn(0x7f3e800d1880 msgr2=0x7f3e801557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 shutdown_connections 2023-10-08T15:40:50.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.833+0000 7f3e8876c700 1 -- 172.21.15.29:0/4025176664 wait complete. 2023-10-08T15:40:50.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:50.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.966+0000 7fb7ccb7d700 1 Processor -- start 2023-10-08T15:40:50.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.966+0000 7fb7ccb7d700 1 -- start start 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7ccb7d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c80cce30 0x7fb7c815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7ccb7d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb7c80b6580 0x7fb7c806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7ccb7d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c80b4d70 con 0x7fb7c806a830 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7ccb7d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c806ac70 con 0x7fb7c80b6580 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7ccb7d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c80cd8d0 con 0x7fb7c80cce30 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7c77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c80cce30 0x7fb7c815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7c6ffd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb7c80b6580 0x7fb7c806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7c77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c80cce30 0x7fb7c815aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:59570/0 (socket says 172.21.15.29:59570) 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7c7fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb7c806a830 0x7fb7c815d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:37278/0 (socket says 172.21.15.29:37278) 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7c77fe700 1 -- 172.21.15.29:0/2051369403 learned_addr learned my addr 172.21.15.29:0/2051369403 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.967+0000 7fb7c77fe700 1 -- 172.21.15.29:0/2051369403 >> v2:172.21.15.183:3300/0 conn(0x7fb7c80b6580 msgr2=0x7fb7c806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7c77fe700 1 --2- 172.21.15.29:0/2051369403 >> v2:172.21.15.183:3300/0 conn(0x7fb7c80b6580 0x7fb7c806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7c77fe700 1 -- 172.21.15.29:0/2051369403 >> v1:172.21.15.183:6789/0 conn(0x7fb7c806a830 legacy=0x7fb7c815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7c77fe700 1 -- 172.21.15.29:0/2051369403 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c80b4440 con 0x7fb7c80cce30 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7c6ffd700 1 --2- 172.21.15.29:0/2051369403 >> v2:172.21.15.183:3300/0 conn(0x7fb7c80b6580 0x7fb7c806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7c77fe700 1 --2- 172.21.15.29:0/2051369403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c80cce30 0x7fb7c815aca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80099b0 tx=0x7fb7b8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9adba2052768107b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7c67fc700 1 -- 172.21.15.29:0/2051369403 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8009ea0 con 0x7fb7c80cce30 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7c67fc700 1 -- 172.21.15.29:0/2051369403 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b800b860 con 0x7fb7c80cce30 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7c67fc700 1 -- 172.21.15.29:0/2051369403 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800bc00 con 0x7fb7c80cce30 2023-10-08T15:40:50.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/2051369403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c80cce30 msgr2=0x7fb7c815aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/2051369403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c80cce30 0x7fb7c815aca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80099b0 tx=0x7fb7b8009250 comp rx=0 tx=0).stop 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/2051369403 shutdown_connections 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/2051369403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c80cce30 0x7fb7c815aca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/2051369403 >> v2:172.21.15.183:3300/0 conn(0x7fb7c80b6580 0x7fb7c806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/2051369403 >> 172.21.15.29:0/2051369403 conn(0x7fb7c8068cb0 msgr2=0x7fb7c80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.968+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/2051369403 shutdown_connections 2023-10-08T15:40:50.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.969+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/2051369403 wait complete. 2023-10-08T15:40:50.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.970+0000 7fb7ccb7d700 1 Processor -- start 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.970+0000 7fb7ccb7d700 1 -- start start 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.970+0000 7fb7ccb7d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c806a830 0x7fb7c81512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.970+0000 7fb7ccb7d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7c80b6580 0x7fb7c814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.970+0000 7fb7ccb7d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7c80cce30 0x7fb7c80d0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.970+0000 7fb7ccb7d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c80b0be0 con 0x7fb7c80cce30 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.970+0000 7fb7ccb7d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8151b80 con 0x7fb7c80b6580 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.970+0000 7fb7ccb7d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8151e60 con 0x7fb7c806a830 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7c80cce30 0x7fb7c80d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7c80cce30 0x7fb7c80d0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45942/0 (socket says 172.21.15.29:45942) 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c77fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c806a830 0x7fb7c81512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c7fff700 1 -- 172.21.15.29:0/3066675361 learned_addr learned my addr 172.21.15.29:0/3066675361 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c6ffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7c80b6580 0x7fb7c814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c77fe700 1 -- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7c80b6580 msgr2=0x7fb7c814b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c77fe700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7c80b6580 0x7fb7c814b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c77fe700 1 -- 172.21.15.29:0/3066675361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7c80cce30 msgr2=0x7fb7c80d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c77fe700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7c80cce30 0x7fb7c80d0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c77fe700 1 -- 172.21.15.29:0/3066675361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc009420 con 0x7fb7c806a830 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c7fff700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7c80cce30 0x7fb7c80d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7c77fe700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c806a830 0x7fb7c81512e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7c815a280 tx=0x7fb7b8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7af7fe700 1 -- 172.21.15.29:0/3066675361 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8000d10 con 0x7fb7c806a830 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7af7fe700 1 -- 172.21.15.29:0/3066675361 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b800bbe0 con 0x7fb7c806a830 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b80094f0 con 0x7fb7c806a830 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7af7fe700 1 -- 172.21.15.29:0/3066675361 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8011630 con 0x7fb7c806a830 2023-10-08T15:40:50.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.971+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c8152420 con 0x7fb7c806a830 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.972+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c80b0d50 con 0x7fb7c806a830 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.973+0000 7fb7af7fe700 1 -- 172.21.15.29:0/3066675361 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7b8011a60 con 0x7fb7c806a830 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.973+0000 7fb7af7fe700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb7b4066f60 0x7fb7b4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.973+0000 7fb7af7fe700 1 -- 172.21.15.29:0/3066675361 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7b8085390 con 0x7fb7c806a830 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.973+0000 7fb7c6ffd700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb7b4066f60 0x7fb7b4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:50.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.974+0000 7fb7c6ffd700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb7b4066f60 0x7fb7b4069410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80d1090 tx=0x7fb7bc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:50.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:50.978+0000 7fb7af7fe700 1 -- 172.21.15.29:0/3066675361 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7b80525e0 con 0x7fb7c806a830 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.170+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7c80b4720 con 0x7fb7c806a830 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.170+0000 7fb7af7fe700 1 -- 172.21.15.29:0/3066675361 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7b8015020 con 0x7fb7c806a830 2023-10-08T15:40:51.172 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb7b4066f60 msgr2=0x7fb7b4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb7b4066f60 0x7fb7b4069410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80d1090 tx=0x7fb7bc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c806a830 msgr2=0x7fb7c81512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c806a830 0x7fb7c81512e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7c815a280 tx=0x7fb7b8017000 comp rx=0 tx=0).stop 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 shutdown_connections 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb7b4066f60 0x7fb7b4069410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7c80cce30 0x7fb7c80d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7c806a830 0x7fb7c81512e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 --2- 172.21.15.29:0/3066675361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7c80b6580 0x7fb7c814b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 >> 172.21.15.29:0/3066675361 conn(0x7fb7c8068cb0 msgr2=0x7fb7c8150420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 shutdown_connections 2023-10-08T15:40:51.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.172+0000 7fb7ccb7d700 1 -- 172.21.15.29:0/3066675361 wait complete. 2023-10-08T15:40:51.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:51.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.306+0000 7fe2067b5700 1 Processor -- start 2023-10-08T15:40:51.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.306+0000 7fe2067b5700 1 -- start start 2023-10-08T15:40:51.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe2067b5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015a620 0x7fe20015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe2067b5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe20015d580 0x7fe200158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe2067b5700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20015cbb0 con 0x7fe200157870 2023-10-08T15:40:51.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe2067b5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20015bdb0 con 0x7fe20015d580 2023-10-08T15:40:51.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe2067b5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015bfa0 con 0x7fe20015a620 2023-10-08T15:40:51.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1ff7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015a620 0x7fe20015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe204d52700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe20015d580 0x7fe200158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1fffff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fe200157870 0x7fe20015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:37292/0 (socket says 172.21.15.29:37292) 2023-10-08T15:40:51.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1fffff700 1 -- 172.21.15.29:0/2355127104 learned_addr learned my addr 172.21.15.29:0/2355127104 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:51.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1feffd700 1 -- 172.21.15.29:0/2355127104 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362169273 0 0) 0x7fe20015cbb0 con 0x7fe200157870 2023-10-08T15:40:51.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1ff7fe700 1 -- 172.21.15.29:0/2355127104 >> v2:172.21.15.183:3300/0 conn(0x7fe20015d580 msgr2=0x7fe200158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:51.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1ff7fe700 1 --2- 172.21.15.29:0/2355127104 >> v2:172.21.15.183:3300/0 conn(0x7fe20015d580 0x7fe200158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1ff7fe700 1 -- 172.21.15.29:0/2355127104 >> v1:172.21.15.183:6789/0 conn(0x7fe200157870 legacy=0x7fe20015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1ff7fe700 1 -- 172.21.15.29:0/2355127104 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20015c280 con 0x7fe20015a620 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.307+0000 7fe1ff7fe700 1 --2- 172.21.15.29:0/2355127104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015a620 0x7fe20015d040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40098e0 tx=0x7fe1f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=515f9eaff3d948f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe1feffd700 1 -- 172.21.15.29:0/2355127104 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400b640 con 0x7fe20015a620 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe1feffd700 1 -- 172.21.15.29:0/2355127104 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400b7a0 con 0x7fe20015a620 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe1feffd700 1 -- 172.21.15.29:0/2355127104 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400bb40 con 0x7fe20015a620 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe2067b5700 1 -- 172.21.15.29:0/2355127104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015a620 msgr2=0x7fe20015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe2067b5700 1 --2- 172.21.15.29:0/2355127104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015a620 0x7fe20015d040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40098e0 tx=0x7fe1f40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe2067b5700 1 -- 172.21.15.29:0/2355127104 shutdown_connections 2023-10-08T15:40:51.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe2067b5700 1 --2- 172.21.15.29:0/2355127104 >> v2:172.21.15.183:3300/0 conn(0x7fe20015d580 0x7fe200158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe2067b5700 1 --2- 172.21.15.29:0/2355127104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015a620 0x7fe20015d040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe2067b5700 1 -- 172.21.15.29:0/2355127104 >> 172.21.15.29:0/2355127104 conn(0x7fe200068ce0 msgr2=0x7fe2000690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:51.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe2067b5700 1 -- 172.21.15.29:0/2355127104 shutdown_connections 2023-10-08T15:40:51.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.308+0000 7fe2067b5700 1 -- 172.21.15.29:0/2355127104 wait complete. 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.309+0000 7fe2067b5700 1 Processor -- start 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.309+0000 7fe2067b5700 1 -- start start 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe2067b5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe200157870 0x7fe20016b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe2067b5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe20015a620 0x7fe200155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe2067b5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015d580 0x7fe200151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe2067b5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20014e130 con 0x7fe200157870 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe2067b5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20016b670 con 0x7fe20015a620 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe2067b5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe200153b60 con 0x7fe20015d580 2023-10-08T15:40:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe200157870 0x7fe20016b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe200157870 0x7fe20016b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45950/0 (socket says 172.21.15.29:45950) 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe1fffff700 1 -- 172.21.15.29:0/297405816 learned_addr learned my addr 172.21.15.29:0/297405816 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe1ff7fe700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe20015a620 0x7fe200155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.310+0000 7fe204d52700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015d580 0x7fe200151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1fffff700 1 -- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015d580 msgr2=0x7fe200151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1fffff700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015d580 0x7fe200151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1fffff700 1 -- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe20015a620 msgr2=0x7fe200155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1fffff700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe20015a620 0x7fe200155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1fffff700 1 -- 172.21.15.29:0/297405816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4009420 con 0x7fe200157870 2023-10-08T15:40:51.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1fffff700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe200157870 0x7fe20016b130 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000c5b0 tx=0x7fe1f0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1e7fff700 1 -- 172.21.15.29:0/297405816 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0005b30 con 0x7fe200157870 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1e7fff700 1 -- 172.21.15.29:0/297405816 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f0005c90 con 0x7fe200157870 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe200155b90 con 0x7fe200157870 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe1e7fff700 1 -- 172.21.15.29:0/297405816 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0007300 con 0x7fe200157870 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.311+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2000d0b20 con 0x7fe200157870 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.312+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20004c3c0 con 0x7fe200157870 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.312+0000 7fe1e7fff700 1 -- 172.21.15.29:0/297405816 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1f001b3b0 con 0x7fe200157870 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.313+0000 7fe1e7fff700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe1ec066f30 0x7fe1ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.313+0000 7fe1e7fff700 1 -- 172.21.15.29:0/297405816 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1f0083a50 con 0x7fe200157870 2023-10-08T15:40:51.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.313+0000 7fe1ff7fe700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe1ec066f30 0x7fe1ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.313+0000 7fe1ff7fe700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe1ec066f30 0x7fe1ec0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe20015aa20 tx=0x7fe1f4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.317+0000 7fe1e7fff700 1 -- 172.21.15.29:0/297405816 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1f0050c20 con 0x7fe200157870 2023-10-08T15:40:51.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.513+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe20015c560 con 0x7fe200157870 2023-10-08T15:40:51.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.513+0000 7fe1e7fff700 1 -- 172.21.15.29:0/297405816 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fe1f0017090 con 0x7fe200157870 2023-10-08T15:40:51.515 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:51.515 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:51.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe1ec066f30 msgr2=0x7fe1ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe1ec066f30 0x7fe1ec0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe20015aa20 tx=0x7fe1f4017000 comp rx=0 tx=0).stop 2023-10-08T15:40:51.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe200157870 msgr2=0x7fe20016b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe200157870 0x7fe20016b130 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000c5b0 tx=0x7fe1f0001070 comp rx=0 tx=0).stop 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 shutdown_connections 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe1ec066f30 0x7fe1ec0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe20015d580 0x7fe200151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe200157870 0x7fe20016b130 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 --2- 172.21.15.29:0/297405816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe20015a620 0x7fe200155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 >> 172.21.15.29:0/297405816 conn(0x7fe200068ce0 msgr2=0x7fe20015aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 shutdown_connections 2023-10-08T15:40:51.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.516+0000 7fe2067b5700 1 -- 172.21.15.29:0/297405816 wait complete. 2023-10-08T15:40:51.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:40:20.956808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:40:22.081738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:51.530 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:51.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.650+0000 7f1c8f69f700 1 Processor -- start 2023-10-08T15:40:51.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.650+0000 7f1c8f69f700 1 -- start start 2023-10-08T15:40:51.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8f69f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1c8815a290 0x7f1c8806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8f69f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c880b0790 con 0x7f1c88159ec0 2023-10-08T15:40:51.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8f69f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8806af20 con 0x7f1c8806aae0 2023-10-08T15:40:51.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8f69f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c880ce1f0 con 0x7f1c8815a290 2023-10-08T15:40:51.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8cc3a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1c8815a290 0x7f1c8806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8d43b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1c88159ec0 0x7f1c880af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56268/0 (socket says 172.21.15.29:56268) 2023-10-08T15:40:51.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8d43b700 1 -- 172.21.15.29:0/537345581 learned_addr learned my addr 172.21.15.29:0/537345581 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:51.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8cc3a700 1 -- 172.21.15.29:0/537345581 >> v1:172.21.15.183:6789/0 conn(0x7f1c8806aae0 legacy=0x7f1c880cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.651+0000 7f1c8cc3a700 1 -- 172.21.15.29:0/537345581 >> v1:172.21.15.29:6789/0 conn(0x7f1c88159ec0 legacy=0x7f1c880af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c87fff700 1 -- 172.21.15.29:0/537345581 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844931784 0 0) 0x7f1c880b0790 con 0x7f1c88159ec0 2023-10-08T15:40:51.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8cc3a700 1 -- 172.21.15.29:0/537345581 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880b0b20 con 0x7f1c8815a290 2023-10-08T15:40:51.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8cc3a700 1 --2- 172.21.15.29:0/537345581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c8806a5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0098e0 tx=0x7f1c7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20105dd1a4bdf73f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c87fff700 1 -- 172.21.15.29:0/537345581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c009e80 con 0x7f1c8815a290 2023-10-08T15:40:51.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c87fff700 1 -- 172.21.15.29:0/537345581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c00b860 con 0x7f1c8815a290 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c87fff700 1 -- 172.21.15.29:0/537345581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c00bbe0 con 0x7f1c8815a290 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8f69f700 1 -- 172.21.15.29:0/537345581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 msgr2=0x7f1c8806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8f69f700 1 --2- 172.21.15.29:0/537345581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c8806a5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0098e0 tx=0x7f1c7c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8f69f700 1 -- 172.21.15.29:0/537345581 shutdown_connections 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8f69f700 1 --2- 172.21.15.29:0/537345581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c8806a5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8f69f700 1 -- 172.21.15.29:0/537345581 >> 172.21.15.29:0/537345581 conn(0x7f1c880d1880 msgr2=0x7f1c880cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8f69f700 1 -- 172.21.15.29:0/537345581 shutdown_connections 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.652+0000 7f1c8f69f700 1 -- 172.21.15.29:0/537345581 wait complete. 2023-10-08T15:40:51.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.654+0000 7f1c8f69f700 1 Processor -- start 2023-10-08T15:40:51.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.654+0000 7f1c8f69f700 1 -- start start 2023-10-08T15:40:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.654+0000 7f1c8f69f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c8806aae0 0x7f1c8815db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.654+0000 7f1c8f69f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c88159ec0 0x7f1c8815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.654+0000 7f1c8f69f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c880b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.654+0000 7f1c8f69f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880b5a80 con 0x7f1c8815a290 2023-10-08T15:40:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.654+0000 7f1c8f69f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8815ecb0 con 0x7f1c88159ec0 2023-10-08T15:40:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.654+0000 7f1c8f69f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8815e250 con 0x7f1c8806aae0 2023-10-08T15:40:51.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c880b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c880b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45966/0 (socket says 172.21.15.29:45966) 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 -- 172.21.15.29:0/3843368088 learned_addr learned my addr 172.21.15.29:0/3843368088 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8cc3a700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c88159ec0 0x7f1c8815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8d43b700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c8806aae0 0x7f1c8815db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 -- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c8806aae0 msgr2=0x7f1c8815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c8806aae0 0x7f1c8815db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 -- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c88159ec0 msgr2=0x7f1c8815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c88159ec0 0x7f1c8815e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 -- 172.21.15.29:0/3843368088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c009420 con 0x7f1c8815a290 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8dc3c700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c880b4ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c590 tx=0x7f1c78007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c857fa700 1 -- 172.21.15.29:0/3843368088 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78011590 con 0x7f1c8815a290 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c857fa700 1 -- 172.21.15.29:0/3843368088 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c780116f0 con 0x7f1c8815a290 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c880b5500 con 0x7f1c8815a290 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c857fa700 1 -- 172.21.15.29:0/3843368088 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78011ab0 con 0x7f1c8815a290 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.655+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8815a7b0 con 0x7f1c8815a290 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.656+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c88089db0 con 0x7f1c8815a290 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.657+0000 7f1c857fa700 1 -- 172.21.15.29:0/3843368088 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c7801b3b0 con 0x7f1c8815a290 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.657+0000 7f1c857fa700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c74066f30 0x7f1c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.657+0000 7f1c857fa700 1 -- 172.21.15.29:0/3843368088 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c780838f0 con 0x7f1c8815a290 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.657+0000 7f1c8d43b700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c74066f30 0x7f1c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.658+0000 7f1c8d43b700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c74066f30 0x7f1c740693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1c80002250 tx=0x7f1c80001a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.661+0000 7f1c857fa700 1 -- 172.21.15.29:0/3843368088 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c78050b60 con 0x7f1c8815a290 2023-10-08T15:40:51.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.852+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c8804c3c0 con 0x7f1c8815a290 2023-10-08T15:40:51.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.852+0000 7f1c857fa700 1 -- 172.21.15.29:0/3843368088 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c78017070 con 0x7f1c8815a290 2023-10-08T15:40:51.854 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:51.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c74066f30 msgr2=0x7f1c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c74066f30 0x7f1c740693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1c80002250 tx=0x7f1c80001a00 comp rx=0 tx=0).stop 2023-10-08T15:40:51.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 msgr2=0x7f1c880b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c880b4ae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c590 tx=0x7f1c78007ef0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 shutdown_connections 2023-10-08T15:40:51.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1c74066f30 0x7f1c740693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c8815a290 0x7f1c880b4ae0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c8806aae0 0x7f1c8815db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 --2- 172.21.15.29:0/3843368088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c88159ec0 0x7f1c8815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 >> 172.21.15.29:0/3843368088 conn(0x7f1c880d1880 msgr2=0x7f1c880c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:51.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 shutdown_connections 2023-10-08T15:40:51.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.854+0000 7f1c8f69f700 1 -- 172.21.15.29:0/3843368088 wait complete. 2023-10-08T15:40:51.868 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:51.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.987+0000 7fad02bfa700 1 Processor -- start 2023-10-08T15:40:51.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.988+0000 7fad02bfa700 1 -- start start 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.988+0000 7fad02bfa700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7facfc0678b0 0x7facfc15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.988+0000 7fad02bfa700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0c9390 0x7facfc15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.988+0000 7fad02bfa700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facfc0cae70 con 0x7facfc0cbf10 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.988+0000 7fad02bfa700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0cb150 con 0x7facfc0678b0 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.988+0000 7fad02bfa700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0cb430 con 0x7facfc0c9390 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7facfbfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7facfc0cbf10 0x7facfc15e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56282/0 (socket says 172.21.15.29:56282) 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7facfbfff700 1 -- 172.21.15.29:0/1305728346 learned_addr learned my addr 172.21.15.29:0/1305728346 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7fad01197700 1 --2- 172.21.15.29:0/1305728346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0c9390 0x7facfc15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7fad00996700 1 --2- 172.21.15.29:0/1305728346 >> v2:172.21.15.183:3300/0 conn(0x7facfc0678b0 0x7facfc15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7facfb7fe700 1 -- 172.21.15.29:0/1305728346 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257047373 0 0) 0x7facfc0cae70 con 0x7facfc0cbf10 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7facfb7fe700 1 -- 172.21.15.29:0/1305728346 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face8003570 con 0x7facfc0cbf10 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7fad00996700 1 -- 172.21.15.29:0/1305728346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0c9390 msgr2=0x7facfc15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7fad00996700 1 --2- 172.21.15.29:0/1305728346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0c9390 0x7facfc15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7fad00996700 1 -- 172.21.15.29:0/1305728346 >> v1:172.21.15.29:6789/0 conn(0x7facfc0cbf10 legacy=0x7facfc15e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7fad00996700 1 -- 172.21.15.29:0/1305728346 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0cb710 con 0x7facfc0678b0 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7fad00996700 1 --2- 172.21.15.29:0/1305728346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0678b0 0x7facfc15db80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7facf4009e60 tx=0x7facf4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a89cb426ed88811 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7facfb7fe700 1 -- 172.21.15.29:0/1305728346 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400e070 con 0x7facfc0678b0 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7facfb7fe700 1 -- 172.21.15.29:0/1305728346 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf400bab0 con 0x7facfc0678b0 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.989+0000 7facfb7fe700 1 -- 172.21.15.29:0/1305728346 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400be30 con 0x7facfc0678b0 2023-10-08T15:40:51.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.990+0000 7fad02bfa700 1 -- 172.21.15.29:0/1305728346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0678b0 msgr2=0x7facfc15db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.990+0000 7fad02bfa700 1 --2- 172.21.15.29:0/1305728346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0678b0 0x7facfc15db80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7facf4009e60 tx=0x7facf4009780 comp rx=0 tx=0).stop 2023-10-08T15:40:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.990+0000 7fad02bfa700 1 -- 172.21.15.29:0/1305728346 shutdown_connections 2023-10-08T15:40:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.990+0000 7fad02bfa700 1 --2- 172.21.15.29:0/1305728346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0c9390 0x7facfc15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.990+0000 7fad02bfa700 1 --2- 172.21.15.29:0/1305728346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0678b0 0x7facfc15db80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.990+0000 7fad02bfa700 1 -- 172.21.15.29:0/1305728346 >> 172.21.15.29:0/1305728346 conn(0x7facfc069870 msgr2=0x7facfc069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.990+0000 7fad02bfa700 1 -- 172.21.15.29:0/1305728346 shutdown_connections 2023-10-08T15:40:51.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.990+0000 7fad02bfa700 1 -- 172.21.15.29:0/1305728346 wait complete. 2023-10-08T15:40:51.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.991+0000 7fad02bfa700 1 Processor -- start 2023-10-08T15:40:51.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.991+0000 7fad02bfa700 1 -- start start 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad02bfa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facfc0678b0 0x7facfc15ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad02bfa700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0c9390 0x7facfc0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad02bfa700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0cbf10 0x7facfc0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad02bfa700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0c8630 con 0x7facfc0678b0 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad02bfa700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc150830 con 0x7facfc0c9390 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad02bfa700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0c7a20 con 0x7facfc0cbf10 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad00996700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facfc0678b0 0x7facfc15ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad00996700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facfc0678b0 0x7facfc15ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45974/0 (socket says 172.21.15.29:45974) 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad00996700 1 -- 172.21.15.29:0/3688673558 learned_addr learned my addr 172.21.15.29:0/3688673558 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7facfbfff700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0c9390 0x7facfc0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad01197700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0cbf10 0x7facfc0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad00996700 1 -- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0cbf10 msgr2=0x7facfc0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad00996700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0cbf10 0x7facfc0c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad00996700 1 -- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0c9390 msgr2=0x7facfc0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad00996700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0c9390 0x7facfc0c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.992+0000 7fad00996700 1 -- 172.21.15.29:0/3688673558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4009a20 con 0x7facfc0678b0 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.993+0000 7fad00996700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facfc0678b0 0x7facfc15ed70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facf40097c0 tx=0x7facf4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.993+0000 7facf8ff9700 1 -- 172.21.15.29:0/3688673558 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4012d00 con 0x7facfc0678b0 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.993+0000 7facf8ff9700 1 -- 172.21.15.29:0/3688673558 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4012e80 con 0x7facfc0678b0 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.993+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc0c7d00 con 0x7facfc0678b0 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.993+0000 7facf8ff9700 1 -- 172.21.15.29:0/3688673558 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf40276c0 con 0x7facfc0678b0 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.993+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc0c82c0 con 0x7facfc0678b0 2023-10-08T15:40:51.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.994+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc04c3c0 con 0x7facfc0678b0 2023-10-08T15:40:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.994+0000 7facf8ff9700 1 -- 172.21.15.29:0/3688673558 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facf4024070 con 0x7facfc0678b0 2023-10-08T15:40:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.994+0000 7facf8ff9700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7facdc066f30 0x7facdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.995+0000 7facf8ff9700 1 -- 172.21.15.29:0/3688673558 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7facf4086bf0 con 0x7facfc0678b0 2023-10-08T15:40:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.995+0000 7facfbfff700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7facdc066f30 0x7facdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:51.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.995+0000 7facfbfff700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7facdc066f30 0x7facdc0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7facfc16d5d0 tx=0x7facec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:51.999+0000 7facf8ff9700 1 -- 172.21.15.29:0/3688673558 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facf4053e60 con 0x7facfc0678b0 2023-10-08T15:40:52.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.189+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facfc0c8910 con 0x7facfc0678b0 2023-10-08T15:40:52.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.190+0000 7facf8ff9700 1 -- 172.21.15.29:0/3688673558 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7facf402c020 con 0x7facfc0678b0 2023-10-08T15:40:52.191 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:40:52.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7facdc066f30 msgr2=0x7facdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7facdc066f30 0x7facdc0693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7facfc16d5d0 tx=0x7facec009040 comp rx=0 tx=0).stop 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facfc0678b0 msgr2=0x7facfc15ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facfc0678b0 0x7facfc15ed70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facf40097c0 tx=0x7facf4019000 comp rx=0 tx=0).stop 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 shutdown_connections 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7facdc066f30 0x7facdc0693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facfc0cbf10 0x7facfc0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facfc0678b0 0x7facfc15ed70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 --2- 172.21.15.29:0/3688673558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facfc0c9390 0x7facfc0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 >> 172.21.15.29:0/3688673558 conn(0x7facfc069870 msgr2=0x7facfc0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 shutdown_connections 2023-10-08T15:40:52.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.192+0000 7fad02bfa700 1 -- 172.21.15.29:0/3688673558 wait complete. 2023-10-08T15:40:52.205 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:52.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.325+0000 7fdce03e5700 1 Processor -- start 2023-10-08T15:40:52.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.325+0000 7fdce03e5700 1 -- start start 2023-10-08T15:40:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.326+0000 7fdce03e5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdcd8152300 0x7fdcd815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.326+0000 7fdce03e5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdcd8158df0 0x7fdcd80caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.326+0000 7fdce03e5700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd815c8d0 con 0x7fdcd806d370 2023-10-08T15:40:52.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.326+0000 7fdce03e5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd80b1400 con 0x7fdcd8152300 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.326+0000 7fdce03e5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd80c9370 con 0x7fdcd8158df0 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcde181700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdcd8152300 0x7fdcd815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcde181700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdcd8152300 0x7fdcd815b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45990/0 (socket says 172.21.15.29:45990) 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcde181700 1 -- 172.21.15.29:0/2057931175 learned_addr learned my addr 172.21.15.29:0/2057931175 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcdd980700 1 --2- 172.21.15.29:0/2057931175 >> v2:172.21.15.183:3300/0 conn(0x7fdcd8158df0 0x7fdcd80caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcde181700 1 -- 172.21.15.29:0/2057931175 >> v2:172.21.15.183:3300/0 conn(0x7fdcd8158df0 msgr2=0x7fdcd80caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcde181700 1 --2- 172.21.15.29:0/2057931175 >> v2:172.21.15.183:3300/0 conn(0x7fdcd8158df0 0x7fdcd80caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcde181700 1 -- 172.21.15.29:0/2057931175 >> v1:172.21.15.183:6789/0 conn(0x7fdcd806d370 legacy=0x7fdcd806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcde181700 1 -- 172.21.15.29:0/2057931175 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd815c030 con 0x7fdcd8152300 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcde181700 1 --2- 172.21.15.29:0/2057931175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd815b9a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdcd806e8d0 tx=0x7fdcd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8b950a399de1d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcdd17f700 1 -- 172.21.15.29:0/2057931175 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000b820 con 0x7fdcd8152300 2023-10-08T15:40:52.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcdd17f700 1 -- 172.21.15.29:0/2057931175 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000b980 con 0x7fdcd8152300 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.327+0000 7fdcdd17f700 1 -- 172.21.15.29:0/2057931175 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000bd20 con 0x7fdcd8152300 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.328+0000 7fdce03e5700 1 -- 172.21.15.29:0/2057931175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 msgr2=0x7fdcd815b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.328+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2057931175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd815b9a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdcd806e8d0 tx=0x7fdcd0009250 comp rx=0 tx=0).stop 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.328+0000 7fdce03e5700 1 -- 172.21.15.29:0/2057931175 shutdown_connections 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.328+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2057931175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd815b9a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.328+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2057931175 >> v2:172.21.15.183:3300/0 conn(0x7fdcd8158df0 0x7fdcd80caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.328+0000 7fdce03e5700 1 -- 172.21.15.29:0/2057931175 >> 172.21.15.29:0/2057931175 conn(0x7fdcd8069870 msgr2=0x7fdcd8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.328+0000 7fdce03e5700 1 -- 172.21.15.29:0/2057931175 shutdown_connections 2023-10-08T15:40:52.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.328+0000 7fdce03e5700 1 -- 172.21.15.29:0/2057931175 wait complete. 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.329+0000 7fdce03e5700 1 Processor -- start 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.329+0000 7fdce03e5700 1 -- start start 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdce03e5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806d370 0x7fdcd80c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdce03e5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd81504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdce03e5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd8158df0 0x7fdcd80c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdce03e5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd80c6640 con 0x7fdcd8152300 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdce03e5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd80c5d50 con 0x7fdcd8158df0 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdce03e5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd80c5ff0 con 0x7fdcd806d370 2023-10-08T15:40:52.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd81504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd81504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45994/0 (socket says 172.21.15.29:45994) 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 -- 172.21.15.29:0/2211623973 learned_addr learned my addr 172.21.15.29:0/2211623973 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcde181700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806d370 0x7fdcd80c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcde982700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd8158df0 0x7fdcd80c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 -- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806d370 msgr2=0x7fdcd80c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806d370 0x7fdcd80c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 -- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd8158df0 msgr2=0x7fdcd80c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd8158df0 0x7fdcd80c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 -- 172.21.15.29:0/2211623973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00094f0 con 0x7fdcd8152300 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcde181700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806d370 0x7fdcd80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcde982700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd8158df0 0x7fdcd80c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcdd980700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd81504b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00c880 tx=0x7fdccc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcd67fc700 1 -- 172.21.15.29:0/2211623973 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc011600 con 0x7fdcd8152300 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcd67fc700 1 -- 172.21.15.29:0/2211623973 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc011780 con 0x7fdcd8152300 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd80c62d0 con 0x7fdcd8152300 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdcd67fc700 1 -- 172.21.15.29:0/2211623973 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc011b40 con 0x7fdcd8152300 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.330+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd80c7f40 con 0x7fdcd8152300 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.331+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd81509f0 con 0x7fdcd8152300 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.332+0000 7fdcd67fc700 1 -- 172.21.15.29:0/2211623973 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdccc018360 con 0x7fdcd8152300 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.332+0000 7fdcd67fc700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdcc4066f30 0x7fdcc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.332+0000 7fdcd67fc700 1 -- 172.21.15.29:0/2211623973 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdccc084270 con 0x7fdcd8152300 2023-10-08T15:40:52.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.332+0000 7fdcde181700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdcc4066f30 0x7fdcc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.333+0000 7fdcde181700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdcc4066f30 0x7fdcc40693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdcd806e8d0 tx=0x7fdcd0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.336+0000 7fdcd67fc700 1 -- 172.21.15.29:0/2211623973 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdccc054f70 con 0x7fdcd8152300 2023-10-08T15:40:52.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.527+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdcd804c3c0 con 0x7fdcd8152300 2023-10-08T15:40:52.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.528+0000 7fdcd67fc700 1 -- 172.21.15.29:0/2211623973 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdccc054b00 con 0x7fdcd8152300 2023-10-08T15:40:52.530 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:40:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdcc4066f30 msgr2=0x7fdcc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdcc4066f30 0x7fdcc40693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdcd806e8d0 tx=0x7fdcd0016000 comp rx=0 tx=0).stop 2023-10-08T15:40:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 msgr2=0x7fdcd81504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd81504b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00c880 tx=0x7fdccc008040 comp rx=0 tx=0).stop 2023-10-08T15:40:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 shutdown_connections 2023-10-08T15:40:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdcc4066f30 0x7fdcc40693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd8158df0 0x7fdcd80c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806d370 0x7fdcd80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 --2- 172.21.15.29:0/2211623973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcd8152300 0x7fdcd81504b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 >> 172.21.15.29:0/2211623973 conn(0x7fdcd8069870 msgr2=0x7fdcd80cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 shutdown_connections 2023-10-08T15:40:52.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.530+0000 7fdce03e5700 1 -- 172.21.15.29:0/2211623973 wait complete. 2023-10-08T15:40:52.544 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:52.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.661+0000 7fdfda23d700 1 Processor -- start 2023-10-08T15:40:52.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.661+0000 7fdfda23d700 1 -- start start 2023-10-08T15:40:52.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfda23d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd4157c40 0x7fdfd4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfda23d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd415cbb0 con 0x7fdfd4157870 2023-10-08T15:40:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfda23d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd415bfa0 con 0x7fdfd415a620 2023-10-08T15:40:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfda23d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd415bdb0 con 0x7fdfd4157c40 2023-10-08T15:40:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd37fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdfd4157870 0x7fdfd415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56298/0 (socket says 172.21.15.29:56298) 2023-10-08T15:40:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd37fe700 1 -- 172.21.15.29:0/2652362466 learned_addr learned my addr 172.21.15.29:0/2652362466 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544821789 0 0) 0x7fdfd415cbb0 con 0x7fdfd4157870 2023-10-08T15:40:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfbc003570 con 0x7fdfd4157870 2023-10-08T15:40:52.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd3fff700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd4157c40 0x7fdfd4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 162255796 0 0) 0x7fdfbc003570 con 0x7fdfd4157870 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd4157c40 msgr2=0x7fdfd4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd27fc700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd4157c40 0x7fdfd4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.662+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 >> v1:172.21.15.183:6789/0 conn(0x7fdfd415a620 legacy=0x7fdfd415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd415c280 con 0x7fdfd4157870 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fdfc4001470 con 0x7fdfd4157870 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 >> v1:172.21.15.29:6789/0 conn(0x7fdfd4157870 legacy=0x7fdfd415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd4157c40 0x7fdfbc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc004010 0x7fdfbc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfbc004d50 0x7fdfbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc00bbf0 con 0x7fdfbc004d50 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc00bd30 con 0x7fdfbc004010 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc00bef0 con 0x7fdfd4157c40 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd3fff700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfbc004d50 0x7fdfbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd37fe700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd4157c40 0x7fdfbc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd2ffd700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc004010 0x7fdfbc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd3fff700 1 -- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd4157c40 msgr2=0x7fdfbc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd3fff700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd4157c40 0x7fdfbc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd3fff700 1 -- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc004010 msgr2=0x7fdfbc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd3fff700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc004010 0x7fdfbc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd3fff700 1 -- 172.21.15.29:0/2652362466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc003570 con 0x7fdfbc004d50 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd3fff700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfbc004d50 0x7fdfbc0051c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0094d0 tx=0x7fdfcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e943597d6446d82f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00ea60 con 0x7fdfbc004d50 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00f040 con 0x7fdfbc004d50 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.663+0000 7fdfd27fc700 1 -- 172.21.15.29:0/2652362466 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00edf0 con 0x7fdfbc004d50 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.664+0000 7fdfda23d700 1 -- 172.21.15.29:0/2652362466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfbc004d50 msgr2=0x7fdfbc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.664+0000 7fdfda23d700 1 --2- 172.21.15.29:0/2652362466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfbc004d50 0x7fdfbc0051c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0094d0 tx=0x7fdfcc00b040 comp rx=0 tx=0).stop 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.664+0000 7fdfd3fff700 1 -- 172.21.15.29:0/2652362466 reap_dead start 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.664+0000 7fdfda23d700 1 -- 172.21.15.29:0/2652362466 shutdown_connections 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.664+0000 7fdfda23d700 1 -- 172.21.15.29:0/2652362466 >> 172.21.15.29:0/2652362466 conn(0x7fdfd4068ce0 msgr2=0x7fdfd40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.664+0000 7fdfda23d700 1 -- 172.21.15.29:0/2652362466 shutdown_connections 2023-10-08T15:40:52.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.664+0000 7fdfda23d700 1 -- 172.21.15.29:0/2652362466 wait complete. 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.665+0000 7fdfda23d700 1 Processor -- start 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.665+0000 7fdfda23d700 1 -- start start 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfda23d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd414b8d0 0x7fdfd40b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfda23d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd40b3320 0x7fdfd4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfda23d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd414bca0 0x7fdfd4153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfda23d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40b2230 con 0x7fdfd40b3320 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfda23d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd414e630 con 0x7fdfd414bca0 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfda23d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd414e320 con 0x7fdfd414b8d0 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd40b3320 0x7fdfd4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd40b3320 0x7fdfd4152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46024/0 (socket says 172.21.15.29:46024) 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd2ffd700 1 -- 172.21.15.29:0/1454966515 learned_addr learned my addr 172.21.15.29:0/1454966515 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:52.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd37fe700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd414b8d0 0x7fdfd40b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd3fff700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd414bca0 0x7fdfd4153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd2ffd700 1 -- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd414b8d0 msgr2=0x7fdfd40b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd2ffd700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd414b8d0 0x7fdfd40b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd2ffd700 1 -- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd414bca0 msgr2=0x7fdfd4153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd2ffd700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd414bca0 0x7fdfd4153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd2ffd700 1 -- 172.21.15.29:0/1454966515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40b1990 con 0x7fdfd40b3320 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.666+0000 7fdfd3fff700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd414bca0 0x7fdfd4153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.667+0000 7fdfd2ffd700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd40b3320 0x7fdfd4152b20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8002920 tx=0x7fdfc8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.667+0000 7fdfbb7fe700 1 -- 172.21.15.29:0/1454966515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800f730 con 0x7fdfd40b3320 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.667+0000 7fdfbb7fe700 1 -- 172.21.15.29:0/1454966515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc800f890 con 0x7fdfd40b3320 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.667+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd40b1c70 con 0x7fdfd40b3320 2023-10-08T15:40:52.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.667+0000 7fdfbb7fe700 1 -- 172.21.15.29:0/1454966515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800fc30 con 0x7fdfd40b3320 2023-10-08T15:40:52.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.667+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd40b1560 con 0x7fdfd40b3320 2023-10-08T15:40:52.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.668+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd414e7c0 con 0x7fdfd40b3320 2023-10-08T15:40:52.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.668+0000 7fdfbb7fe700 1 -- 172.21.15.29:0/1454966515 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfc80133f0 con 0x7fdfd40b3320 2023-10-08T15:40:52.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.669+0000 7fdfbb7fe700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdfc0066f30 0x7fdfc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:52.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.669+0000 7fdfbb7fe700 1 -- 172.21.15.29:0/1454966515 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfc80842d0 con 0x7fdfd40b3320 2023-10-08T15:40:52.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.669+0000 7fdfd37fe700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdfc0066f30 0x7fdfc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:52.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.669+0000 7fdfd37fe700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdfc0066f30 0x7fdfc00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4001050 tx=0x7fdfc4001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:52.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.673+0000 7fdfbb7fe700 1 -- 172.21.15.29:0/1454966515 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfc8051540 con 0x7fdfd40b3320 2023-10-08T15:40:52.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.866+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfd404c3c0 con 0x7fdfd40b3320 2023-10-08T15:40:52.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.867+0000 7fdfbb7fe700 1 -- 172.21.15.29:0/1454966515 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fdfc8054b60 con 0x7fdfd40b3320 2023-10-08T15:40:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:52.869 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdfc0066f30 msgr2=0x7fdfc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdfc0066f30 0x7fdfc00693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4001050 tx=0x7fdfc4001e50 comp rx=0 tx=0).stop 2023-10-08T15:40:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd40b3320 msgr2=0x7fdfd4152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd40b3320 0x7fdfd4152b20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8002920 tx=0x7fdfc8007d30 comp rx=0 tx=0).stop 2023-10-08T15:40:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 shutdown_connections 2023-10-08T15:40:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdfc0066f30 0x7fdfc00693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd414bca0 0x7fdfd4153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd414b8d0 0x7fdfd40b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 --2- 172.21.15.29:0/1454966515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdfd40b3320 0x7fdfd4152b20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:52.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 >> 172.21.15.29:0/1454966515 conn(0x7fdfd4068ce0 msgr2=0x7fdfd40b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:52.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 shutdown_connections 2023-10-08T15:40:52.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:52.869+0000 7fdfda23d700 1 -- 172.21.15.29:0/1454966515 wait complete. 2023-10-08T15:40:52.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:40:20.956808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:40:22.081738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:52.883 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:53.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.003+0000 7fedd3de8700 1 Processor -- start 2023-10-08T15:40:53.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.003+0000 7fedd3de8700 1 -- start start 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd3de8700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fedcc0b3570 0x7fedcc15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd3de8700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedcc0b14f0 con 0x7fedcc0b4860 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd3de8700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedcc0b17d0 con 0x7fedcc0b4c30 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd3de8700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc0b1ab0 con 0x7fedcc0b3570 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd1b84700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fedcc0b4860 0x7fedcc159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56304/0 (socket says 172.21.15.29:56304) 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd1b84700 1 -- 172.21.15.29:0/3831552823 learned_addr learned my addr 172.21.15.29:0/3831552823 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562010342 0 0) 0x7fedcc0b14f0 con 0x7fedcc0b4860 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd1383700 1 --2- 172.21.15.29:0/3831552823 >> v2:172.21.15.183:3300/0 conn(0x7fedcc0b3570 0x7fedcc15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb4003570 con 0x7fedcc0b4860 2023-10-08T15:40:53.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 65255115 0 0) 0x7fedb4003570 con 0x7fedcc0b4860 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 >> v2:172.21.15.183:3300/0 conn(0x7fedcc0b3570 msgr2=0x7fedcc15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 --2- 172.21.15.29:0/3831552823 >> v2:172.21.15.183:3300/0 conn(0x7fedcc0b3570 0x7fedcc15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 >> v1:172.21.15.183:6789/0 conn(0x7fedcc0b4c30 legacy=0x7fedcc0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0b1d90 con 0x7fedcc0b4860 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fedc40015f0 con 0x7fedcc0b4860 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 >> v1:172.21.15.29:6789/0 conn(0x7fedcc0b4860 legacy=0x7fedcc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb4003a60 0x7fedb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb4004810 0x7fedb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedb40051c0 0x7fedb400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.004+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc0b1ab0 con 0x7fedb40051c0 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb400c0d0 con 0x7fedb4004810 2023-10-08T15:40:53.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb400c290 con 0x7fedb4003a60 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd2385700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedb40051c0 0x7fedb400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd1b84700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb4003a60 0x7fedb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd1383700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb4004810 0x7fedb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd2385700 1 -- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb4003a60 msgr2=0x7fedb4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd2385700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb4003a60 0x7fedb4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd2385700 1 -- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb4004810 msgr2=0x7fedb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd2385700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb4004810 0x7fedb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd2385700 1 -- 172.21.15.29:0/3831552823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4003570 con 0x7fedb40051c0 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd1383700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedb4004810 0x7fedb4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd1b84700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb4003a60 0x7fedb4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd2385700 1 -- 172.21.15.29:0/3831552823 reap_dead start 2023-10-08T15:40:53.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd2385700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedb40051c0 0x7fedb400ba60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fedbc001fc0 tx=0x7fedbc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafe667d1bfe53b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc001950 con 0x7fedb40051c0 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc00c8b0 con 0x7fedb40051c0 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.005+0000 7fedd0b82700 1 -- 172.21.15.29:0/3831552823 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc00cc50 con 0x7fedb40051c0 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.006+0000 7fedd3de8700 1 -- 172.21.15.29:0/3831552823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedb40051c0 msgr2=0x7fedb400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.006+0000 7fedd3de8700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedb40051c0 0x7fedb400ba60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fedbc001fc0 tx=0x7fedbc001640 comp rx=0 tx=0).stop 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.006+0000 7fedd3de8700 1 -- 172.21.15.29:0/3831552823 shutdown_connections 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.006+0000 7fedd3de8700 1 --2- 172.21.15.29:0/3831552823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedb40051c0 0x7fedb400ba60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.006+0000 7fedd3de8700 1 -- 172.21.15.29:0/3831552823 >> 172.21.15.29:0/3831552823 conn(0x7fedcc09a0f0 msgr2=0x7fedcc067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.006+0000 7fedd3de8700 1 -- 172.21.15.29:0/3831552823 shutdown_connections 2023-10-08T15:40:53.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.006+0000 7fedd3de8700 1 -- 172.21.15.29:0/3831552823 wait complete. 2023-10-08T15:40:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.007+0000 7fedd3de8700 1 Processor -- start 2023-10-08T15:40:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.007+0000 7fedd3de8700 1 -- start start 2023-10-08T15:40:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd3de8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb40051c0 0x7fedcc14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd3de8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedcc156600 0x7fedcc15fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd3de8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc153500 0x7fedcc153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd3de8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1532f0 con 0x7fedcc156600 2023-10-08T15:40:53.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd3de8700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc153ea0 con 0x7fedcc153500 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd3de8700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc150a70 con 0x7fedb40051c0 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedcc156600 0x7fedcc15fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedcc156600 0x7fedcc15fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46044/0 (socket says 172.21.15.29:46044) 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 -- 172.21.15.29:0/1954653532 learned_addr learned my addr 172.21.15.29:0/1954653532 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1b84700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb40051c0 0x7fedcc14ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd2385700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc153500 0x7fedcc153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 -- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb40051c0 msgr2=0x7fedcc14ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb40051c0 0x7fedcc14ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 -- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc153500 msgr2=0x7fedcc153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc153500 0x7fedcc153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 -- 172.21.15.29:0/1954653532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc14f3a0 con 0x7fedcc156600 2023-10-08T15:40:53.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1b84700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb40051c0 0x7fedcc14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd1383700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedcc156600 0x7fedcc15fad0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009fd0 tx=0x7fedc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedc9ffb700 1 -- 172.21.15.29:0/1954653532 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0015740 con 0x7fedcc156600 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedc9ffb700 1 -- 172.21.15.29:0/1954653532 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc00158a0 con 0x7fedcc156600 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedc9ffb700 1 -- 172.21.15.29:0/1954653532 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0015c40 con 0x7fedcc156600 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.008+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc1603d0 con 0x7fedcc156600 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.009+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc150d10 con 0x7fedcc156600 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.010+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc04c3c0 con 0x7fedcc156600 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.010+0000 7fedc9ffb700 1 -- 172.21.15.29:0/1954653532 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fedc0013410 con 0x7fedcc156600 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.010+0000 7fedc9ffb700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedb8066f30 0x7fedb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.011+0000 7fedc9ffb700 1 -- 172.21.15.29:0/1954653532 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedc0084cb0 con 0x7fedcc156600 2023-10-08T15:40:53.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.011+0000 7fedd1b84700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedb8066f30 0x7fedb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.011+0000 7fedd1b84700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedb8066f30 0x7fedb80693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fedcc15b760 tx=0x7fedc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.015+0000 7fedc9ffb700 1 -- 172.21.15.29:0/1954653532 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedc0051e80 con 0x7fedcc156600 2023-10-08T15:40:53.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.205+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedcc15d990 con 0x7fedcc156600 2023-10-08T15:40:53.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.205+0000 7fedc9ffb700 1 -- 172.21.15.29:0/1954653532 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedc00554a0 con 0x7fedcc156600 2023-10-08T15:40:53.207 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:53.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedb8066f30 msgr2=0x7fedb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedb8066f30 0x7fedb80693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fedcc15b760 tx=0x7fedc4009040 comp rx=0 tx=0).stop 2023-10-08T15:40:53.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedcc156600 msgr2=0x7fedcc15fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedcc156600 0x7fedcc15fad0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009fd0 tx=0x7fedc0008040 comp rx=0 tx=0).stop 2023-10-08T15:40:53.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 shutdown_connections 2023-10-08T15:40:53.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedb8066f30 0x7fedb80693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedcc153500 0x7fedcc153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedb40051c0 0x7fedcc14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 --2- 172.21.15.29:0/1954653532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedcc156600 0x7fedcc15fad0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 >> 172.21.15.29:0/1954653532 conn(0x7fedcc09a0f0 msgr2=0x7fedcc15c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 shutdown_connections 2023-10-08T15:40:53.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.207+0000 7fedd3de8700 1 -- 172.21.15.29:0/1954653532 wait complete. 2023-10-08T15:40:53.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:53.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.341+0000 7fb9be0de700 1 Processor -- start 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.341+0000 7fb9be0de700 1 -- start start 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9be0de700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9be0de700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb9b806aa00 0x7fb9b80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9be0de700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b80b4d70 con 0x7fb9b80b6580 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9be0de700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b80cd8d0 con 0x7fb9b806aa00 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9be0de700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80b4440 con 0x7fb9b80cce30 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9bd0dc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9bd8dd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb9b806aa00 0x7fb9b80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9bc8db700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb9b80b6580 0x7fb9b806a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:37348/0 (socket says 172.21.15.29:37348) 2023-10-08T15:40:53.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9bd0dc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b815aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:59720/0 (socket says 172.21.15.29:59720) 2023-10-08T15:40:53.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.342+0000 7fb9bc8db700 1 -- 172.21.15.29:0/1736865486 learned_addr learned my addr 172.21.15.29:0/1736865486 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:53.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9bd0dc700 1 -- 172.21.15.29:0/1736865486 >> v2:172.21.15.183:3300/0 conn(0x7fb9b806aa00 msgr2=0x7fb9b80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:53.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9bd0dc700 1 --2- 172.21.15.29:0/1736865486 >> v2:172.21.15.183:3300/0 conn(0x7fb9b806aa00 0x7fb9b80b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9bd0dc700 1 -- 172.21.15.29:0/1736865486 >> v1:172.21.15.183:6789/0 conn(0x7fb9b80b6580 legacy=0x7fb9b806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9bd0dc700 1 -- 172.21.15.29:0/1736865486 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80b4720 con 0x7fb9b80cce30 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9bd0dc700 1 --2- 172.21.15.29:0/1736865486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b815aca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40098e0 tx=0x7fb9b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403e02db4d642ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9affff700 1 -- 172.21.15.29:0/1736865486 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400b640 con 0x7fb9b80cce30 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9affff700 1 -- 172.21.15.29:0/1736865486 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b400b7a0 con 0x7fb9b80cce30 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9affff700 1 -- 172.21.15.29:0/1736865486 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400bb40 con 0x7fb9b80cce30 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9be0de700 1 -- 172.21.15.29:0/1736865486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 msgr2=0x7fb9b815aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9be0de700 1 --2- 172.21.15.29:0/1736865486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b815aca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40098e0 tx=0x7fb9b40091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9be0de700 1 -- 172.21.15.29:0/1736865486 shutdown_connections 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9be0de700 1 --2- 172.21.15.29:0/1736865486 >> v2:172.21.15.183:3300/0 conn(0x7fb9b806aa00 0x7fb9b80b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.343+0000 7fb9be0de700 1 --2- 172.21.15.29:0/1736865486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b815aca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.344+0000 7fb9be0de700 1 -- 172.21.15.29:0/1736865486 >> 172.21.15.29:0/1736865486 conn(0x7fb9b8068cb0 msgr2=0x7fb9b80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.344+0000 7fb9be0de700 1 -- 172.21.15.29:0/1736865486 shutdown_connections 2023-10-08T15:40:53.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.344+0000 7fb9be0de700 1 -- 172.21.15.29:0/1736865486 wait complete. 2023-10-08T15:40:53.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.345+0000 7fb9be0de700 1 Processor -- start 2023-10-08T15:40:53.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.345+0000 7fb9be0de700 1 -- start start 2023-10-08T15:40:53.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9be0de700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9b806aa00 0x7fb9b81569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9be0de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b80b6580 0x7fb9b8156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9be0de700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b816a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9be0de700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8152910 con 0x7fb9b80b6580 2023-10-08T15:40:53.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9be0de700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b816b060 con 0x7fb9b806aa00 2023-10-08T15:40:53.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9be0de700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b816b340 con 0x7fb9b80cce30 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b80b6580 0x7fb9b8156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bd0dc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9b806aa00 0x7fb9b81569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b80b6580 0x7fb9b8156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46060/0 (socket says 172.21.15.29:46060) 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 -- 172.21.15.29:0/3392999393 learned_addr learned my addr 172.21.15.29:0/3392999393 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bd8dd700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b816a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 -- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 msgr2=0x7fb9b816a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b816a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 -- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9b806aa00 msgr2=0x7fb9b81569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9b806aa00 0x7fb9b81569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 -- 172.21.15.29:0/3392999393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4009420 con 0x7fb9b80b6580 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9bc8db700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b80b6580 0x7fb9b8156f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800c790 tx=0x7fb9a8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9ad7fa700 1 -- 172.21.15.29:0/3392999393 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8005b30 con 0x7fb9b80b6580 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9ad7fa700 1 -- 172.21.15.29:0/3392999393 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a8005cb0 con 0x7fb9b80b6580 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9ad7fa700 1 -- 172.21.15.29:0/3392999393 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8004a80 con 0x7fb9b80b6580 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.346+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b8152b60 con 0x7fb9b80b6580 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.347+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b814f0b0 con 0x7fb9b80b6580 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.347+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b8153080 con 0x7fb9b80b6580 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.348+0000 7fb9ad7fa700 1 -- 172.21.15.29:0/3392999393 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9a80070d0 con 0x7fb9b80b6580 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.348+0000 7fb9ad7fa700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb99c066f30 0x7fb99c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.349+0000 7fb9ad7fa700 1 -- 172.21.15.29:0/3392999393 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9a80837f0 con 0x7fb9b80b6580 2023-10-08T15:40:53.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.349+0000 7fb9bd0dc700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb99c066f30 0x7fb99c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.349+0000 7fb9bd0dc700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb99c066f30 0x7fb99c0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40093f0 tx=0x7fb9b4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.353+0000 7fb9ad7fa700 1 -- 172.21.15.29:0/3392999393 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9a804b5a0 con 0x7fb9b80b6580 2023-10-08T15:40:53.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.544+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9b80b4a00 con 0x7fb9b80b6580 2023-10-08T15:40:53.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.544+0000 7fb9ad7fa700 1 -- 172.21.15.29:0/3392999393 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9b8153080 con 0x7fb9b80b6580 2023-10-08T15:40:53.546 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:40:53.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb99c066f30 msgr2=0x7fb99c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb99c066f30 0x7fb99c0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40093f0 tx=0x7fb9b4017000 comp rx=0 tx=0).stop 2023-10-08T15:40:53.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b80b6580 msgr2=0x7fb9b8156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b80b6580 0x7fb9b8156f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800c790 tx=0x7fb9a8007f40 comp rx=0 tx=0).stop 2023-10-08T15:40:53.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 shutdown_connections 2023-10-08T15:40:53.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb99c066f30 0x7fb99c0693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9b80cce30 0x7fb9b816a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9b806aa00 0x7fb9b81569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 --2- 172.21.15.29:0/3392999393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b80b6580 0x7fb9b8156f20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 >> 172.21.15.29:0/3392999393 conn(0x7fb9b8068cb0 msgr2=0x7fb9b8157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 shutdown_connections 2023-10-08T15:40:53.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.546+0000 7fb9be0de700 1 -- 172.21.15.29:0/3392999393 wait complete. 2023-10-08T15:40:53.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:53.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.680+0000 7f6aade0c700 1 Processor -- start 2023-10-08T15:40:53.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.680+0000 7f6aade0c700 1 -- start start 2023-10-08T15:40:53.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aade0c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6aa80cce30 0x7f6aa815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aade0c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80b6580 0x7f6aa806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aade0c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6aa806a830 0x7f6aa815d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aade0c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa80b4d70 con 0x7f6aa806a830 2023-10-08T15:40:53.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aade0c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa806ac70 con 0x7f6aa80cce30 2023-10-08T15:40:53.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aade0c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80cd8d0 con 0x7f6aa80b6580 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aad60b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6aa806a830 0x7f6aa815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aad60b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6aa806a830 0x7f6aa815d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46070/0 (socket says 172.21.15.29:46070) 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aad60b700 1 -- 172.21.15.29:0/2064179392 learned_addr learned my addr 172.21.15.29:0/2064179392 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aace0a700 1 --2- 172.21.15.29:0/2064179392 >> v2:172.21.15.183:3300/0 conn(0x7f6aa80cce30 0x7f6aa815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.681+0000 7f6aa7fff700 1 --2- 172.21.15.29:0/2064179392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80b6580 0x7f6aa806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aad60b700 1 -- 172.21.15.29:0/2064179392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80b6580 msgr2=0x7f6aa806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aad60b700 1 --2- 172.21.15.29:0/2064179392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80b6580 0x7f6aa806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aad60b700 1 -- 172.21.15.29:0/2064179392 >> v2:172.21.15.183:3300/0 conn(0x7f6aa80cce30 msgr2=0x7f6aa815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:53.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aad60b700 1 --2- 172.21.15.29:0/2064179392 >> v2:172.21.15.183:3300/0 conn(0x7f6aa80cce30 0x7f6aa815aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aad60b700 1 -- 172.21.15.29:0/2064179392 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80b4440 con 0x7f6aa806a830 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aad60b700 1 --2- 172.21.15.29:0/2064179392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa815d880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80b3770 tx=0x7f6aa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c87d0c6ff19f681 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aa77fe700 1 -- 172.21.15.29:0/2064179392 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000e070 con 0x7f6aa806a830 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aa77fe700 1 -- 172.21.15.29:0/2064179392 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa000b970 con 0x7f6aa806a830 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aa77fe700 1 -- 172.21.15.29:0/2064179392 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00092e0 con 0x7f6aa806a830 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aade0c700 1 -- 172.21.15.29:0/2064179392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 msgr2=0x7f6aa815d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2064179392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa815d880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80b3770 tx=0x7f6aa0009840 comp rx=0 tx=0).stop 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aade0c700 1 -- 172.21.15.29:0/2064179392 shutdown_connections 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2064179392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa815d880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.682+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2064179392 >> v2:172.21.15.183:3300/0 conn(0x7f6aa80cce30 0x7f6aa815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.683+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2064179392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80b6580 0x7f6aa806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.683+0000 7f6aade0c700 1 -- 172.21.15.29:0/2064179392 >> 172.21.15.29:0/2064179392 conn(0x7f6aa8068cb0 msgr2=0x7f6aa80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.683+0000 7f6aade0c700 1 -- 172.21.15.29:0/2064179392 shutdown_connections 2023-10-08T15:40:53.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.683+0000 7f6aade0c700 1 -- 172.21.15.29:0/2064179392 wait complete. 2023-10-08T15:40:53.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.684+0000 7f6aade0c700 1 Processor -- start 2023-10-08T15:40:53.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.684+0000 7f6aade0c700 1 -- start start 2023-10-08T15:40:53.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aade0c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa8154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aade0c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6aa80b6580 0x7f6aa814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aade0c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80cce30 0x7f6aa80b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aade0c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa81535c0 con 0x7f6aa806a830 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aade0c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8152940 con 0x7f6aa80b6580 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aade0c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8152c20 con 0x7f6aa80cce30 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa8154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa8154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46084/0 (socket says 172.21.15.29:46084) 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 -- 172.21.15.29:0/2681883345 learned_addr learned my addr 172.21.15.29:0/2681883345 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aa7fff700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6aa80b6580 0x7f6aa814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aad60b700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80cce30 0x7f6aa80b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 -- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80cce30 msgr2=0x7f6aa80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80cce30 0x7f6aa80b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 -- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6aa80b6580 msgr2=0x7f6aa814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6aa80b6580 0x7f6aa814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 -- 172.21.15.29:0/2681883345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa0009ae0 con 0x7f6aa806a830 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aad60b700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80cce30 0x7f6aa80b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aa7fff700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6aa80b6580 0x7f6aa814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aace0a700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa8154c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00e930 tx=0x7f6a9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aa4ff9700 1 -- 172.21.15.29:0/2681883345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00eed0 con 0x7f6aa806a830 2023-10-08T15:40:53.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aa4ff9700 1 -- 172.21.15.29:0/2681883345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00c850 con 0x7f6aa806a830 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aa4ff9700 1 -- 172.21.15.29:0/2681883345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00cbf0 con 0x7f6aa806a830 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa8152f00 con 0x7f6aa806a830 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.685+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa80b27b0 con 0x7f6aa806a830 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.686+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa8089550 con 0x7f6aa806a830 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.687+0000 7f6aa4ff9700 1 -- 172.21.15.29:0/2681883345 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a9c013470 con 0x7f6aa806a830 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.687+0000 7f6aa4ff9700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6a8c066f30 0x7f6a8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.687+0000 7f6aa4ff9700 1 -- 172.21.15.29:0/2681883345 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a9c0846f0 con 0x7f6aa806a830 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.687+0000 7f6aa7fff700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6a8c066f30 0x7f6a8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:53.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.688+0000 7f6aa7fff700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6a8c066f30 0x7f6a8c0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6aa815cc90 tx=0x7f6a94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:53.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.691+0000 7f6aa4ff9700 1 -- 172.21.15.29:0/2681883345 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a9c051960 con 0x7f6aa806a830 2023-10-08T15:40:53.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.882+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6aa80b4720 con 0x7f6aa806a830 2023-10-08T15:40:53.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.882+0000 7f6aa4ff9700 1 -- 172.21.15.29:0/2681883345 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a9c054f80 con 0x7f6aa806a830 2023-10-08T15:40:53.884 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:40:53.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6a8c066f30 msgr2=0x7f6a8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6a8c066f30 0x7f6a8c0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6aa815cc90 tx=0x7f6a94008040 comp rx=0 tx=0).stop 2023-10-08T15:40:53.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 msgr2=0x7f6aa8154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:53.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa8154c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00e930 tx=0x7f6a9c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.886 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 shutdown_connections 2023-10-08T15:40:53.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6a8c066f30 0x7f6a8c0693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6aa80cce30 0x7f6aa80b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6aa806a830 0x7f6aa8154c80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 --2- 172.21.15.29:0/2681883345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6aa80b6580 0x7f6aa814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:53.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 >> 172.21.15.29:0/2681883345 conn(0x7f6aa8068cb0 msgr2=0x7f6aa80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:53.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 shutdown_connections 2023-10-08T15:40:53.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:53.884+0000 7f6aade0c700 1 -- 172.21.15.29:0/2681883345 wait complete. 2023-10-08T15:40:53.898 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:54.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.015+0000 7fb396817700 1 Processor -- start 2023-10-08T15:40:54.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.015+0000 7fb396817700 1 -- start start 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb396817700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb390157870 0x7fb39015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb396817700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb390157c40 0x7fb390158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb396817700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39015cbb0 con 0x7fb39015a620 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb396817700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39015bfa0 con 0x7fb390157c40 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb396817700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39015c280 con 0x7fb390157870 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb394db4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb390157c40 0x7fb390158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb394db4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb390157c40 0x7fb390158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46088/0 (socket says 172.21.15.29:46088) 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb394db4700 1 -- 172.21.15.29:0/3260658766 learned_addr learned my addr 172.21.15.29:0/3260658766 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb38ffff700 1 --2- 172.21.15.29:0/3260658766 >> v2:172.21.15.183:3300/0 conn(0x7fb390157870 0x7fb39015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb394db4700 1 -- 172.21.15.29:0/3260658766 >> v2:172.21.15.183:3300/0 conn(0x7fb390157870 msgr2=0x7fb39015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb394db4700 1 --2- 172.21.15.29:0/3260658766 >> v2:172.21.15.183:3300/0 conn(0x7fb390157870 0x7fb39015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb394db4700 1 -- 172.21.15.29:0/3260658766 >> v1:172.21.15.183:6789/0 conn(0x7fb39015a620 legacy=0x7fb39015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb394db4700 1 -- 172.21.15.29:0/3260658766 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39015c560 con 0x7fb390157c40 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb38ffff700 1 --2- 172.21.15.29:0/3260658766 >> v2:172.21.15.183:3300/0 conn(0x7fb390157870 0x7fb39015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb394db4700 1 --2- 172.21.15.29:0/3260658766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb390158110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb390069d80 tx=0x7fb388009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13dc93939d7080f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.016+0000 7fb38effd700 1 -- 172.21.15.29:0/3260658766 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800e070 con 0x7fb390157c40 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb38effd700 1 -- 172.21.15.29:0/3260658766 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38800ba50 con 0x7fb390157c40 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb38effd700 1 -- 172.21.15.29:0/3260658766 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3880092e0 con 0x7fb390157c40 2023-10-08T15:40:54.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb396817700 1 -- 172.21.15.29:0/3260658766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 msgr2=0x7fb390158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb396817700 1 --2- 172.21.15.29:0/3260658766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb390158110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb390069d80 tx=0x7fb388009840 comp rx=0 tx=0).stop 2023-10-08T15:40:54.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb396817700 1 -- 172.21.15.29:0/3260658766 shutdown_connections 2023-10-08T15:40:54.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb396817700 1 --2- 172.21.15.29:0/3260658766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb390158110 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb396817700 1 --2- 172.21.15.29:0/3260658766 >> v2:172.21.15.183:3300/0 conn(0x7fb390157870 0x7fb39015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb396817700 1 -- 172.21.15.29:0/3260658766 >> 172.21.15.29:0/3260658766 conn(0x7fb390068ce0 msgr2=0x7fb3900690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb396817700 1 -- 172.21.15.29:0/3260658766 shutdown_connections 2023-10-08T15:40:54.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.017+0000 7fb396817700 1 -- 172.21.15.29:0/3260658766 wait complete. 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.018+0000 7fb396817700 1 Processor -- start 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.018+0000 7fb396817700 1 -- start start 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb396817700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390157870 0x7fb390155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb396817700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb39015fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb396817700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015a620 0x7fb3900c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb396817700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390160590 con 0x7fb390157c40 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb396817700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901602c0 con 0x7fb390157870 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb396817700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c66c0 con 0x7fb39015a620 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb39015fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb39015fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46096/0 (socket says 172.21.15.29:46096) 2023-10-08T15:40:54.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38f7fe700 1 -- 172.21.15.29:0/252135242 learned_addr learned my addr 172.21.15.29:0/252135242 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38ffff700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390157870 0x7fb390155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb394db4700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015a620 0x7fb3900c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38f7fe700 1 -- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015a620 msgr2=0x7fb3900c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38f7fe700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015a620 0x7fb3900c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38f7fe700 1 -- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390157870 msgr2=0x7fb390155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38f7fe700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390157870 0x7fb390155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.019+0000 7fb38f7fe700 1 -- 172.21.15.29:0/252135242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388009ae0 con 0x7fb390157c40 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.020+0000 7fb38f7fe700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb39015fd80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c590 tx=0x7fb384007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.020+0000 7fb377fff700 1 -- 172.21.15.29:0/252135242 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384011590 con 0x7fb390157c40 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.020+0000 7fb377fff700 1 -- 172.21.15.29:0/252135242 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb384011710 con 0x7fb390157c40 2023-10-08T15:40:54.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.020+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3900c69a0 con 0x7fb390157c40 2023-10-08T15:40:54.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.020+0000 7fb377fff700 1 -- 172.21.15.29:0/252135242 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384011ad0 con 0x7fb390157c40 2023-10-08T15:40:54.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.020+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3900c7950 con 0x7fb390157c40 2023-10-08T15:40:54.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.021+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39004c3c0 con 0x7fb390157c40 2023-10-08T15:40:54.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.021+0000 7fb377fff700 1 -- 172.21.15.29:0/252135242 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb38401b3b0 con 0x7fb390157c40 2023-10-08T15:40:54.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.022+0000 7fb377fff700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb37c066f30 0x7fb37c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.022+0000 7fb377fff700 1 -- 172.21.15.29:0/252135242 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3840839d0 con 0x7fb390157c40 2023-10-08T15:40:54.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.022+0000 7fb38ffff700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb37c066f30 0x7fb37c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.022+0000 7fb38ffff700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb37c066f30 0x7fb37c0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb380006f00 tx=0x7fb380008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.026+0000 7fb377fff700 1 -- 172.21.15.29:0/252135242 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb384050c40 con 0x7fb390157c40 2023-10-08T15:40:54.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.218+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb39015c840 con 0x7fb390157c40 2023-10-08T15:40:54.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.219+0000 7fb377fff700 1 -- 172.21.15.29:0/252135242 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb384017070 con 0x7fb390157c40 2023-10-08T15:40:54.221 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:54.221 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:54.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb37c066f30 msgr2=0x7fb37c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb37c066f30 0x7fb37c0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb380006f00 tx=0x7fb380008040 comp rx=0 tx=0).stop 2023-10-08T15:40:54.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 msgr2=0x7fb39015fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb39015fd80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c590 tx=0x7fb384007f50 comp rx=0 tx=0).stop 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 shutdown_connections 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb37c066f30 0x7fb37c0693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb39015a620 0x7fb3900c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb390157870 0x7fb390155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 --2- 172.21.15.29:0/252135242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb390157c40 0x7fb39015fd80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.221+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 >> 172.21.15.29:0/252135242 conn(0x7fb390068ce0 msgr2=0x7fb390159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.222+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 shutdown_connections 2023-10-08T15:40:54.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.222+0000 7fb396817700 1 -- 172.21.15.29:0/252135242 wait complete. 2023-10-08T15:40:54.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:40:20.956808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:40:22.081738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:54.236 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:54.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.356+0000 7f635719c700 1 Processor -- start 2023-10-08T15:40:54.357 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.356+0000 7f635719c700 1 -- start start 2023-10-08T15:40:54.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.356+0000 7f635719c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63500697c0 0x7f635015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.356+0000 7f635719c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f635015a230 0x7f63500af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f635719c700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635015ea90 con 0x7f6350159e60 2023-10-08T15:40:54.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f635719c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63500d1cf0 con 0x7f635015a230 2023-10-08T15:40:54.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f635719c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b3100 con 0x7f63500697c0 2023-10-08T15:40:54.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f6354f38700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6350159e60 0x7f63500690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:37358/0 (socket says 172.21.15.29:37358) 2023-10-08T15:40:54.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f6354f38700 1 -- 172.21.15.29:0/3133078707 learned_addr learned my addr 172.21.15.29:0/3133078707 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:54.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f634ffff700 1 --2- 172.21.15.29:0/3133078707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63500697c0 0x7f635015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f6355739700 1 --2- 172.21.15.29:0/3133078707 >> v2:172.21.15.183:3300/0 conn(0x7f635015a230 0x7f63500af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f634f7fe700 1 -- 172.21.15.29:0/3133078707 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330834325 0 0) 0x7f635015ea90 con 0x7f6350159e60 2023-10-08T15:40:54.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f634f7fe700 1 -- 172.21.15.29:0/3133078707 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f633c003570 con 0x7f6350159e60 2023-10-08T15:40:54.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f634ffff700 1 -- 172.21.15.29:0/3133078707 >> v2:172.21.15.183:3300/0 conn(0x7f635015a230 msgr2=0x7f63500af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f634ffff700 1 --2- 172.21.15.29:0/3133078707 >> v2:172.21.15.183:3300/0 conn(0x7f635015a230 0x7f63500af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f634ffff700 1 -- 172.21.15.29:0/3133078707 >> v1:172.21.15.183:6789/0 conn(0x7f6350159e60 legacy=0x7f63500690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f634ffff700 1 -- 172.21.15.29:0/3133078707 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63500d10e0 con 0x7f63500697c0 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.357+0000 7f6355739700 1 --2- 172.21.15.29:0/3133078707 >> v2:172.21.15.183:3300/0 conn(0x7f635015a230 0x7f63500af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f634ffff700 1 --2- 172.21.15.29:0/3133078707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63500697c0 0x7f635015e550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63400098e0 tx=0x7f63400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95805f65e7ef2a61 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f634f7fe700 1 -- 172.21.15.29:0/3133078707 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340011630 con 0x7f63500697c0 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f634f7fe700 1 -- 172.21.15.29:0/3133078707 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340011790 con 0x7f63500697c0 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f634f7fe700 1 -- 172.21.15.29:0/3133078707 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340011b30 con 0x7f63500697c0 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f635719c700 1 -- 172.21.15.29:0/3133078707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63500697c0 msgr2=0x7f635015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f635719c700 1 --2- 172.21.15.29:0/3133078707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63500697c0 0x7f635015e550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63400098e0 tx=0x7f63400091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f635719c700 1 -- 172.21.15.29:0/3133078707 shutdown_connections 2023-10-08T15:40:54.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f635719c700 1 --2- 172.21.15.29:0/3133078707 >> v2:172.21.15.183:3300/0 conn(0x7f635015a230 0x7f63500af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f635719c700 1 --2- 172.21.15.29:0/3133078707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63500697c0 0x7f635015e550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f635719c700 1 -- 172.21.15.29:0/3133078707 >> 172.21.15.29:0/3133078707 conn(0x7f6350070700 msgr2=0x7f6350070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f635719c700 1 -- 172.21.15.29:0/3133078707 shutdown_connections 2023-10-08T15:40:54.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.358+0000 7f635719c700 1 -- 172.21.15.29:0/3133078707 wait complete. 2023-10-08T15:40:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.360+0000 7f635719c700 1 Processor -- start 2023-10-08T15:40:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.360+0000 7f635719c700 1 -- start start 2023-10-08T15:40:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.360+0000 7f635719c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63500697c0 0x7f635015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.360+0000 7f635719c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6350159e60 0x7f63501468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.360+0000 7f635719c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f635015a230 0x7f63500af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.360+0000 7f635719c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635015cb60 con 0x7f63500697c0 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.360+0000 7f635719c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635015d960 con 0x7f6350159e60 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.360+0000 7f635719c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6350158ab0 con 0x7f635015a230 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63500697c0 0x7f635015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63500697c0 0x7f635015c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46110/0 (socket says 172.21.15.29:46110) 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 -- 172.21.15.29:0/3287911868 learned_addr learned my addr 172.21.15.29:0/3287911868 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f634ffff700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6350159e60 0x7f63501468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6355739700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f635015a230 0x7f63500af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 -- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f635015a230 msgr2=0x7f63500af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f635015a230 0x7f63500af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 -- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6350159e60 msgr2=0x7f63501468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6350159e60 0x7f63501468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 -- 172.21.15.29:0/3287911868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6338009420 con 0x7f63500697c0 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f6354f38700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63500697c0 0x7f635015c620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f634800cd30 tx=0x7f6348001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f634cff9700 1 -- 172.21.15.29:0/3287911868 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634800ab70 con 0x7f63500697c0 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f634cff9700 1 -- 172.21.15.29:0/3287911868 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634800acf0 con 0x7f63500697c0 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6340009420 con 0x7f63500697c0 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f634cff9700 1 -- 172.21.15.29:0/3287911868 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348007340 con 0x7f63500697c0 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.361+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635015d0b0 con 0x7f63500697c0 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.362+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635004c3c0 con 0x7f63500697c0 2023-10-08T15:40:54.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.363+0000 7f634cff9700 1 -- 172.21.15.29:0/3287911868 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6348007770 con 0x7f63500697c0 2023-10-08T15:40:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.363+0000 7f634cff9700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6330066f60 0x7f6330069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.363+0000 7f634cff9700 1 -- 172.21.15.29:0/3287911868 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6348084a50 con 0x7f63500697c0 2023-10-08T15:40:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.363+0000 7f634ffff700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6330066f60 0x7f6330069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.364+0000 7f634ffff700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6330066f60 0x7f6330069410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63400091e0 tx=0x7f6340017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.367+0000 7f634cff9700 1 -- 172.21.15.29:0/3287911868 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6348051d40 con 0x7f63500697c0 2023-10-08T15:40:54.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.559+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63500cb590 con 0x7f63500697c0 2023-10-08T15:40:54.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.559+0000 7f634cff9700 1 -- 172.21.15.29:0/3287911868 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f634800ae60 con 0x7f63500697c0 2023-10-08T15:40:54.561 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:54.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6330066f60 msgr2=0x7f6330069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6330066f60 0x7f6330069410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63400091e0 tx=0x7f6340017000 comp rx=0 tx=0).stop 2023-10-08T15:40:54.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63500697c0 msgr2=0x7f635015c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63500697c0 0x7f635015c620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f634800cd30 tx=0x7f6348001b10 comp rx=0 tx=0).stop 2023-10-08T15:40:54.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 shutdown_connections 2023-10-08T15:40:54.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6330066f60 0x7f6330069410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f635015a230 0x7f63500af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63500697c0 0x7f635015c620 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 --2- 172.21.15.29:0/3287911868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6350159e60 0x7f63501468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 >> 172.21.15.29:0/3287911868 conn(0x7f6350070700 msgr2=0x7f6350159390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 shutdown_connections 2023-10-08T15:40:54.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.561+0000 7f635719c700 1 -- 172.21.15.29:0/3287911868 wait complete. 2023-10-08T15:40:54.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:54.677 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:54.680 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:40:54.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.695+0000 7fb5233be700 1 Processor -- start 2023-10-08T15:40:54.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.695+0000 7fb5233be700 1 -- start start 2023-10-08T15:40:54.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.696+0000 7fb5233be700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.696+0000 7fb5233be700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51c0c9000 con 0x7fb51c0cc960 2023-10-08T15:40:54.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.696+0000 7fb5233be700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51c0cced0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.696+0000 7fb5233be700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c0c9a00 con 0x7fb51c15a120 2023-10-08T15:40:54.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.696+0000 7fb52115a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.696+0000 7fb520959700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb51c0cc960 0x7fb51c0c1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56318/0 (socket says 172.21.15.29:56318) 2023-10-08T15:40:54.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.696+0000 7fb520959700 1 -- 172.21.15.29:0/262805531 learned_addr learned my addr 172.21.15.29:0/262805531 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:54.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb513fff700 1 -- 172.21.15.29:0/262805531 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930200036 0 0) 0x7fb51c0c9000 con 0x7fb51c0cc960 2023-10-08T15:40:54.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb513fff700 1 -- 172.21.15.29:0/262805531 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb508003570 con 0x7fb51c0cc960 2023-10-08T15:40:54.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb52115a700 1 -- 172.21.15.29:0/262805531 >> v1:172.21.15.183:6789/0 conn(0x7fb51c0c26b0 legacy=0x7fb51c0aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb513fff700 1 -- 172.21.15.29:0/262805531 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059720915 0 0) 0x7fb51c0cced0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb52115a700 1 -- 172.21.15.29:0/262805531 >> v1:172.21.15.29:6789/0 conn(0x7fb51c0cc960 legacy=0x7fb51c0c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb52115a700 1 -- 172.21.15.29:0/262805531 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c06f750 con 0x7fb51c15a120 2023-10-08T15:40:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb52115a700 1 --2- 172.21.15.29:0/262805531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0c94c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb518009910 tx=0x7fb5180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89dacc654fd91d24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb513fff700 1 -- 172.21.15.29:0/262805531 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800b640 con 0x7fb51c15a120 2023-10-08T15:40:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb513fff700 1 -- 172.21.15.29:0/262805531 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51800b7a0 con 0x7fb51c15a120 2023-10-08T15:40:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.697+0000 7fb513fff700 1 -- 172.21.15.29:0/262805531 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800bb60 con 0x7fb51c15a120 2023-10-08T15:40:54.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.698+0000 7fb5233be700 1 -- 172.21.15.29:0/262805531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 msgr2=0x7fb51c0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.698+0000 7fb5233be700 1 --2- 172.21.15.29:0/262805531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0c94c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb518009910 tx=0x7fb5180091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.698+0000 7fb5233be700 1 -- 172.21.15.29:0/262805531 shutdown_connections 2023-10-08T15:40:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.698+0000 7fb5233be700 1 --2- 172.21.15.29:0/262805531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0c94c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.698+0000 7fb5233be700 1 -- 172.21.15.29:0/262805531 >> 172.21.15.29:0/262805531 conn(0x7fb51c0680f0 msgr2=0x7fb51c0cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.698+0000 7fb5233be700 1 -- 172.21.15.29:0/262805531 shutdown_connections 2023-10-08T15:40:54.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.698+0000 7fb5233be700 1 -- 172.21.15.29:0/262805531 wait complete. 2023-10-08T15:40:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.699+0000 7fb5233be700 1 Processor -- start 2023-10-08T15:40:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.699+0000 7fb5233be700 1 -- start start 2023-10-08T15:40:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.700+0000 7fb5233be700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb51c0c26b0 0x7fb51c169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.700+0000 7fb5233be700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c0cc960 0x7fb51c0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.700+0000 7fb5233be700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.700+0000 7fb5233be700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c0c68d0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.700+0000 7fb5233be700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c0c5d50 con 0x7fb51c0cc960 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.700+0000 7fb5233be700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c0c6030 con 0x7fb51c15a120 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb51c0c26b0 0x7fb51c169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb51c0c26b0 0x7fb51c169e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46112/0 (socket says 172.21.15.29:46112) 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 -- 172.21.15.29:0/538696292 learned_addr learned my addr 172.21.15.29:0/538696292 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb520959700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c0cc960 0x7fb51c0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52195b700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 -- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 msgr2=0x7fb51c0696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 -- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c0cc960 msgr2=0x7fb51c0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c0cc960 0x7fb51c0c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 -- 172.21.15.29:0/538696292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518009420 con 0x7fb51c0c26b0 2023-10-08T15:40:54.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb52115a700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb51c0c26b0 0x7fb51c169e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb518009fb0 tx=0x7fb518016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb5117fa700 1 -- 172.21.15.29:0/538696292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800b910 con 0x7fb51c0c26b0 2023-10-08T15:40:54.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb5117fa700 1 -- 172.21.15.29:0/538696292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51800ba90 con 0x7fb51c0c26b0 2023-10-08T15:40:54.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c0c6310 con 0x7fb51c0c26b0 2023-10-08T15:40:54.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb5117fa700 1 -- 172.21.15.29:0/538696292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51801c6b0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.701+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c0c72f0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.702+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51c04c3c0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.703+0000 7fb5117fa700 1 -- 172.21.15.29:0/538696292 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb51801caa0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.703+0000 7fb5117fa700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb500066f30 0x7fb5000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:54.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.703+0000 7fb5117fa700 1 -- 172.21.15.29:0/538696292 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb518086880 con 0x7fb51c0c26b0 2023-10-08T15:40:54.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.704+0000 7fb520959700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb500066f30 0x7fb5000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:54.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.704+0000 7fb520959700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb500066f30 0x7fb5000693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb51c06a250 tx=0x7fb50c007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:54.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.708+0000 7fb5117fa700 1 -- 172.21.15.29:0/538696292 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb518053af0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.897+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb51c04c3c0 con 0x7fb51c0c26b0 2023-10-08T15:40:54.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.898+0000 7fb5117fa700 1 -- 172.21.15.29:0/538696292 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb518057110 con 0x7fb51c0c26b0 2023-10-08T15:40:54.900 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb500066f30 msgr2=0x7fb5000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb500066f30 0x7fb5000693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb51c06a250 tx=0x7fb50c007d10 comp rx=0 tx=0).stop 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb51c0c26b0 msgr2=0x7fb51c169e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb51c0c26b0 0x7fb51c169e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb518009fb0 tx=0x7fb518016000 comp rx=0 tx=0).stop 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 shutdown_connections 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb500066f30 0x7fb5000693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb51c15a120 0x7fb51c0696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb51c0c26b0 0x7fb51c169e20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 --2- 172.21.15.29:0/538696292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb51c0cc960 0x7fb51c0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:54.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 >> 172.21.15.29:0/538696292 conn(0x7fb51c0680f0 msgr2=0x7fb51c06af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:54.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 shutdown_connections 2023-10-08T15:40:54.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:54.900+0000 7fb5233be700 1 -- 172.21.15.29:0/538696292 wait complete. 2023-10-08T15:40:54.913 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:55.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.033+0000 7f9c370e9700 1 Processor -- start 2023-10-08T15:40:55.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.033+0000 7f9c370e9700 1 -- start start 2023-10-08T15:40:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.034+0000 7f9c370e9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c300678b0 0x7f9c3015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.034+0000 7f9c370e9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300cbf10 0x7f9c3015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.034+0000 7f9c370e9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c300cae70 con 0x7f9c300c9390 2023-10-08T15:40:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.034+0000 7f9c370e9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c300cb150 con 0x7f9c300678b0 2023-10-08T15:40:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.034+0000 7f9c370e9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300cb430 con 0x7f9c300cbf10 2023-10-08T15:40:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c34e85700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c300678b0 0x7f9c3015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c2ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300cbf10 0x7f9c3015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c34e85700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c300678b0 0x7f9c3015db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:40740/0 (socket says 172.21.15.29:40740) 2023-10-08T15:40:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c34e85700 1 -- 172.21.15.29:0/3076650854 learned_addr learned my addr 172.21.15.29:0/3076650854 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c35686700 1 --1- 172.21.15.29:0/3076650854 >> v1:172.21.15.183:6789/0 conn(0x7f9c300c9390 0x7f9c3006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:37384/0 (socket says 172.21.15.29:37384) 2023-10-08T15:40:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c34e85700 1 -- 172.21.15.29:0/3076650854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300cbf10 msgr2=0x7f9c3015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c34e85700 1 --2- 172.21.15.29:0/3076650854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300cbf10 0x7f9c3015e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c34e85700 1 -- 172.21.15.29:0/3076650854 >> v1:172.21.15.183:6789/0 conn(0x7f9c300c9390 legacy=0x7f9c3006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c34e85700 1 -- 172.21.15.29:0/3076650854 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300cb710 con 0x7f9c300678b0 2023-10-08T15:40:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c2f7fe700 1 -- 172.21.15.29:0/3076650854 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656051097 0 0) 0x7f9c300cae70 con 0x7f9c300c9390 2023-10-08T15:40:55.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c2ffff700 1 --2- 172.21.15.29:0/3076650854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300cbf10 0x7f9c3015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c34e85700 1 --2- 172.21.15.29:0/3076650854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 0x7f9c3015db80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9c280099b0 tx=0x7f9c28009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=838798556827da07 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c2f7fe700 1 -- 172.21.15.29:0/3076650854 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28009ea0 con 0x7f9c300678b0 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c2f7fe700 1 -- 172.21.15.29:0/3076650854 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2800b860 con 0x7f9c300678b0 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.035+0000 7f9c2f7fe700 1 -- 172.21.15.29:0/3076650854 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2800bc00 con 0x7f9c300678b0 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.036+0000 7f9c370e9700 1 -- 172.21.15.29:0/3076650854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 msgr2=0x7f9c3015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.036+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3076650854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 0x7f9c3015db80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9c280099b0 tx=0x7f9c28009250 comp rx=0 tx=0).stop 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.036+0000 7f9c370e9700 1 -- 172.21.15.29:0/3076650854 shutdown_connections 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.036+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3076650854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 0x7f9c3015db80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.036+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3076650854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300cbf10 0x7f9c3015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.036+0000 7f9c370e9700 1 -- 172.21.15.29:0/3076650854 >> 172.21.15.29:0/3076650854 conn(0x7f9c30069870 msgr2=0x7f9c30069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.036+0000 7f9c370e9700 1 -- 172.21.15.29:0/3076650854 shutdown_connections 2023-10-08T15:40:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.036+0000 7f9c370e9700 1 -- 172.21.15.29:0/3076650854 wait complete. 2023-10-08T15:40:55.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.037+0000 7f9c370e9700 1 Processor -- start 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.037+0000 7f9c370e9700 1 -- start start 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c370e9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 0x7f9c300c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c370e9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300c9390 0x7f9c30150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c370e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c300cbf10 0x7f9c3015e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c370e9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300c8f80 con 0x7f9c300cbf10 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c370e9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300c8ca0 con 0x7f9c300678b0 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c370e9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3016a3d0 con 0x7f9c300c9390 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c35686700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c300cbf10 0x7f9c3015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c35686700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c300cbf10 0x7f9c3015e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46122/0 (socket says 172.21.15.29:46122) 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c35686700 1 -- 172.21.15.29:0/3187325945 learned_addr learned my addr 172.21.15.29:0/3187325945 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c34e85700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 0x7f9c300c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c2ffff700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300c9390 0x7f9c30150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c35686700 1 -- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300c9390 msgr2=0x7f9c30150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c35686700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300c9390 0x7f9c30150640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c35686700 1 -- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 msgr2=0x7f9c300c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c35686700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 0x7f9c300c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c35686700 1 -- 172.21.15.29:0/3187325945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20009a20 con 0x7f9c300cbf10 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.038+0000 7f9c34e85700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 0x7f9c300c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:55.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.039+0000 7f9c35686700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c300cbf10 0x7f9c3015e500 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c5e0 tx=0x7f9c18007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.039+0000 7f9c2cff9700 1 -- 172.21.15.29:0/3187325945 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18005a70 con 0x7f9c300cbf10 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.039+0000 7f9c2cff9700 1 -- 172.21.15.29:0/3187325945 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18005bd0 con 0x7f9c300cbf10 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.039+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c280094f0 con 0x7f9c300cbf10 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.039+0000 7f9c2cff9700 1 -- 172.21.15.29:0/3187325945 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180070d0 con 0x7f9c300cbf10 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.039+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3016a990 con 0x7f9c300cbf10 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.040+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3004c3c0 con 0x7f9c300cbf10 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.040+0000 7f9c2cff9700 1 -- 172.21.15.29:0/3187325945 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c18007440 con 0x7f9c300cbf10 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.040+0000 7f9c2cff9700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9c10066f60 0x7f9c10069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.041+0000 7f9c2cff9700 1 -- 172.21.15.29:0/3187325945 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c18083b70 con 0x7f9c300cbf10 2023-10-08T15:40:55.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.041+0000 7f9c34e85700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9c10066f60 0x7f9c10069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.041+0000 7f9c34e85700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9c10066f60 0x7f9c10069410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9c280099b0 tx=0x7f9c28017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.045+0000 7f9c2cff9700 1 -- 172.21.15.29:0/3187325945 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c18050d40 con 0x7f9c300cbf10 2023-10-08T15:40:55.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.236+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c30068da0 con 0x7f9c300cbf10 2023-10-08T15:40:55.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.236+0000 7f9c2cff9700 1 -- 172.21.15.29:0/3187325945 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c18017070 con 0x7f9c300cbf10 2023-10-08T15:40:55.238 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:40:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9c10066f60 msgr2=0x7f9c10069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9c10066f60 0x7f9c10069410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9c280099b0 tx=0x7f9c28017000 comp rx=0 tx=0).stop 2023-10-08T15:40:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c300cbf10 msgr2=0x7f9c3015e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c300cbf10 0x7f9c3015e500 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c5e0 tx=0x7f9c18007d60 comp rx=0 tx=0).stop 2023-10-08T15:40:55.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 shutdown_connections 2023-10-08T15:40:55.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9c10066f60 0x7f9c10069410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c300cbf10 0x7f9c3015e500 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c300678b0 0x7f9c300c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 --2- 172.21.15.29:0/3187325945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c300c9390 0x7f9c30150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.238+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 >> 172.21.15.29:0/3187325945 conn(0x7f9c30069870 msgr2=0x7f9c300b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:55.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.239+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 shutdown_connections 2023-10-08T15:40:55.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.239+0000 7f9c370e9700 1 -- 172.21.15.29:0/3187325945 wait complete. 2023-10-08T15:40:55.261 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-08T15:40:55.261 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-08T15:40:55.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-08T15:40:55.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.379+0000 7f280702e700 1 Processor -- start 2023-10-08T15:40:55.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.379+0000 7f280702e700 1 -- start start 2023-10-08T15:40:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f280702e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2800157870 0x7f280015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f280702e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2800157c40 0x7f2800158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f280702e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280015cbb0 con 0x7f280015a620 2023-10-08T15:40:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f280702e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280015bfa0 con 0x7f2800157c40 2023-10-08T15:40:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f280702e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280015c280 con 0x7f2800157870 2023-10-08T15:40:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f28055cb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2800157c40 0x7f2800158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f28055cb700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2800157c40 0x7f2800158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46136/0 (socket says 172.21.15.29:46136) 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f28055cb700 1 -- 172.21.15.29:0/2673706243 learned_addr learned my addr 172.21.15.29:0/2673706243 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f2804dca700 1 --2- 172.21.15.29:0/2673706243 >> v2:172.21.15.183:3300/0 conn(0x7f2800157870 0x7f280015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f28055cb700 1 -- 172.21.15.29:0/2673706243 >> v2:172.21.15.183:3300/0 conn(0x7f2800157870 msgr2=0x7f280015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f28055cb700 1 --2- 172.21.15.29:0/2673706243 >> v2:172.21.15.183:3300/0 conn(0x7f2800157870 0x7f280015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f28055cb700 1 -- 172.21.15.29:0/2673706243 >> v1:172.21.15.183:6789/0 conn(0x7f280015a620 legacy=0x7f280015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f28055cb700 1 -- 172.21.15.29:0/2673706243 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280015c560 con 0x7f2800157c40 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.380+0000 7f28055cb700 1 --2- 172.21.15.29:0/2673706243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157c40 0x7f2800158110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2800069d80 tx=0x7f27e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a8e1445a18ea2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f27ff7fe700 1 -- 172.21.15.29:0/2673706243 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8009e70 con 0x7f2800157c40 2023-10-08T15:40:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f27ff7fe700 1 -- 172.21.15.29:0/2673706243 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800b860 con 0x7f2800157c40 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f27ff7fe700 1 -- 172.21.15.29:0/2673706243 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800bc00 con 0x7f2800157c40 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f280702e700 1 -- 172.21.15.29:0/2673706243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157c40 msgr2=0x7f2800158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f280702e700 1 --2- 172.21.15.29:0/2673706243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157c40 0x7f2800158110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2800069d80 tx=0x7f27e8009250 comp rx=0 tx=0).stop 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f280702e700 1 -- 172.21.15.29:0/2673706243 shutdown_connections 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f280702e700 1 --2- 172.21.15.29:0/2673706243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157c40 0x7f2800158110 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f280702e700 1 --2- 172.21.15.29:0/2673706243 >> v2:172.21.15.183:3300/0 conn(0x7f2800157870 0x7f280015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f280702e700 1 -- 172.21.15.29:0/2673706243 >> 172.21.15.29:0/2673706243 conn(0x7f2800068ce0 msgr2=0x7f28000690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f280702e700 1 -- 172.21.15.29:0/2673706243 shutdown_connections 2023-10-08T15:40:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.381+0000 7f280702e700 1 -- 172.21.15.29:0/2673706243 wait complete. 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.382+0000 7f280702e700 1 Processor -- start 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f280702e700 1 -- start start 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f280702e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157870 0x7f280013f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f280702e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2800157c40 0x7f280014f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f280702e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f280015a620 0x7f28000b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f280702e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b1400 con 0x7f2800157870 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f280702e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b07f0 con 0x7f280015a620 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f280702e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b0ad0 con 0x7f2800157c40 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f2804dca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157870 0x7f280013f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f2804dca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157870 0x7f280013f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46140/0 (socket says 172.21.15.29:46140) 2023-10-08T15:40:55.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f2804dca700 1 -- 172.21.15.29:0/1424328993 learned_addr learned my addr 172.21.15.29:0/1424328993 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f28055cb700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f280015a620 0x7f28000b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.383+0000 7f27fffff700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2800157c40 0x7f280014f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f2804dca700 1 -- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2800157c40 msgr2=0x7f280014f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f2804dca700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2800157c40 0x7f280014f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f2804dca700 1 -- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f280015a620 msgr2=0x7f28000b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f2804dca700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f280015a620 0x7f28000b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f2804dca700 1 -- 172.21.15.29:0/1424328993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80094f0 con 0x7f2800157870 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f2804dca700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157870 0x7f280013f920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f27f800ec80 tx=0x7f27f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f27fcff9700 1 -- 172.21.15.29:0/1424328993 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800c850 con 0x7f2800157870 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f27fcff9700 1 -- 172.21.15.29:0/1424328993 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f800c9b0 con 0x7f2800157870 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000b0db0 con 0x7f2800157870 2023-10-08T15:40:55.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f27fcff9700 1 -- 172.21.15.29:0/1424328993 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800cd50 con 0x7f2800157870 2023-10-08T15:40:55.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.384+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280014ff20 con 0x7f2800157870 2023-10-08T15:40:55.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.385+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280004c3c0 con 0x7f2800157870 2023-10-08T15:40:55.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.386+0000 7f27fcff9700 1 -- 172.21.15.29:0/1424328993 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27f8013680 con 0x7f2800157870 2023-10-08T15:40:55.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.386+0000 7f27fcff9700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f27e0066f30 0x7f27e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:55.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.386+0000 7f27fcff9700 1 -- 172.21.15.29:0/1424328993 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27f8084730 con 0x7f2800157870 2023-10-08T15:40:55.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.386+0000 7f27fffff700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f27e0066f30 0x7f27e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:55.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.387+0000 7f27fffff700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f27e0066f30 0x7f27e00693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f280015b460 tx=0x7f27f0001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:55.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.390+0000 7f27fcff9700 1 -- 172.21.15.29:0/1424328993 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27f80519a0 con 0x7f2800157870 2023-10-08T15:40:55.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:55.660+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f280015c840 con 0x7f2800157870 2023-10-08T15:40:56.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.584+0000 7f27fcff9700 1 -- 172.21.15.29:0/1424328993 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v46) v1 ==== 133+0+0 (secure 0 0 0) 0x7f27f8054fc0 con 0x7f2800157870 2023-10-08T15:40:56.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f27e0066f30 msgr2=0x7f27e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f27e0066f30 0x7f27e00693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f280015b460 tx=0x7f27f0001650 comp rx=0 tx=0).stop 2023-10-08T15:40:56.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157870 msgr2=0x7f280013f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157870 0x7f280013f920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f27f800ec80 tx=0x7f27f80091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 shutdown_connections 2023-10-08T15:40:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f27e0066f30 0x7f27e00693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f280015a620 0x7f28000b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2800157870 0x7f280013f920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 --2- 172.21.15.29:0/1424328993 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2800157c40 0x7f280014f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 >> 172.21.15.29:0/1424328993 conn(0x7f2800068ce0 msgr2=0x7f28000b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 shutdown_connections 2023-10-08T15:40:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.586+0000 7f280702e700 1 -- 172.21.15.29:0/1424328993 wait complete. 2023-10-08T15:40:56.603 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-08T15:40:56.744 INFO:teuthology.orchestra.run.smithi029.stdout:{"osd_objectstore":"memstore"} 2023-10-08T15:40:56.745 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-08T15:40:56.745 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T15:40:56.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.866+0000 7f8c7ec20700 1 Processor -- start 2023-10-08T15:40:56.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.866+0000 7f8c7ec20700 1 -- start start 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.866+0000 7f8c7ec20700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c780d05a0 0x7f8c78164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.866+0000 7f8c7ec20700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780b0790 con 0x7f8c7815a290 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.866+0000 7f8c7ec20700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780ce1f0 con 0x7f8c78159ec0 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.866+0000 7f8c7ec20700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c780b0b20 con 0x7f8c780d05a0 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c7d1bd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c780d05a0 0x7f8c78164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c7d1bd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c780d05a0 0x7f8c78164ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46142/0 (socket says 172.21.15.29:46142) 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c7d1bd700 1 -- 172.21.15.29:0/1488442156 learned_addr learned my addr 172.21.15.29:0/1488442156 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c77fff700 1 --1- 172.21.15.29:0/1488442156 >> v1:172.21.15.29:6789/0 conn(0x7f8c7815a290 0x7f8c7806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56324/0 (socket says 172.21.15.29:56324) 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c7d1bd700 1 -- 172.21.15.29:0/1488442156 >> v1:172.21.15.183:6789/0 conn(0x7f8c78159ec0 legacy=0x7f8c780af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:56.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c7d1bd700 1 -- 172.21.15.29:0/1488442156 >> v1:172.21.15.29:6789/0 conn(0x7f8c7815a290 legacy=0x7f8c7806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c7d1bd700 1 -- 172.21.15.29:0/1488442156 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780b04b0 con 0x7f8c780d05a0 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c777fe700 1 -- 172.21.15.29:0/1488442156 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956617868 0 0) 0x7f8c780b0790 con 0x7f8c7815a290 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c7d1bd700 1 --2- 172.21.15.29:0/1488442156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c780d05a0 0x7f8c78164ed0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8c600099b0 tx=0x7f8c60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3f16595cb007dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c777fe700 1 -- 172.21.15.29:0/1488442156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000b820 con 0x7f8c780d05a0 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c777fe700 1 -- 172.21.15.29:0/1488442156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000b980 con 0x7f8c780d05a0 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.867+0000 7f8c777fe700 1 -- 172.21.15.29:0/1488442156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000bd20 con 0x7f8c780d05a0 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.868+0000 7f8c7ec20700 1 -- 172.21.15.29:0/1488442156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c780d05a0 msgr2=0x7f8c78164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.868+0000 7f8c7ec20700 1 --2- 172.21.15.29:0/1488442156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c780d05a0 0x7f8c78164ed0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8c600099b0 tx=0x7f8c60009250 comp rx=0 tx=0).stop 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.868+0000 7f8c7ec20700 1 -- 172.21.15.29:0/1488442156 shutdown_connections 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.868+0000 7f8c7ec20700 1 --2- 172.21.15.29:0/1488442156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c780d05a0 0x7f8c78164ed0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.868+0000 7f8c7ec20700 1 -- 172.21.15.29:0/1488442156 >> 172.21.15.29:0/1488442156 conn(0x7f8c780d1880 msgr2=0x7f8c780cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:56.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.868+0000 7f8c7ec20700 1 -- 172.21.15.29:0/1488442156 shutdown_connections 2023-10-08T15:40:56.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.868+0000 7f8c7ec20700 1 -- 172.21.15.29:0/1488442156 wait complete. 2023-10-08T15:40:56.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.869+0000 7f8c7ec20700 1 Processor -- start 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.869+0000 7f8c7ec20700 1 -- start start 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780d05a0 0x7f8c78156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c78159ec0 0x7f8c780c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815a290 0x7f8c780c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780c9c60 con 0x7f8c78159ec0 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7816e3e0 con 0x7f8c780d05a0 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780c9930 con 0x7f8c7815a290 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c78159ec0 0x7f8c780c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c78159ec0 0x7f8c780c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46146/0 (socket says 172.21.15.29:46146) 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 -- 172.21.15.29:0/3358262104 learned_addr learned my addr 172.21.15.29:0/3358262104 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7d1bd700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815a290 0x7f8c780c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7c9bc700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780d05a0 0x7f8c78156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 -- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815a290 msgr2=0x7f8c780c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815a290 0x7f8c780c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 -- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780d05a0 msgr2=0x7f8c78156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780d05a0 0x7f8c78156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 -- 172.21.15.29:0/3358262104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c600094f0 con 0x7f8c78159ec0 2023-10-08T15:40:56.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c77fff700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c78159ec0 0x7f8c780c8490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800cd30 tx=0x7f8c68001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c74ff9700 1 -- 172.21.15.29:0/3358262104 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68005df0 con 0x7f8c78159ec0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c74ff9700 1 -- 172.21.15.29:0/3358262104 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800a960 con 0x7f8c78159ec0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7816e680 con 0x7f8c78159ec0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c74ff9700 1 -- 172.21.15.29:0/3358262104 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800ad20 con 0x7f8c78159ec0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c780c9080 con 0x7f8c78159ec0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.871+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c780c9790 con 0x7f8c78159ec0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.872+0000 7f8c74ff9700 1 -- 172.21.15.29:0/3358262104 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c68007300 con 0x7f8c78159ec0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.872+0000 7f8c74ff9700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.872+0000 7f8c74ff9700 1 -- 172.21.15.29:0/3358262104 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c680846c0 con 0x7f8c78159ec0 2023-10-08T15:40:56.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.873+0000 7f8c7c9bc700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:56.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.873+0000 7f8c7c9bc700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8c58066f30 0x7f8c580693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c70003870 tx=0x7f8c70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:56.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:56.877+0000 7f8c74ff9700 1 -- 172.21.15.29:0/3358262104 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c780c9790 con 0x7f8c78159ec0 2023-10-08T15:40:57.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.069+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8c780c9790 con 0x7f8c78159ec0 2023-10-08T15:40:57.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.072+0000 7f8c74ff9700 1 -- 172.21.15.29:0/3358262104 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c780c9790 con 0x7f8c78159ec0 2023-10-08T15:40:57.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8c58066f30 msgr2=0x7f8c580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8c58066f30 0x7f8c580693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c70003870 tx=0x7f8c70009040 comp rx=0 tx=0).stop 2023-10-08T15:40:57.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c78159ec0 msgr2=0x7f8c780c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c78159ec0 0x7f8c780c8490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800cd30 tx=0x7f8c68001af0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 shutdown_connections 2023-10-08T15:40:57.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815a290 0x7f8c780c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780d05a0 0x7f8c78156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 --2- 172.21.15.29:0/3358262104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c78159ec0 0x7f8c780c8490 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.074+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 >> 172.21.15.29:0/3358262104 conn(0x7f8c780d1880 msgr2=0x7f8c781574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:57.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.075+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 shutdown_connections 2023-10-08T15:40:57.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.075+0000 7f8c7ec20700 1 -- 172.21.15.29:0/3358262104 wait complete. 2023-10-08T15:40:57.087 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:40:57.087 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:57.124 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:40:57.172 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:40:57.172 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T15:40:57.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:57.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-08T15:40:57.207 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:40:57.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:57.207 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T15:40:57.262 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T15:40:57.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:57.263 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-08T15:40:57.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:40:57.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:57.301 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T15:40:57.357 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-08T15:40:57.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:57.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-08T15:40:57.393 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:40:57.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:57.393 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T15:40:57.448 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-08T15:40:57.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:40:57.448 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-08T15:40:57.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:40:57.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:40:57.485 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T15:40:57.541 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T15:40:57.541 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:57.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.659+0000 7f806c3bd700 1 Processor -- start 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.660+0000 7f806c3bd700 1 -- start start 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.660+0000 7f806c3bd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640c75c0 0x7f80640c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.660+0000 7f806c3bd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f80640abeb0 0x7f80640c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.660+0000 7f806c3bd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80640c9cb0 con 0x7f80640abae0 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.660+0000 7f806c3bd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80640c8e80 con 0x7f80640abeb0 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.660+0000 7f806c3bd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c90a0 con 0x7f80640c75c0 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f8069958700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640c75c0 0x7f80640c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f806a95a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f80640abeb0 0x7f80640c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f8069958700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640c75c0 0x7f80640c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:59866/0 (socket says 172.21.15.29:59866) 2023-10-08T15:40:57.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f806a159700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f80640abae0 0x7f80640c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:37402/0 (socket says 172.21.15.29:37402) 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f8069958700 1 -- 172.21.15.29:0/1697306939 learned_addr learned my addr 172.21.15.29:0/1697306939 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f806a95a700 1 -- 172.21.15.29:0/1697306939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640c75c0 msgr2=0x7f80640c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f806a95a700 1 --2- 172.21.15.29:0/1697306939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640c75c0 0x7f80640c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f806a95a700 1 -- 172.21.15.29:0/1697306939 >> v1:172.21.15.183:6789/0 conn(0x7f80640abae0 legacy=0x7f80640c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f806a95a700 1 -- 172.21.15.29:0/1697306939 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640c9380 con 0x7f80640abeb0 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f8069157700 1 -- 172.21.15.29:0/1697306939 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697858658 0 0) 0x7f80640c9cb0 con 0x7f80640abae0 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f8069958700 1 --2- 172.21.15.29:0/1697306939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640c75c0 0x7f80640c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.661+0000 7f806a95a700 1 --2- 172.21.15.29:0/1697306939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abeb0 0x7f80640c8940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f805400bb90 tx=0x7f805400b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc13cb867ee27d15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f8069157700 1 -- 172.21.15.29:0/1697306939 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805400db40 con 0x7f80640abeb0 2023-10-08T15:40:57.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f8069157700 1 -- 172.21.15.29:0/1697306939 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805400dca0 con 0x7f80640abeb0 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f8069157700 1 -- 172.21.15.29:0/1697306939 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80540196b0 con 0x7f80640abeb0 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f806c3bd700 1 -- 172.21.15.29:0/1697306939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abeb0 msgr2=0x7f80640c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f806c3bd700 1 --2- 172.21.15.29:0/1697306939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abeb0 0x7f80640c8940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f805400bb90 tx=0x7f805400b430 comp rx=0 tx=0).stop 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f806c3bd700 1 -- 172.21.15.29:0/1697306939 shutdown_connections 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f806c3bd700 1 --2- 172.21.15.29:0/1697306939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abeb0 0x7f80640c8940 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f806c3bd700 1 --2- 172.21.15.29:0/1697306939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640c75c0 0x7f80640c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f806c3bd700 1 -- 172.21.15.29:0/1697306939 >> 172.21.15.29:0/1697306939 conn(0x7f8064067660 msgr2=0x7f8064067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f806c3bd700 1 -- 172.21.15.29:0/1697306939 shutdown_connections 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.662+0000 7f806c3bd700 1 -- 172.21.15.29:0/1697306939 wait complete. 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.663+0000 7f806c3bd700 1 Processor -- start 2023-10-08T15:40:57.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.663+0000 7f806c3bd700 1 -- start start 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806c3bd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abae0 0x7f80640c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806c3bd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640abeb0 0x7f8064165810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806c3bd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80640c75c0 0x7f80640b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806c3bd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c61d0 con 0x7f80640c75c0 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806c3bd700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c4130 con 0x7f80640abae0 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806c3bd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80640b0550 con 0x7f80640abeb0 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a95a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80640c75c0 0x7f80640b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a95a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80640c75c0 0x7f80640b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46152/0 (socket says 172.21.15.29:46152) 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a95a700 1 -- 172.21.15.29:0/4285840426 learned_addr learned my addr 172.21.15.29:0/4285840426 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:57.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a159700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abae0 0x7f80640c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f8069958700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640abeb0 0x7f8064165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a95a700 1 -- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640abeb0 msgr2=0x7f8064165810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a95a700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640abeb0 0x7f8064165810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a95a700 1 -- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abae0 msgr2=0x7f80640c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a95a700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abae0 0x7f80640c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.664+0000 7f806a95a700 1 -- 172.21.15.29:0/4285840426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80580094f0 con 0x7f80640c75c0 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.665+0000 7f806a95a700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80640c75c0 0x7f80640b0a50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f805400b2c0 tx=0x7f805401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.665+0000 7f80627fc700 1 -- 172.21.15.29:0/4285840426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054010850 con 0x7f80640c75c0 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.665+0000 7f80627fc700 1 -- 172.21.15.29:0/4285840426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80540109b0 con 0x7f80640c75c0 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.665+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805400b6d0 con 0x7f80640c75c0 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.665+0000 7f80627fc700 1 -- 172.21.15.29:0/4285840426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054010d70 con 0x7f80640c75c0 2023-10-08T15:40:57.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.665+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80640c6750 con 0x7f80640c75c0 2023-10-08T15:40:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.666+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8064157770 con 0x7f80640c75c0 2023-10-08T15:40:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.666+0000 7f80627fc700 1 -- 172.21.15.29:0/4285840426 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8054023070 con 0x7f80640c75c0 2023-10-08T15:40:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.667+0000 7f80627fc700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8050066f30 0x7f80500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.667+0000 7f80627fc700 1 -- 172.21.15.29:0/4285840426 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8054014070 con 0x7f80640c75c0 2023-10-08T15:40:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.667+0000 7f806a159700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8050066f30 0x7f80500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.667+0000 7f806a159700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8050066f30 0x7f80500693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f805c001560 tx=0x7f805c001b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:57.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.671+0000 7f80627fc700 1 -- 172.21.15.29:0/4285840426 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8054055840 con 0x7f80640c75c0 2023-10-08T15:40:57.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.908+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f806404c3c0 con 0x7f80640c75c0 2023-10-08T15:40:57.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.909+0000 7f80627fc700 1 -- 172.21.15.29:0/4285840426 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f8054058e60 con 0x7f80640c75c0 2023-10-08T15:40:57.909 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:57.909 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:23.085169+0000","modified":"2023-10-08T15:40:26.715893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:40:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8050066f30 msgr2=0x7f80500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8050066f30 0x7f80500693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f805c001560 tx=0x7f805c001b00 comp rx=0 tx=0).stop 2023-10-08T15:40:57.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80640c75c0 msgr2=0x7f80640b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80640c75c0 0x7f80640b0a50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f805400b2c0 tx=0x7f805401b000 comp rx=0 tx=0).stop 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 shutdown_connections 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8050066f30 0x7f80500693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80640c75c0 0x7f80640b0a50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80640abae0 0x7f80640c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 --2- 172.21.15.29:0/4285840426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80640abeb0 0x7f8064165810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.910+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 >> 172.21.15.29:0/4285840426 conn(0x7f8064067660 msgr2=0x7f8064068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.911+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 shutdown_connections 2023-10-08T15:40:57.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:57.911+0000 7f806c3bd700 1 -- 172.21.15.29:0/4285840426 wait complete. 2023-10-08T15:40:57.913 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2023-10-08T15:40:57.923 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:58.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.041+0000 7fc91fd5a700 1 Processor -- start 2023-10-08T15:40:58.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.041+0000 7fc91fd5a700 1 -- start start 2023-10-08T15:40:58.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.042+0000 7fc91fd5a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc918157ba0 0x7fc91806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.042+0000 7fc91fd5a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc91815b0d0 0x7fc91806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.042+0000 7fc91fd5a700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91815c360 con 0x7fc9181577d0 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.042+0000 7fc91fd5a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91815b790 con 0x7fc918157ba0 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.042+0000 7fc91fd5a700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91815d800 con 0x7fc91815b0d0 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.042+0000 7fc91d2f5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc918157ba0 0x7fc91806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.042+0000 7fc91d2f5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc918157ba0 0x7fc91806a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46168/0 (socket says 172.21.15.29:46168) 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.042+0000 7fc91d2f5700 1 -- 172.21.15.29:0/516215495 learned_addr learned my addr 172.21.15.29:0/516215495 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91e2f7700 1 --2- 172.21.15.29:0/516215495 >> v2:172.21.15.183:3300/0 conn(0x7fc91815b0d0 0x7fc91806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91d2f5700 1 -- 172.21.15.29:0/516215495 >> v2:172.21.15.183:3300/0 conn(0x7fc91815b0d0 msgr2=0x7fc91806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91d2f5700 1 --2- 172.21.15.29:0/516215495 >> v2:172.21.15.183:3300/0 conn(0x7fc91815b0d0 0x7fc91806aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91d2f5700 1 -- 172.21.15.29:0/516215495 >> v1:172.21.15.183:6789/0 conn(0x7fc9181577d0 legacy=0x7fc9180cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91d2f5700 1 -- 172.21.15.29:0/516215495 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91815ba30 con 0x7fc918157ba0 2023-10-08T15:40:58.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91d2f5700 1 --2- 172.21.15.29:0/516215495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc918157ba0 0x7fc91806a520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b6d90 tx=0x7fc90c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0c89fcf23dbd19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91caf4700 1 -- 172.21.15.29:0/516215495 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00b860 con 0x7fc918157ba0 2023-10-08T15:40:58.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91caf4700 1 -- 172.21.15.29:0/516215495 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c00b9c0 con 0x7fc918157ba0 2023-10-08T15:40:58.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.043+0000 7fc91caf4700 1 -- 172.21.15.29:0/516215495 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00bd60 con 0x7fc918157ba0 2023-10-08T15:40:58.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.044+0000 7fc91fd5a700 1 -- 172.21.15.29:0/516215495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc918157ba0 msgr2=0x7fc91806a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.044+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/516215495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc918157ba0 0x7fc91806a520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b6d90 tx=0x7fc90c009250 comp rx=0 tx=0).stop 2023-10-08T15:40:58.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.044+0000 7fc91fd5a700 1 -- 172.21.15.29:0/516215495 shutdown_connections 2023-10-08T15:40:58.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.044+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/516215495 >> v2:172.21.15.183:3300/0 conn(0x7fc91815b0d0 0x7fc91806aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.044+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/516215495 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc918157ba0 0x7fc91806a520 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.044+0000 7fc91fd5a700 1 -- 172.21.15.29:0/516215495 >> 172.21.15.29:0/516215495 conn(0x7fc918068ce0 msgr2=0x7fc9180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.044+0000 7fc91fd5a700 1 -- 172.21.15.29:0/516215495 shutdown_connections 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.044+0000 7fc91fd5a700 1 -- 172.21.15.29:0/516215495 wait complete. 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.045+0000 7fc91fd5a700 1 Processor -- start 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.045+0000 7fc91fd5a700 1 -- start start 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.045+0000 7fc91fd5a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9181577d0 0x7fc9180b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.045+0000 7fc91fd5a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc918157ba0 0x7fc9180d1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.045+0000 7fc91fd5a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc91815b0d0 0x7fc91815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91fd5a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180b1700 con 0x7fc9181577d0 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91fd5a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180b0af0 con 0x7fc918157ba0 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91fd5a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180b0dd0 con 0x7fc91815b0d0 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9181577d0 0x7fc9180b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9181577d0 0x7fc9180b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46178/0 (socket says 172.21.15.29:46178) 2023-10-08T15:40:58.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 -- 172.21.15.29:0/3433127092 learned_addr learned my addr 172.21.15.29:0/3433127092 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91d2f5700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc918157ba0 0x7fc9180d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91e2f7700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc91815b0d0 0x7fc91815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 -- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc91815b0d0 msgr2=0x7fc91815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc91815b0d0 0x7fc91815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 -- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc918157ba0 msgr2=0x7fc9180d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc918157ba0 0x7fc9180d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 -- 172.21.15.29:0/3433127092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0094f0 con 0x7fc9181577d0 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91daf6700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9181577d0 0x7fc9180b2300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc90800cb40 tx=0x7fc908001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc915ffb700 1 -- 172.21.15.29:0/3433127092 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908002060 con 0x7fc9181577d0 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc915ffb700 1 -- 172.21.15.29:0/3433127092 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90800a7e0 con 0x7fc9181577d0 2023-10-08T15:40:58.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9180b10b0 con 0x7fc9181577d0 2023-10-08T15:40:58.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.046+0000 7fc915ffb700 1 -- 172.21.15.29:0/3433127092 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90800aba0 con 0x7fc9181577d0 2023-10-08T15:40:58.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.047+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9180b2840 con 0x7fc9181577d0 2023-10-08T15:40:58.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.047+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91804c3c0 con 0x7fc9181577d0 2023-10-08T15:40:58.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.048+0000 7fc915ffb700 1 -- 172.21.15.29:0/3433127092 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc908003030 con 0x7fc9181577d0 2023-10-08T15:40:58.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.048+0000 7fc915ffb700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc904066f30 0x7fc9040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.048+0000 7fc915ffb700 1 -- 172.21.15.29:0/3433127092 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc908084510 con 0x7fc9181577d0 2023-10-08T15:40:58.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.048+0000 7fc91d2f5700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc904066f30 0x7fc9040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.049+0000 7fc91d2f5700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc904066f30 0x7fc9040693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b6d90 tx=0x7fc90c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.052+0000 7fc915ffb700 1 -- 172.21.15.29:0/3433127092 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9080516e0 con 0x7fc9181577d0 2023-10-08T15:40:58.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.247+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc91815bd10 con 0x7fc9181577d0 2023-10-08T15:40:58.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.248+0000 7fc915ffb700 1 -- 172.21.15.29:0/3433127092 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc908054d00 con 0x7fc9181577d0 2023-10-08T15:40:58.249 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:58.249 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:58.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc904066f30 msgr2=0x7fc9040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc904066f30 0x7fc9040693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b6d90 tx=0x7fc90c017000 comp rx=0 tx=0).stop 2023-10-08T15:40:58.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9181577d0 msgr2=0x7fc9180b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9181577d0 0x7fc9180b2300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc90800cb40 tx=0x7fc908001770 comp rx=0 tx=0).stop 2023-10-08T15:40:58.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 shutdown_connections 2023-10-08T15:40:58.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc904066f30 0x7fc9040693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc91815b0d0 0x7fc91815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9181577d0 0x7fc9180b2300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 --2- 172.21.15.29:0/3433127092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc918157ba0 0x7fc9180d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 >> 172.21.15.29:0/3433127092 conn(0x7fc918068ce0 msgr2=0x7fc91814c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 shutdown_connections 2023-10-08T15:40:58.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.250+0000 7fc91fd5a700 1 -- 172.21.15.29:0/3433127092 wait complete. 2023-10-08T15:40:58.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:40:20.956808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:40:22.081738+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:40:58.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:40:58.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.385+0000 7fb63fe9b700 1 Processor -- start 2023-10-08T15:40:58.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.385+0000 7fb63fe9b700 1 -- start start 2023-10-08T15:40:58.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63fe9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb638159ec0 0x7fb6380af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63fe9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb63806acb0 0x7fb6380afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63fe9b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6380b0790 con 0x7fb63815a290 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63fe9b700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6380ce1f0 con 0x7fb63806acb0 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63fe9b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6380b0b20 con 0x7fb638159ec0 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63e438700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb63806acb0 0x7fb6380afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63e438700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb63806acb0 0x7fb6380afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49644/0 (socket says 172.21.15.29:49644) 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63e438700 1 -- 172.21.15.29:0/1238780388 learned_addr learned my addr 172.21.15.29:0/1238780388 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63e438700 1 -- 172.21.15.29:0/1238780388 >> v2:172.21.15.183:3300/0 conn(0x7fb638159ec0 msgr2=0x7fb6380af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63e438700 1 --2- 172.21.15.29:0/1238780388 >> v2:172.21.15.183:3300/0 conn(0x7fb638159ec0 0x7fb6380af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63e438700 1 -- 172.21.15.29:0/1238780388 >> v1:172.21.15.183:6789/0 conn(0x7fb63815a290 legacy=0x7fb63806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63e438700 1 -- 172.21.15.29:0/1238780388 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380b04b0 con 0x7fb63806acb0 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63e438700 1 --2- 172.21.15.29:0/1238780388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806acb0 0x7fb6380afe80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6380898e0 tx=0x7fb630009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147d9a78b25ae8a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63cc35700 1 -- 172.21.15.29:0/1238780388 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000b820 con 0x7fb63806acb0 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63cc35700 1 -- 172.21.15.29:0/1238780388 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63000b980 con 0x7fb63806acb0 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.386+0000 7fb63cc35700 1 -- 172.21.15.29:0/1238780388 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000bd20 con 0x7fb63806acb0 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.387+0000 7fb63fe9b700 1 -- 172.21.15.29:0/1238780388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806acb0 msgr2=0x7fb6380afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.387+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/1238780388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806acb0 0x7fb6380afe80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6380898e0 tx=0x7fb630009250 comp rx=0 tx=0).stop 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.387+0000 7fb63fe9b700 1 -- 172.21.15.29:0/1238780388 shutdown_connections 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.387+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/1238780388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806acb0 0x7fb6380afe80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.387+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/1238780388 >> v2:172.21.15.183:3300/0 conn(0x7fb638159ec0 0x7fb6380af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.387+0000 7fb63fe9b700 1 -- 172.21.15.29:0/1238780388 >> 172.21.15.29:0/1238780388 conn(0x7fb6380d1880 msgr2=0x7fb6380cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.387+0000 7fb63fe9b700 1 -- 172.21.15.29:0/1238780388 shutdown_connections 2023-10-08T15:40:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.387+0000 7fb63fe9b700 1 -- 172.21.15.29:0/1238780388 wait complete. 2023-10-08T15:40:58.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.388+0000 7fb63fe9b700 1 Processor -- start 2023-10-08T15:40:58.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.388+0000 7fb63fe9b700 1 -- start start 2023-10-08T15:40:58.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63fe9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb63806acb0 0x7fb6380b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63fe9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb638159ec0 0x7fb6380caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63fe9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63815a290 0x7fb63815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63fe9b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6381550a0 con 0x7fb63815a290 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63fe9b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380b69d0 con 0x7fb63806acb0 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63fe9b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380b6000 con 0x7fb638159ec0 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63815a290 0x7fb63815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63815a290 0x7fb63815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49652/0 (socket says 172.21.15.29:49652) 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 -- 172.21.15.29:0/3489991136 learned_addr learned my addr 172.21.15.29:0/3489991136 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63d436700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb638159ec0 0x7fb6380caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63dc37700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb63806acb0 0x7fb6380b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 -- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb638159ec0 msgr2=0x7fb6380caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb638159ec0 0x7fb6380caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 -- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb63806acb0 msgr2=0x7fb6380b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb63806acb0 0x7fb6380b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 -- 172.21.15.29:0/3489991136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300094f0 con 0x7fb63815a290 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.389+0000 7fb63e438700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63815a290 0x7fb63815b200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb638071eb0 tx=0x7fb630016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.390+0000 7fb635ffb700 1 -- 172.21.15.29:0/3489991136 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630011e80 con 0x7fb63815a290 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.390+0000 7fb635ffb700 1 -- 172.21.15.29:0/3489991136 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63001f070 con 0x7fb63815a290 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.390+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6380b53f0 con 0x7fb63815a290 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.390+0000 7fb635ffb700 1 -- 172.21.15.29:0/3489991136 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63001a8a0 con 0x7fb63815a290 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.390+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6380b59b0 con 0x7fb63815a290 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.391+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6380b6170 con 0x7fb63815a290 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.391+0000 7fb635ffb700 1 -- 172.21.15.29:0/3489991136 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb63001ac50 con 0x7fb63815a290 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.392+0000 7fb635ffb700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb624066f30 0x7fb6240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.392+0000 7fb635ffb700 1 -- 172.21.15.29:0/3489991136 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb630021070 con 0x7fb63815a290 2023-10-08T15:40:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.392+0000 7fb63dc37700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb624066f30 0x7fb6240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.392+0000 7fb63dc37700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb624066f30 0x7fb6240693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb628007580 tx=0x7fb628009780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.396+0000 7fb635ffb700 1 -- 172.21.15.29:0/3489991136 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb630053a20 con 0x7fb63815a290 2023-10-08T15:40:58.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.591+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb63815bf10 con 0x7fb63815a290 2023-10-08T15:40:58.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.591+0000 7fb635ffb700 1 -- 172.21.15.29:0/3489991136 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb630057040 con 0x7fb63815a290 2023-10-08T15:40:58.592 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:40:58.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb624066f30 msgr2=0x7fb6240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb624066f30 0x7fb6240693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb628007580 tx=0x7fb628009780 comp rx=0 tx=0).stop 2023-10-08T15:40:58.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63815a290 msgr2=0x7fb63815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63815a290 0x7fb63815b200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb638071eb0 tx=0x7fb630016000 comp rx=0 tx=0).stop 2023-10-08T15:40:58.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 shutdown_connections 2023-10-08T15:40:58.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb624066f30 0x7fb6240693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63815a290 0x7fb63815b200 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb63806acb0 0x7fb6380b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 --2- 172.21.15.29:0/3489991136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb638159ec0 0x7fb6380caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 >> 172.21.15.29:0/3489991136 conn(0x7fb6380d1880 msgr2=0x7fb6380b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 shutdown_connections 2023-10-08T15:40:58.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.593+0000 7fb63fe9b700 1 -- 172.21.15.29:0/3489991136 wait complete. 2023-10-08T15:40:58.606 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:40:58.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.728+0000 7fea9f59e700 1 Processor -- start 2023-10-08T15:40:58.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.728+0000 7fea9f59e700 1 -- start start 2023-10-08T15:40:58.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.729+0000 7fea9f59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa006f060 0x7feaa015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.729+0000 7fea9f59e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feaa006f430 0x7feaa00c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.729+0000 7fea9f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa00c7710 con 0x7feaa00ca250 2023-10-08T15:40:58.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.729+0000 7fea9f59e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa006fcb0 con 0x7feaa006f430 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.729+0000 7fea9f59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00c79f0 con 0x7feaa006f060 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.729+0000 7fea9dd9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7feaa00ca250 0x7feaa015b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51504/0 (socket says 172.21.15.29:51504) 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.729+0000 7fea9dd9b700 1 -- 172.21.15.29:0/4178498457 learned_addr learned my addr 172.21.15.29:0/4178498457 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631656645 0 0) 0x7feaa00c7710 con 0x7feaa00ca250 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea8c003570 con 0x7feaa00ca250 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9e59c700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa006f060 0x7feaa015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9ed9d700 1 --2- 172.21.15.29:0/4178498457 >> v2:172.21.15.183:3300/0 conn(0x7feaa006f430 0x7feaa00c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 777566240 0 0) 0x7fea8c003570 con 0x7feaa00ca250 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa006f060 msgr2=0x7feaa015ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa006f060 0x7feaa015ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 >> v2:172.21.15.183:3300/0 conn(0x7feaa006f430 msgr2=0x7feaa00c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 --2- 172.21.15.29:0/4178498457 >> v2:172.21.15.183:3300/0 conn(0x7feaa006f430 0x7feaa00c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00c7cd0 con 0x7feaa00ca250 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fea88001470 con 0x7feaa00ca250 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 >> v1:172.21.15.29:6789/0 conn(0x7feaa00ca250 legacy=0x7feaa015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea8c003a60 0x7fea8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea8c004810 0x7fea8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa006f060 0x7fea8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa006fcb0 con 0x7fea8c004810 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00c79f0 con 0x7fea8c003a60 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c00ba60 con 0x7feaa006f060 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9dd9b700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea8c004810 0x7fea8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9e59c700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea8c003a60 0x7fea8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9ed9d700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa006f060 0x7fea8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9dd9b700 1 -- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa006f060 msgr2=0x7fea8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9dd9b700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa006f060 0x7fea8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9dd9b700 1 -- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea8c003a60 msgr2=0x7fea8c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9dd9b700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea8c003a60 0x7fea8c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9dd9b700 1 -- 172.21.15.29:0/4178498457 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c003570 con 0x7fea8c004810 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.730+0000 7fea9dd9b700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea8c004810 0x7fea8c004c80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea8800c3f0 tx=0x7fea88001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb563c3bc7ce74e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8800cc80 con 0x7fea8c004810 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8800ce00 con 0x7fea8c004810 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9d59a700 1 -- 172.21.15.29:0/4178498457 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88005b70 con 0x7fea8c004810 2023-10-08T15:40:58.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9f59e700 1 -- 172.21.15.29:0/4178498457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea8c004810 msgr2=0x7fea8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9f59e700 1 --2- 172.21.15.29:0/4178498457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea8c004810 0x7fea8c004c80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea8800c3f0 tx=0x7fea88001e90 comp rx=0 tx=0).stop 2023-10-08T15:40:58.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9ed9d700 1 -- 172.21.15.29:0/4178498457 reap_dead start 2023-10-08T15:40:58.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9f59e700 1 -- 172.21.15.29:0/4178498457 shutdown_connections 2023-10-08T15:40:58.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9f59e700 1 -- 172.21.15.29:0/4178498457 >> 172.21.15.29:0/4178498457 conn(0x7feaa00cdba0 msgr2=0x7feaa00c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9f59e700 1 -- 172.21.15.29:0/4178498457 shutdown_connections 2023-10-08T15:40:58.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.731+0000 7fea9f59e700 1 -- 172.21.15.29:0/4178498457 wait complete. 2023-10-08T15:40:58.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.732+0000 7fea9f59e700 1 Processor -- start 2023-10-08T15:40:58.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.732+0000 7fea9f59e700 1 -- start start 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9f59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea8c004810 0x7feaa00c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaa00b0f50 0x7feaa00c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9f59e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa00b2460 0x7feaa00c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00b1fd0 con 0x7feaa00b0f50 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9f59e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00b13c0 con 0x7feaa00b2460 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9f59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00b16a0 con 0x7fea8c004810 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaa00b0f50 0x7feaa00c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaa00b0f50 0x7feaa00c2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49676/0 (socket says 172.21.15.29:49676) 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9dd9b700 1 -- 172.21.15.29:0/3968746529 learned_addr learned my addr 172.21.15.29:0/3968746529 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9e59c700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea8c004810 0x7feaa00c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.733+0000 7fea9ed9d700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa00b2460 0x7feaa00c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea9dd9b700 1 -- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea8c004810 msgr2=0x7feaa00c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea9dd9b700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea8c004810 0x7feaa00c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea9dd9b700 1 -- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa00b2460 msgr2=0x7feaa00c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea9dd9b700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa00b2460 0x7feaa00c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea9dd9b700 1 -- 172.21.15.29:0/3968746529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00b1980 con 0x7feaa00b0f50 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea9dd9b700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaa00b0f50 0x7feaa00c2470 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea88001ed0 tx=0x7fea88015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea967fc700 1 -- 172.21.15.29:0/3968746529 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880072e0 con 0x7feaa00b0f50 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea967fc700 1 -- 172.21.15.29:0/3968746529 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea88007460 con 0x7feaa00b0f50 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa00b1c60 con 0x7feaa00b0f50 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea967fc700 1 -- 172.21.15.29:0/3968746529 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88007820 con 0x7feaa00b0f50 2023-10-08T15:40:58.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.734+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa00c1ca0 con 0x7feaa00b0f50 2023-10-08T15:40:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.735+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa00b2180 con 0x7feaa00b0f50 2023-10-08T15:40:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.735+0000 7fea967fc700 1 -- 172.21.15.29:0/3968746529 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea88019030 con 0x7feaa00b0f50 2023-10-08T15:40:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.736+0000 7fea967fc700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fea80066f30 0x7fea800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.736+0000 7fea967fc700 1 -- 172.21.15.29:0/3968746529 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea88085080 con 0x7feaa00b0f50 2023-10-08T15:40:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.736+0000 7fea9e59c700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fea80066f30 0x7fea800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.736+0000 7fea9e59c700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fea80066f30 0x7fea800693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea98006f00 tx=0x7fea980091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:58.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.740+0000 7fea967fc700 1 -- 172.21.15.29:0/3968746529 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feaa00b2180 con 0x7feaa00b0f50 2023-10-08T15:40:58.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.931+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feaa00c7fb0 con 0x7feaa00b0f50 2023-10-08T15:40:58.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.931+0000 7fea967fc700 1 -- 172.21.15.29:0/3968746529 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea880522f0 con 0x7feaa00b0f50 2023-10-08T15:40:58.932 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:40:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fea80066f30 msgr2=0x7fea800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fea80066f30 0x7fea800693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea98006f00 tx=0x7fea980091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaa00b0f50 msgr2=0x7feaa00c2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:58.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaa00b0f50 0x7feaa00c2470 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea88001ed0 tx=0x7fea88015000 comp rx=0 tx=0).stop 2023-10-08T15:40:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 shutdown_connections 2023-10-08T15:40:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fea80066f30 0x7fea800693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa00b2460 0x7feaa00c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea8c004810 0x7feaa00c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 --2- 172.21.15.29:0/3968746529 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feaa00b0f50 0x7feaa00c2470 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 >> 172.21.15.29:0/3968746529 conn(0x7feaa00cdba0 msgr2=0x7feaa00af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 shutdown_connections 2023-10-08T15:40:58.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:58.933+0000 7fea9f59e700 1 -- 172.21.15.29:0/3968746529 wait complete. 2023-10-08T15:40:58.946 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:40:59.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.067+0000 7f923689a700 1 Processor -- start 2023-10-08T15:40:59.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.067+0000 7f923689a700 1 -- start start 2023-10-08T15:40:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.068+0000 7f923689a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.068+0000 7f923689a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92301513f0 con 0x7f923015afb0 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.068+0000 7f923689a700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923015db20 con 0x7f92300cd300 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.068+0000 7f923689a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923015e7a0 con 0x7f92300d1470 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.068+0000 7f922f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f923015afb0 0x7f92300d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51506/0 (socket says 172.21.15.29:51506) 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.068+0000 7f922f7fe700 1 -- 172.21.15.29:0/2730676572 learned_addr learned my addr 172.21.15.29:0/2730676572 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.068+0000 7f9234e37700 1 --2- 172.21.15.29:0/2730676572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f922effd700 1 -- 172.21.15.29:0/2730676572 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086834631 0 0) 0x7f92301513f0 con 0x7f923015afb0 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f922effd700 1 -- 172.21.15.29:0/2730676572 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f921c003570 con 0x7f923015afb0 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f922effd700 1 -- 172.21.15.29:0/2730676572 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112042387 0 0) 0x7f923015db20 con 0x7f92300cd300 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f922effd700 1 -- 172.21.15.29:0/2730676572 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92301513f0 con 0x7f92300cd300 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f9234e37700 1 -- 172.21.15.29:0/2730676572 >> v1:172.21.15.183:6789/0 conn(0x7f92300cd300 legacy=0x7f92300b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f9234e37700 1 -- 172.21.15.29:0/2730676572 >> v1:172.21.15.29:6789/0 conn(0x7f923015afb0 legacy=0x7f92300d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f922effd700 1 -- 172.21.15.29:0/2730676572 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849163675 0 0) 0x7f921c003570 con 0x7f923015afb0 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f9234e37700 1 -- 172.21.15.29:0/2730676572 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923015de00 con 0x7f92300d1470 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f9234e37700 1 --2- 172.21.15.29:0/2730676572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230164e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9228009e90 tx=0x7f9228009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3429ac11e719ac02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f922effd700 1 -- 172.21.15.29:0/2730676572 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800e070 con 0x7f92300d1470 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f922effd700 1 -- 172.21.15.29:0/2730676572 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922800bb80 con 0x7f92300d1470 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.069+0000 7f922effd700 1 -- 172.21.15.29:0/2730676572 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228012430 con 0x7f92300d1470 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.070+0000 7f923689a700 1 -- 172.21.15.29:0/2730676572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 msgr2=0x7f9230164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.070+0000 7f923689a700 1 --2- 172.21.15.29:0/2730676572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230164e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9228009e90 tx=0x7f9228009780 comp rx=0 tx=0).stop 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.070+0000 7f923689a700 1 -- 172.21.15.29:0/2730676572 shutdown_connections 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.070+0000 7f923689a700 1 --2- 172.21.15.29:0/2730676572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230164e20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.070+0000 7f923689a700 1 -- 172.21.15.29:0/2730676572 >> 172.21.15.29:0/2730676572 conn(0x7f9230068d90 msgr2=0x7f9230069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:59.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.070+0000 7f923689a700 1 -- 172.21.15.29:0/2730676572 shutdown_connections 2023-10-08T15:40:59.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.070+0000 7f923689a700 1 -- 172.21.15.29:0/2730676572 wait complete. 2023-10-08T15:40:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.071+0000 7f923689a700 1 Processor -- start 2023-10-08T15:40:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.071+0000 7f923689a700 1 -- start start 2023-10-08T15:40:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f923689a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92300cd300 0x7f92300c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f923689a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f923689a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923015afb0 0x7f92300ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f923689a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300c6fd0 con 0x7f92300cd300 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f923689a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300c63c0 con 0x7f923015afb0 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f923689a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92300c66a0 con 0x7f92300d1470 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92300cd300 0x7f92300c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92300cd300 0x7f92300c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49692/0 (socket says 172.21.15.29:49692) 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 -- 172.21.15.29:0/1042127016 learned_addr learned my addr 172.21.15.29:0/1042127016 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922f7fe700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f9234e37700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923015afb0 0x7f92300ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 -- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 msgr2=0x7f9230141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 -- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923015afb0 msgr2=0x7f92300ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923015afb0 0x7f92300ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 -- 172.21.15.29:0/1042127016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228009a20 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f9234e37700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923015afb0 0x7f92300ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.072+0000 7f922ffff700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92300cd300 0x7f92300c5b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f922000c790 tx=0x7f9220007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.073+0000 7f9227fff700 1 -- 172.21.15.29:0/1042127016 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220010510 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.073+0000 7f9227fff700 1 -- 172.21.15.29:0/1042127016 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9220010670 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.073+0000 7f9227fff700 1 -- 172.21.15.29:0/1042127016 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220010a30 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.073+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92300c6980 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.073+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92300c60b0 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.073+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923004c3c0 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.074+0000 7f9227fff700 1 -- 172.21.15.29:0/1042127016 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f922001b3b0 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.074+0000 7f9227fff700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9210066f30 0x7f92100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.074+0000 7f9227fff700 1 -- 172.21.15.29:0/1042127016 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9220083df0 con 0x7f92300cd300 2023-10-08T15:40:59.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.075+0000 7f922f7fe700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9210066f30 0x7f92100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.075+0000 7f922f7fe700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9210066f30 0x7f92100693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9218007fd0 tx=0x7f9218007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.079+0000 7f9227fff700 1 -- 172.21.15.29:0/1042127016 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9220051060 con 0x7f92300cd300 2023-10-08T15:40:59.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.270+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92300b4010 con 0x7f92300cd300 2023-10-08T15:40:59.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.270+0000 7f9227fff700 1 -- 172.21.15.29:0/1042127016 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9220017020 con 0x7f92300cd300 2023-10-08T15:40:59.271 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:40:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9210066f30 msgr2=0x7f92100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9210066f30 0x7f92100693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9218007fd0 tx=0x7f9218007d10 comp rx=0 tx=0).stop 2023-10-08T15:40:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92300cd300 msgr2=0x7f92300c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92300cd300 0x7f92300c5b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f922000c790 tx=0x7f9220007e10 comp rx=0 tx=0).stop 2023-10-08T15:40:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 shutdown_connections 2023-10-08T15:40:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9210066f30 0x7f92100693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923015afb0 0x7f92300ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92300cd300 0x7f92300c5b70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 --2- 172.21.15.29:0/1042127016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92300d1470 0x7f9230141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 >> 172.21.15.29:0/1042127016 conn(0x7f9230068d90 msgr2=0x7f9230150950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:59.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 shutdown_connections 2023-10-08T15:40:59.274 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.272+0000 7f923689a700 1 -- 172.21.15.29:0/1042127016 wait complete. 2023-10-08T15:40:59.285 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:40:59.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.404+0000 7efdb1417700 1 Processor -- start 2023-10-08T15:40:59.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.404+0000 7efdb1417700 1 -- start start 2023-10-08T15:40:59.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdb1417700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efdac159e10 0x7efdac0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdb1417700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac15a1e0 0x7efdac0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdb1417700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac15db80 con 0x7efdac0b1610 2023-10-08T15:40:59.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdb1417700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdac15e800 con 0x7efdac159e10 2023-10-08T15:40:59.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdb1417700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac15de60 con 0x7efdac15a1e0 2023-10-08T15:40:59.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdab7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efdac0b1610 0x7efdac0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51510/0 (socket says 172.21.15.29:51510) 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdab7fe700 1 -- 172.21.15.29:0/2358208955 learned_addr learned my addr 172.21.15.29:0/2358208955 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdaaffd700 1 --2- 172.21.15.29:0/2358208955 >> v2:172.21.15.183:3300/0 conn(0x7efdac159e10 0x7efdac0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdaa7fc700 1 --2- 172.21.15.29:0/2358208955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac15a1e0 0x7efdac0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efda9ffb700 1 -- 172.21.15.29:0/2358208955 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539417130 0 0) 0x7efdac15db80 con 0x7efdac0b1610 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efda9ffb700 1 -- 172.21.15.29:0/2358208955 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd98003570 con 0x7efdac0b1610 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdaa7fc700 1 -- 172.21.15.29:0/2358208955 >> v2:172.21.15.183:3300/0 conn(0x7efdac159e10 msgr2=0x7efdac0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efda9ffb700 1 -- 172.21.15.29:0/2358208955 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206591932 0 0) 0x7efd98003570 con 0x7efdac0b1610 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdaa7fc700 1 --2- 172.21.15.29:0/2358208955 >> v2:172.21.15.183:3300/0 conn(0x7efdac159e10 0x7efdac0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdaa7fc700 1 -- 172.21.15.29:0/2358208955 >> v1:172.21.15.29:6789/0 conn(0x7efdac0b1610 legacy=0x7efdac0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.405+0000 7efdaa7fc700 1 -- 172.21.15.29:0/2358208955 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac15e140 con 0x7efdac15a1e0 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdaa7fc700 1 --2- 172.21.15.29:0/2358208955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac15a1e0 0x7efdac0b3260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd940098e0 tx=0x7efd940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1668c0ba1511092 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efda9ffb700 1 -- 172.21.15.29:0/2358208955 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4001470 con 0x7efdac15a1e0 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efda9ffb700 1 -- 172.21.15.29:0/2358208955 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd94011420 con 0x7efdac15a1e0 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efda9ffb700 1 -- 172.21.15.29:0/2358208955 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940117c0 con 0x7efdac15a1e0 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdb1417700 1 -- 172.21.15.29:0/2358208955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac15a1e0 msgr2=0x7efdac0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdb1417700 1 --2- 172.21.15.29:0/2358208955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac15a1e0 0x7efdac0b3260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd940098e0 tx=0x7efd940091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdb1417700 1 -- 172.21.15.29:0/2358208955 shutdown_connections 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdb1417700 1 --2- 172.21.15.29:0/2358208955 >> v2:172.21.15.183:3300/0 conn(0x7efdac159e10 0x7efdac0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdb1417700 1 --2- 172.21.15.29:0/2358208955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac15a1e0 0x7efdac0b3260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdb1417700 1 -- 172.21.15.29:0/2358208955 >> 172.21.15.29:0/2358208955 conn(0x7efdac067660 msgr2=0x7efdac067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdb1417700 1 -- 172.21.15.29:0/2358208955 shutdown_connections 2023-10-08T15:40:59.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.406+0000 7efdb1417700 1 -- 172.21.15.29:0/2358208955 wait complete. 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdb1417700 1 Processor -- start 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdb1417700 1 -- start start 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdb1417700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdac0b1610 0x7efdac0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdb1417700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac159e10 0x7efdac16d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdb1417700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdac15a1e0 0x7efdac0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdb1417700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0cf910 con 0x7efdac15a1e0 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdb1417700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0cfbf0 con 0x7efdac0b1610 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdb1417700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac16db70 con 0x7efdac159e10 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdab7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdac15a1e0 0x7efdac0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdab7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdac15a1e0 0x7efdac0cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49708/0 (socket says 172.21.15.29:49708) 2023-10-08T15:40:59.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdaaffd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdac0b1610 0x7efdac0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdab7fe700 1 -- 172.21.15.29:0/2054605758 learned_addr learned my addr 172.21.15.29:0/2054605758 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.408+0000 7efdaa7fc700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac159e10 0x7efdac16d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efdab7fe700 1 -- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac159e10 msgr2=0x7efdac16d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efdab7fe700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac159e10 0x7efdac16d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efdab7fe700 1 -- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdac0b1610 msgr2=0x7efdac0ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efdab7fe700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdac0b1610 0x7efdac0ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efdab7fe700 1 -- 172.21.15.29:0/2054605758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94009420 con 0x7efdac15a1e0 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efdab7fe700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdac15a1e0 0x7efdac0cbd70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efda400cb60 tx=0x7efda4001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efda2ffd700 1 -- 172.21.15.29:0/2054605758 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4007150 con 0x7efdac15a1e0 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efda2ffd700 1 -- 172.21.15.29:0/2054605758 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda40072d0 con 0x7efdac15a1e0 2023-10-08T15:40:59.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac16de10 con 0x7efdac15a1e0 2023-10-08T15:40:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efda2ffd700 1 -- 172.21.15.29:0/2054605758 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4007690 con 0x7efdac15a1e0 2023-10-08T15:40:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.409+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac16e3d0 con 0x7efdac15a1e0 2023-10-08T15:40:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.410+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac0cfd60 con 0x7efdac15a1e0 2023-10-08T15:40:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.411+0000 7efda2ffd700 1 -- 172.21.15.29:0/2054605758 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efda4004a40 con 0x7efdac15a1e0 2023-10-08T15:40:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.411+0000 7efda2ffd700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd8c066f30 0x7efd8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.411+0000 7efda2ffd700 1 -- 172.21.15.29:0/2054605758 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efda4083b80 con 0x7efdac15a1e0 2023-10-08T15:40:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.411+0000 7efdaaffd700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd8c066f30 0x7efd8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.412+0000 7efdaaffd700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd8c066f30 0x7efd8c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00f570 tx=0x7efd9c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.415+0000 7efda2ffd700 1 -- 172.21.15.29:0/2054605758 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efda4050e70 con 0x7efdac15a1e0 2023-10-08T15:40:59.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.654+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdac04c3c0 con 0x7efdac15a1e0 2023-10-08T15:40:59.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.654+0000 7efda2ffd700 1 -- 172.21.15.29:0/2054605758 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7efda4018020 con 0x7efdac15a1e0 2023-10-08T15:40:59.655 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:59.655 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:23.085169+0000","modified":"2023-10-08T15:40:26.715893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd8c066f30 msgr2=0x7efd8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd8c066f30 0x7efd8c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00f570 tx=0x7efd9c00b040 comp rx=0 tx=0).stop 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdac15a1e0 msgr2=0x7efdac0cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdac15a1e0 0x7efdac0cbd70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efda400cb60 tx=0x7efda4001aa0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 shutdown_connections 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd8c066f30 0x7efd8c0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdac15a1e0 0x7efdac0cbd70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdac0b1610 0x7efdac0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 --2- 172.21.15.29:0/2054605758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdac159e10 0x7efdac16d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 >> 172.21.15.29:0/2054605758 conn(0x7efdac067660 msgr2=0x7efdac1592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 shutdown_connections 2023-10-08T15:40:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.656+0000 7efdb1417700 1 -- 172.21.15.29:0/2054605758 wait complete. 2023-10-08T15:40:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2023-10-08T15:40:59.670 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:40:59.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.789+0000 7f07bc009700 1 Processor -- start 2023-10-08T15:40:59.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.789+0000 7f07bc009700 1 -- start start 2023-10-08T15:40:59.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07bc009700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07b40cffa0 0x7f07b406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07bc009700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b40b3d40 con 0x7f07b4159e60 2023-10-08T15:40:59.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07bc009700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b40b4300 con 0x7f07b415a230 2023-10-08T15:40:59.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07bc009700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b4069d70 con 0x7f07b40cffa0 2023-10-08T15:40:59.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b95a4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07b40cffa0 0x7f07b406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b9da5700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f07b4159e60 0x7f07b40b6890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51518/0 (socket says 172.21.15.29:51518) 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b9da5700 1 -- 172.21.15.29:0/2791155505 learned_addr learned my addr 172.21.15.29:0/2791155505 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b95a4700 1 -- 172.21.15.29:0/2791155505 >> v1:172.21.15.183:6789/0 conn(0x7f07b415a230 legacy=0x7f07b4163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b95a4700 1 -- 172.21.15.29:0/2791155505 >> v1:172.21.15.29:6789/0 conn(0x7f07b4159e60 legacy=0x7f07b40b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b95a4700 1 -- 172.21.15.29:0/2791155505 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40d0480 con 0x7f07b40cffa0 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b8da3700 1 -- 172.21.15.29:0/2791155505 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173074823 0 0) 0x7f07b40b3d40 con 0x7f07b4159e60 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b95a4700 1 --2- 172.21.15.29:0/2791155505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40cffa0 0x7f07b406a6a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07a80098e0 tx=0x7f07a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e017c03eee44596 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b8da3700 1 -- 172.21.15.29:0/2791155505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8009e80 con 0x7f07b40cffa0 2023-10-08T15:40:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b8da3700 1 -- 172.21.15.29:0/2791155505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a800b860 con 0x7f07b40cffa0 2023-10-08T15:40:59.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.790+0000 7f07b8da3700 1 -- 172.21.15.29:0/2791155505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a800bbe0 con 0x7f07b40cffa0 2023-10-08T15:40:59.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.791+0000 7f07bc009700 1 -- 172.21.15.29:0/2791155505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40cffa0 msgr2=0x7f07b406a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.791+0000 7f07bc009700 1 --2- 172.21.15.29:0/2791155505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40cffa0 0x7f07b406a6a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07a80098e0 tx=0x7f07a80091a0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.791+0000 7f07bc009700 1 -- 172.21.15.29:0/2791155505 shutdown_connections 2023-10-08T15:40:59.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.791+0000 7f07bc009700 1 --2- 172.21.15.29:0/2791155505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40cffa0 0x7f07b406a6a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.791+0000 7f07bc009700 1 -- 172.21.15.29:0/2791155505 >> 172.21.15.29:0/2791155505 conn(0x7f07b40d1a50 msgr2=0x7f07b4068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:59.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.791+0000 7f07bc009700 1 -- 172.21.15.29:0/2791155505 shutdown_connections 2023-10-08T15:40:59.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.791+0000 7f07bc009700 1 -- 172.21.15.29:0/2791155505 wait complete. 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.792+0000 7f07bc009700 1 Processor -- start 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.792+0000 7f07bc009700 1 -- start start 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07bc009700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b40cffa0 0x7f07b40c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07bc009700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b4159e60 0x7f07b4158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07bc009700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b415a230 0x7f07b416abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07bc009700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c8970 con 0x7f07b415a230 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07bc009700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40cc4b0 con 0x7f07b40cffa0 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07bc009700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b416b6d0 con 0x7f07b4159e60 2023-10-08T15:40:59.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b415a230 0x7f07b416abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b415a230 0x7f07b416abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49722/0 (socket says 172.21.15.29:49722) 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 -- 172.21.15.29:0/2844299530 learned_addr learned my addr 172.21.15.29:0/2844299530 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07b95a4700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b4159e60 0x7f07b4158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07b9da5700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b40cffa0 0x7f07b40c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 -- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b4159e60 msgr2=0x7f07b4158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b4159e60 0x7f07b4158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 -- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b40cffa0 msgr2=0x7f07b40c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b40cffa0 0x7f07b40c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 -- 172.21.15.29:0/2844299530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8009420 con 0x7f07b415a230 2023-10-08T15:40:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07b95a4700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b4159e60 0x7f07b4158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:40:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.793+0000 7f07ba5a6700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b415a230 0x7f07b416abe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c840 tx=0x7f07a4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.794+0000 7f07b1ffb700 1 -- 172.21.15.29:0/2844299530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4012630 con 0x7f07b415a230 2023-10-08T15:40:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.794+0000 7f07b1ffb700 1 -- 172.21.15.29:0/2844299530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a40127b0 con 0x7f07b415a230 2023-10-08T15:40:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.794+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b416b9b0 con 0x7f07b415a230 2023-10-08T15:40:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.794+0000 7f07b1ffb700 1 -- 172.21.15.29:0/2844299530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4012b70 con 0x7f07b415a230 2023-10-08T15:40:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.794+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b40ccab0 con 0x7f07b415a230 2023-10-08T15:40:59.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.795+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b40cc620 con 0x7f07b415a230 2023-10-08T15:40:59.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.795+0000 7f07b1ffb700 1 -- 172.21.15.29:0/2844299530 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07a4003030 con 0x7f07b415a230 2023-10-08T15:40:59.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.795+0000 7f07b1ffb700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:40:59.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.795+0000 7f07b1ffb700 1 -- 172.21.15.29:0/2844299530 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07a40844f0 con 0x7f07b415a230 2023-10-08T15:40:59.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.796+0000 7f07b9da5700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:40:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.796+0000 7f07b9da5700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f07a0066f30 0x7f07a00693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f07ac000c00 tx=0x7f07ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:40:59.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.800+0000 7f07b1ffb700 1 -- 172.21.15.29:0/2844299530 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07a4051760 con 0x7f07b415a230 2023-10-08T15:40:59.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.993+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07b40b5b10 con 0x7f07b415a230 2023-10-08T15:40:59.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.994+0000 7f07b1ffb700 1 -- 172.21.15.29:0/2844299530 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f07a4054d80 con 0x7f07b415a230 2023-10-08T15:40:59.994 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:40:59.994 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:40:59.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f07a0066f30 msgr2=0x7f07a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f07a0066f30 0x7f07a00693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f07ac000c00 tx=0x7f07ac009040 comp rx=0 tx=0).stop 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b415a230 msgr2=0x7f07b416abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b415a230 0x7f07b416abe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c840 tx=0x7f07a4001670 comp rx=0 tx=0).stop 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 shutdown_connections 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b415a230 0x7f07b416abe0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07b40cffa0 0x7f07b40c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 --2- 172.21.15.29:0/2844299530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07b4159e60 0x7f07b4158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 >> 172.21.15.29:0/2844299530 conn(0x7f07b40d1a50 msgr2=0x7f07b40b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 shutdown_connections 2023-10-08T15:40:59.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:40:59.996+0000 7f07bc009700 1 -- 172.21.15.29:0/2844299530 wait complete. 2023-10-08T15:41:00.008 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T15:41:00.009 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.126+0000 7f271d091700 1 Processor -- start 2023-10-08T15:41:00.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.126+0000 7f271d091700 1 -- start start 2023-10-08T15:41:00.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f271d091700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271806f660 0x7f271806aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f271d091700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271806a050 con 0x7f2718068ae0 2023-10-08T15:41:00.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f271d091700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180acdc0 con 0x7f2718068710 2023-10-08T15:41:00.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f271d091700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c9c20 con 0x7f271806f660 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f271c890700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2718068ae0 0x7f2718070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51528/0 (socket says 172.21.15.29:51528) 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f271c890700 1 -- 172.21.15.29:0/4255151322 learned_addr learned my addr 172.21.15.29:0/4255151322 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f27177fe700 1 --2- 172.21.15.29:0/4255151322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271806f660 0x7f271806aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f2716ffd700 1 -- 172.21.15.29:0/4255151322 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775873508 0 0) 0x7f271806a050 con 0x7f2718068ae0 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.127+0000 7f2716ffd700 1 -- 172.21.15.29:0/4255151322 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2700003570 con 0x7f2718068ae0 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f2716ffd700 1 -- 172.21.15.29:0/4255151322 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548367566 0 0) 0x7f27180acdc0 con 0x7f2718068710 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f2716ffd700 1 -- 172.21.15.29:0/4255151322 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271806a050 con 0x7f2718068710 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f2716ffd700 1 -- 172.21.15.29:0/4255151322 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3028456839 0 0) 0x7f2700003570 con 0x7f2718068ae0 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f27177fe700 1 -- 172.21.15.29:0/4255151322 >> v1:172.21.15.183:6789/0 conn(0x7f2718068710 legacy=0x7f27180c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f27177fe700 1 -- 172.21.15.29:0/4255151322 >> v1:172.21.15.29:6789/0 conn(0x7f2718068ae0 legacy=0x7f2718070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f27177fe700 1 -- 172.21.15.29:0/4255151322 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180c9e00 con 0x7f271806f660 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f27177fe700 1 --2- 172.21.15.29:0/4255151322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271806f660 0x7f271806aaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f270c009910 tx=0x7f270c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613dd89ec1bb654e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f2716ffd700 1 -- 172.21.15.29:0/4255151322 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100017f0 con 0x7f271806f660 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f2716ffd700 1 -- 172.21.15.29:0/4255151322 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c011420 con 0x7f271806f660 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.128+0000 7f2716ffd700 1 -- 172.21.15.29:0/4255151322 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0117c0 con 0x7f271806f660 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.129+0000 7f271d091700 1 -- 172.21.15.29:0/4255151322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271806f660 msgr2=0x7f271806aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.129+0000 7f271d091700 1 --2- 172.21.15.29:0/4255151322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271806f660 0x7f271806aaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f270c009910 tx=0x7f270c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.129+0000 7f271d091700 1 -- 172.21.15.29:0/4255151322 shutdown_connections 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.129+0000 7f271d091700 1 --2- 172.21.15.29:0/4255151322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f271806f660 0x7f271806aaf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.129+0000 7f271d091700 1 -- 172.21.15.29:0/4255151322 >> 172.21.15.29:0/4255151322 conn(0x7f27180cd8f0 msgr2=0x7f27180cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.129+0000 7f271d091700 1 -- 172.21.15.29:0/4255151322 shutdown_connections 2023-10-08T15:41:00.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.129+0000 7f271d091700 1 -- 172.21.15.29:0/4255151322 wait complete. 2023-10-08T15:41:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.130+0000 7f271d091700 1 Processor -- start 2023-10-08T15:41:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.130+0000 7f271d091700 1 -- start start 2023-10-08T15:41:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.130+0000 7f271d091700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2718068710 0x7f2718158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271d091700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2718068ae0 0x7f27180c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271d091700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271806f660 0x7f27180c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271d091700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718159d10 con 0x7f271806f660 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271d091700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718159100 con 0x7f2718068ae0 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271d091700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27181593e0 con 0x7f2718068710 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271806f660 0x7f27180c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271806f660 0x7f27180c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49728/0 (socket says 172.21.15.29:49728) 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 -- 172.21.15.29:0/3138785229 learned_addr learned my addr 172.21.15.29:0/3138785229 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f2717fff700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2718068710 0x7f2718158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f27177fe700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2718068ae0 0x7f27180c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 -- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2718068710 msgr2=0x7f2718158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2718068710 0x7f2718158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 -- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2718068ae0 msgr2=0x7f27180c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2718068ae0 0x7f27180c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 -- 172.21.15.29:0/3138785229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009420 con 0x7f271806f660 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271c890700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271806f660 0x7f27180c59b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f271000ccc0 tx=0x7f2710007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f26fffff700 1 -- 172.21.15.29:0/3138785229 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710004dc0 con 0x7f271806f660 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f26fffff700 1 -- 172.21.15.29:0/3138785229 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000a5f0 con 0x7f271806f660 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27181596c0 con 0x7f271806f660 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f26fffff700 1 -- 172.21.15.29:0/3138785229 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000a9b0 con 0x7f271806f660 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.131+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271815a1a0 con 0x7f271806f660 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.132+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271815a420 con 0x7f271806f660 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.133+0000 7f26fffff700 1 -- 172.21.15.29:0/3138785229 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2710007150 con 0x7f271806f660 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.133+0000 7f26fffff700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2704066f30 0x7f27040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.133+0000 7f26fffff700 1 -- 172.21.15.29:0/3138785229 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2710083d70 con 0x7f271806f660 2023-10-08T15:41:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.133+0000 7f2717fff700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2704066f30 0x7f27040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.134+0000 7f2717fff700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2704066f30 0x7f27040693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2708007fd0 tx=0x7f2708007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.137+0000 7f26fffff700 1 -- 172.21.15.29:0/3138785229 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2710050f40 con 0x7f271806f660 2023-10-08T15:41:00.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.375+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27180c9a60 con 0x7f271806f660 2023-10-08T15:41:00.376 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.375+0000 7f26fffff700 1 -- 172.21.15.29:0/3138785229 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f2710018020 con 0x7f271806f660 2023-10-08T15:41:00.376 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:00.376 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:23.085169+0000","modified":"2023-10-08T15:40:26.715893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:41:00.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2704066f30 msgr2=0x7f27040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2704066f30 0x7f27040693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2708007fd0 tx=0x7f2708007d50 comp rx=0 tx=0).stop 2023-10-08T15:41:00.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271806f660 msgr2=0x7f27180c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271806f660 0x7f27180c59b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f271000ccc0 tx=0x7f2710007d20 comp rx=0 tx=0).stop 2023-10-08T15:41:00.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 shutdown_connections 2023-10-08T15:41:00.378 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2704066f30 0x7f27040693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271806f660 0x7f27180c59b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2718068710 0x7f2718158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 --2- 172.21.15.29:0/3138785229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2718068ae0 0x7f27180c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 >> 172.21.15.29:0/3138785229 conn(0x7f27180cd8f0 msgr2=0x7f27180af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 shutdown_connections 2023-10-08T15:41:00.379 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.377+0000 7f271d091700 1 -- 172.21.15.29:0/3138785229 wait complete. 2023-10-08T15:41:00.379 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2023-10-08T15:41:00.390 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:00.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.508+0000 7f1cd4720700 1 Processor -- start 2023-10-08T15:41:00.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.508+0000 7f1cd4720700 1 -- start start 2023-10-08T15:41:00.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.509+0000 7f1cd4720700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ccc157c40 0x7f1ccc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.509+0000 7f1cd4720700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc15cbb0 con 0x7f1ccc157870 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.509+0000 7f1cd4720700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc15bfa0 con 0x7f1ccc15a620 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.509+0000 7f1cd4720700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc15bdb0 con 0x7f1ccc157c40 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.509+0000 7f1cd2cbd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ccc157c40 0x7f1ccc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.509+0000 7f1cd24bc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1ccc157870 0x7f1ccc15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51540/0 (socket says 172.21.15.29:51540) 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.509+0000 7f1cd2cbd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ccc157c40 0x7f1ccc158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49730/0 (socket says 172.21.15.29:49730) 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd24bc700 1 -- 172.21.15.29:0/3542512289 learned_addr learned my addr 172.21.15.29:0/3542512289 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd2cbd700 1 -- 172.21.15.29:0/3542512289 >> v1:172.21.15.183:6789/0 conn(0x7f1ccc15a620 legacy=0x7f1ccc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd2cbd700 1 -- 172.21.15.29:0/3542512289 >> v1:172.21.15.29:6789/0 conn(0x7f1ccc157870 legacy=0x7f1ccc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd2cbd700 1 -- 172.21.15.29:0/3542512289 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc15c280 con 0x7f1ccc157c40 2023-10-08T15:41:00.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd14ba700 1 -- 172.21.15.29:0/3542512289 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961469897 0 0) 0x7f1ccc15cbb0 con 0x7f1ccc157870 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd2cbd700 1 --2- 172.21.15.29:0/3542512289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc157c40 0x7f1ccc158110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009e60 tx=0x7f1cbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dc427429aded1f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd14ba700 1 -- 172.21.15.29:0/3542512289 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00e070 con 0x7f1ccc157c40 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd14ba700 1 -- 172.21.15.29:0/3542512289 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00bc30 con 0x7f1ccc157c40 2023-10-08T15:41:00.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.510+0000 7f1cd14ba700 1 -- 172.21.15.29:0/3542512289 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc012430 con 0x7f1ccc157c40 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.511+0000 7f1cd4720700 1 -- 172.21.15.29:0/3542512289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc157c40 msgr2=0x7f1ccc158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.511+0000 7f1cd4720700 1 --2- 172.21.15.29:0/3542512289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc157c40 0x7f1ccc158110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009e60 tx=0x7f1cbc009780 comp rx=0 tx=0).stop 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.511+0000 7f1cd4720700 1 -- 172.21.15.29:0/3542512289 shutdown_connections 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.511+0000 7f1cd4720700 1 --2- 172.21.15.29:0/3542512289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc157c40 0x7f1ccc158110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.511+0000 7f1cd4720700 1 -- 172.21.15.29:0/3542512289 >> 172.21.15.29:0/3542512289 conn(0x7f1ccc068ce0 msgr2=0x7f1ccc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.511+0000 7f1cd4720700 1 -- 172.21.15.29:0/3542512289 shutdown_connections 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.511+0000 7f1cd4720700 1 -- 172.21.15.29:0/3542512289 wait complete. 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.512+0000 7f1cd4720700 1 Processor -- start 2023-10-08T15:41:00.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.512+0000 7f1cd4720700 1 -- start start 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd4720700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ccc157870 0x7f1ccc13f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd4720700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ccc157c40 0x7f1ccc16a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd4720700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc15a620 0x7f1ccc16aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd4720700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc16af40 con 0x7f1ccc15a620 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd4720700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0b1840 con 0x7f1ccc157870 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd4720700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc13f6e0 con 0x7f1ccc157c40 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc15a620 0x7f1ccc16aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc15a620 0x7f1ccc16aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49734/0 (socket says 172.21.15.29:49734) 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 -- 172.21.15.29:0/4243594624 learned_addr learned my addr 172.21.15.29:0/4243594624 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd24bc700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ccc157870 0x7f1ccc13f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd1cbb700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ccc157c40 0x7f1ccc16a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 -- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ccc157c40 msgr2=0x7f1ccc16a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ccc157c40 0x7f1ccc16a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 -- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ccc157870 msgr2=0x7f1ccc13f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ccc157870 0x7f1ccc13f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 -- 172.21.15.29:0/4243594624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc009a20 con 0x7f1ccc15a620 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd24bc700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ccc157870 0x7f1ccc13f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd2cbd700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc15a620 0x7f1ccc16aa00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b6c0 tx=0x7f1cbc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cca7fc700 1 -- 172.21.15.29:0/4243594624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc01b630 con 0x7f1ccc15a620 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cca7fc700 1 -- 172.21.15.29:0/4243594624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc01b7b0 con 0x7f1ccc15a620 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cca7fc700 1 -- 172.21.15.29:0/4243594624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc01bb70 con 0x7f1ccc15a620 2023-10-08T15:41:00.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc153a80 con 0x7f1ccc15a620 2023-10-08T15:41:00.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.513+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc154040 con 0x7f1ccc15a620 2023-10-08T15:41:00.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.514+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc04c3c0 con 0x7f1ccc15a620 2023-10-08T15:41:00.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.515+0000 7f1cca7fc700 1 -- 172.21.15.29:0/4243594624 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cbc01c400 con 0x7f1ccc15a620 2023-10-08T15:41:00.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.515+0000 7f1cca7fc700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1cb8066f30 0x7f1cb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.515+0000 7f1cca7fc700 1 -- 172.21.15.29:0/4243594624 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cbc086060 con 0x7f1ccc15a620 2023-10-08T15:41:00.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.515+0000 7f1cd24bc700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1cb8066f30 0x7f1cb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.516+0000 7f1cd24bc700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1cb8066f30 0x7f1cb80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40011e0 tx=0x7f1cc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.519+0000 7f1cca7fc700 1 -- 172.21.15.29:0/4243594624 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cbc053310 con 0x7f1ccc15a620 2023-10-08T15:41:00.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.759+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ccc15c560 con 0x7f1ccc15a620 2023-10-08T15:41:00.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.760+0000 7f1cca7fc700 1 -- 172.21.15.29:0/4243594624 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f1cbc0568f0 con 0x7f1ccc15a620 2023-10-08T15:41:00.760 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:00.760 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1149854253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1149854253},{"type":"v1","addr":"172.21.15.29:6834","nonce":1149854253}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3807602059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3807602059},{"type":"v1","addr":"172.21.15.29:6835","nonce":3807602059}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1314040547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":1314040547},{"type":"v1","addr":"172.21.15.183:6836","nonce":1314040547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:40:23.085169+0000","modified":"2023-10-08T15:40:26.715893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/1226540974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1226540974},{"type":"v1","addr":"172.21.15.183:6837","nonce":1226540974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T15:41:00.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1cb8066f30 msgr2=0x7f1cb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1cb8066f30 0x7f1cb80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40011e0 tx=0x7f1cc4009040 comp rx=0 tx=0).stop 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc15a620 msgr2=0x7f1ccc16aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc15a620 0x7f1ccc16aa00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b6c0 tx=0x7f1cbc019000 comp rx=0 tx=0).stop 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 shutdown_connections 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1cb8066f30 0x7f1cb80693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ccc15a620 0x7f1ccc16aa00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ccc157870 0x7f1ccc13f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 --2- 172.21.15.29:0/4243594624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ccc157c40 0x7f1ccc16a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 >> 172.21.15.29:0/4243594624 conn(0x7f1ccc068ce0 msgr2=0x7f1ccc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 shutdown_connections 2023-10-08T15:41:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.762+0000 7f1cd4720700 1 -- 172.21.15.29:0/4243594624 wait complete. 2023-10-08T15:41:00.764 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2023-10-08T15:41:00.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:00.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.893+0000 7f3ced662700 1 Processor -- start 2023-10-08T15:41:00.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.893+0000 7f3ced662700 1 -- start start 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ced662700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce8159e60 0x7f3ce80b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ced662700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3ce806adb0 0x7f3ce8163c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ced662700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce80b3d40 con 0x7f3ce80cffa0 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ced662700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce8069d70 con 0x7f3ce806adb0 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ced662700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80b4300 con 0x7f3ce8159e60 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3ce806adb0 0x7f3ce8163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce67fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3ce80cffa0 0x7f3ce806a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51550/0 (socket says 172.21.15.29:51550) 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce67fc700 1 -- 172.21.15.29:0/3559903783 learned_addr learned my addr 172.21.15.29:0/3559903783 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:00.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce6ffd700 1 --2- 172.21.15.29:0/3559903783 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce8159e60 0x7f3ce80b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce77fe700 1 -- 172.21.15.29:0/3559903783 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce8159e60 msgr2=0x7f3ce80b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce77fe700 1 --2- 172.21.15.29:0/3559903783 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce8159e60 0x7f3ce80b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce77fe700 1 -- 172.21.15.29:0/3559903783 >> v1:172.21.15.29:6789/0 conn(0x7f3ce80cffa0 legacy=0x7f3ce806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce5ffb700 1 -- 172.21.15.29:0/3559903783 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599205496 0 0) 0x7f3ce80b3d40 con 0x7f3ce80cffa0 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce77fe700 1 -- 172.21.15.29:0/3559903783 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80d0480 con 0x7f3ce806adb0 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce77fe700 1 --2- 172.21.15.29:0/3559903783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce8163c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009e60 tx=0x7f3ce0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ef94ac9257a1a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce5ffb700 1 -- 172.21.15.29:0/3559903783 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000e070 con 0x7f3ce806adb0 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce5ffb700 1 -- 172.21.15.29:0/3559903783 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce000bc30 con 0x7f3ce806adb0 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.894+0000 7f3ce5ffb700 1 -- 172.21.15.29:0/3559903783 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0012430 con 0x7f3ce806adb0 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.895+0000 7f3ced662700 1 -- 172.21.15.29:0/3559903783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 msgr2=0x7f3ce8163c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.895+0000 7f3ced662700 1 --2- 172.21.15.29:0/3559903783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce8163c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009e60 tx=0x7f3ce0009780 comp rx=0 tx=0).stop 2023-10-08T15:41:00.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.895+0000 7f3ced662700 1 -- 172.21.15.29:0/3559903783 shutdown_connections 2023-10-08T15:41:00.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.895+0000 7f3ced662700 1 --2- 172.21.15.29:0/3559903783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce8163c90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.895+0000 7f3ced662700 1 --2- 172.21.15.29:0/3559903783 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce8159e60 0x7f3ce80b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.895+0000 7f3ced662700 1 -- 172.21.15.29:0/3559903783 >> 172.21.15.29:0/3559903783 conn(0x7f3ce80d1a50 msgr2=0x7f3ce8068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:00.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.895+0000 7f3ced662700 1 -- 172.21.15.29:0/3559903783 shutdown_connections 2023-10-08T15:41:00.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.895+0000 7f3ced662700 1 -- 172.21.15.29:0/3559903783 wait complete. 2023-10-08T15:41:00.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.896+0000 7f3ced662700 1 Processor -- start 2023-10-08T15:41:00.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.896+0000 7f3ced662700 1 -- start start 2023-10-08T15:41:00.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ced662700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce80c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ced662700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce80cffa0 0x7f3ce8154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ced662700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce8159e60 0x7f3ce8169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ced662700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce815e960 con 0x7f3ce806adb0 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ced662700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce815dd50 con 0x7f3ce8159e60 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ced662700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce815e030 con 0x7f3ce80cffa0 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce80c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce80c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49748/0 (socket says 172.21.15.29:49748) 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 -- 172.21.15.29:0/3490464326 learned_addr learned my addr 172.21.15.29:0/3490464326 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce67fc700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce80cffa0 0x7f3ce8154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce77fe700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce8159e60 0x7f3ce8169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 -- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce80cffa0 msgr2=0x7f3ce8154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce80cffa0 0x7f3ce8154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 -- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce8159e60 msgr2=0x7f3ce8169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce8159e60 0x7f3ce8169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:00.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 -- 172.21.15.29:0/3490464326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0009a20 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.897+0000 7f3ce6ffd700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce80c6cf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800d890 tx=0x7f3cd8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.898+0000 7f3cceffd700 1 -- 172.21.15.29:0/3490464326 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800b600 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.898+0000 7f3cceffd700 1 -- 172.21.15.29:0/3490464326 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800b760 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.898+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce815e310 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.898+0000 7f3cceffd700 1 -- 172.21.15.29:0/3490464326 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800bae0 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.898+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce80c7230 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.899+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce804c3c0 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.899+0000 7f3cceffd700 1 -- 172.21.15.29:0/3490464326 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cd801e460 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.899+0000 7f3cceffd700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3cd4066f30 0x7f3cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.899+0000 7f3cceffd700 1 -- 172.21.15.29:0/3490464326 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3cd8084c10 con 0x7f3ce806adb0 2023-10-08T15:41:00.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.900+0000 7f3ce67fc700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3cd4066f30 0x7f3cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:00.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.900+0000 7f3ce67fc700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3cd4066f30 0x7f3cd40693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80b2f30 tx=0x7f3cdc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:00.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:00.904+0000 7f3cceffd700 1 -- 172.21.15.29:0/3490464326 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cd8051e80 con 0x7f3ce806adb0 2023-10-08T15:41:01.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.101+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ce80d0760 con 0x7f3ce806adb0 2023-10-08T15:41:01.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.101+0000 7f3cceffd700 1 -- 172.21.15.29:0/3490464326 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f3cd80554a0 con 0x7f3ce806adb0 2023-10-08T15:41:01.102 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:01.102 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:40:24.687609+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:40:20.956808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T15:40:22.081738+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:01.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3cd4066f30 msgr2=0x7f3cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3cd4066f30 0x7f3cd40693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80b2f30 tx=0x7f3cdc009040 comp rx=0 tx=0).stop 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 msgr2=0x7f3ce80c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce80c6cf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800d890 tx=0x7f3cd8008040 comp rx=0 tx=0).stop 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 shutdown_connections 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3cd4066f30 0x7f3cd40693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce8159e60 0x7f3ce8169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ce806adb0 0x7f3ce80c6cf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 --2- 172.21.15.29:0/3490464326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce80cffa0 0x7f3ce8154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 >> 172.21.15.29:0/3490464326 conn(0x7f3ce80d1a50 msgr2=0x7f3ce81562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 shutdown_connections 2023-10-08T15:41:01.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.104+0000 7f3ced662700 1 -- 172.21.15.29:0/3490464326 wait complete. 2023-10-08T15:41:01.117 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T15:41:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.235+0000 7f5d89fc6700 1 Processor -- start 2023-10-08T15:41:01.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.236+0000 7f5d89fc6700 1 -- start start 2023-10-08T15:41:01.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.236+0000 7f5d89fc6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d840c9560 0x7f5d84157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.236+0000 7f5d89fc6700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d84069de0 0x7f5d84157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.236+0000 7f5d89fc6700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d84069060 con 0x7f5d840c9930 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.236+0000 7f5d89fc6700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d84069300 con 0x7f5d84069de0 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.236+0000 7f5d89fc6700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840695e0 con 0x7f5d840c9560 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.236+0000 7f5d83fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5d840c9930 0x7f5d8415bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51556/0 (socket says 172.21.15.29:51556) 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.236+0000 7f5d83fff700 1 -- 172.21.15.29:0/2171644110 learned_addr learned my addr 172.21.15.29:0/2171644110 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d837fe700 1 --2- 172.21.15.29:0/2171644110 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d840c9560 0x7f5d84157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d82ffd700 1 --2- 172.21.15.29:0/2171644110 >> v2:172.21.15.183:3300/0 conn(0x7f5d84069de0 0x7f5d84157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d827fc700 1 -- 172.21.15.29:0/2171644110 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558708142 0 0) 0x7f5d84069060 con 0x7f5d840c9930 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d827fc700 1 -- 172.21.15.29:0/2171644110 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d6c003570 con 0x7f5d840c9930 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d837fe700 1 -- 172.21.15.29:0/2171644110 >> v2:172.21.15.183:3300/0 conn(0x7f5d84069de0 msgr2=0x7f5d84157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d837fe700 1 --2- 172.21.15.29:0/2171644110 >> v2:172.21.15.183:3300/0 conn(0x7f5d84069de0 0x7f5d84157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d837fe700 1 -- 172.21.15.29:0/2171644110 >> v1:172.21.15.29:6789/0 conn(0x7f5d840c9930 legacy=0x7f5d8415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d837fe700 1 -- 172.21.15.29:0/2171644110 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840698c0 con 0x7f5d840c9560 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d837fe700 1 --2- 172.21.15.29:0/2171644110 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d840c9560 0x7f5d84157a50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d740098e0 tx=0x7f5d740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6891d7e35ba3441f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d827fc700 1 -- 172.21.15.29:0/2171644110 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74011630 con 0x7f5d840c9560 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d827fc700 1 -- 172.21.15.29:0/2171644110 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d74011790 con 0x7f5d840c9560 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.237+0000 7f5d827fc700 1 -- 172.21.15.29:0/2171644110 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74011b30 con 0x7f5d840c9560 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.238+0000 7f5d89fc6700 1 -- 172.21.15.29:0/2171644110 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d840c9560 msgr2=0x7f5d84157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.238+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/2171644110 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d840c9560 0x7f5d84157a50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d740098e0 tx=0x7f5d740091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.238+0000 7f5d89fc6700 1 -- 172.21.15.29:0/2171644110 shutdown_connections 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.238+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/2171644110 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d840c9560 0x7f5d84157a50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.238+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/2171644110 >> v2:172.21.15.183:3300/0 conn(0x7f5d84069de0 0x7f5d84157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.238+0000 7f5d89fc6700 1 -- 172.21.15.29:0/2171644110 >> 172.21.15.29:0/2171644110 conn(0x7f5d84067660 msgr2=0x7f5d84067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:01.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.238+0000 7f5d89fc6700 1 -- 172.21.15.29:0/2171644110 shutdown_connections 2023-10-08T15:41:01.241 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.238+0000 7f5d89fc6700 1 -- 172.21.15.29:0/2171644110 wait complete. 2023-10-08T15:41:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.239+0000 7f5d89fc6700 1 Processor -- start 2023-10-08T15:41:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.239+0000 7f5d89fc6700 1 -- start start 2023-10-08T15:41:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d89fc6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d84069de0 0x7f5d84156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d89fc6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d840c9560 0x7f5d840b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d89fc6700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d840c9930 0x7f5d840b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d89fc6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840c6190 con 0x7f5d840c9560 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d89fc6700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84168d10 con 0x7f5d840c9930 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d89fc6700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840c5860 con 0x7f5d84069de0 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d82ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d840c9560 0x7f5d840b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d82ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d840c9560 0x7f5d840b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49750/0 (socket says 172.21.15.29:49750) 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d82ffd700 1 -- 172.21.15.29:0/1827555127 learned_addr learned my addr 172.21.15.29:0/1827555127 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d837fe700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d84069de0 0x7f5d84156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d83fff700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d840c9930 0x7f5d840b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d82ffd700 1 -- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d84069de0 msgr2=0x7f5d84156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d82ffd700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d84069de0 0x7f5d84156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d82ffd700 1 -- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d840c9930 msgr2=0x7f5d840b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d82ffd700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d840c9930 0x7f5d840b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d82ffd700 1 -- 172.21.15.29:0/1827555127 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74009420 con 0x7f5d840c9560 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.240+0000 7f5d83fff700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d840c9930 0x7f5d840b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.241+0000 7f5d82ffd700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d840c9560 0x7f5d840b1810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800ec80 tx=0x7f5d780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.241+0000 7f5d6b7fe700 1 -- 172.21.15.29:0/1827555127 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800c850 con 0x7f5d840c9560 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.241+0000 7f5d6b7fe700 1 -- 172.21.15.29:0/1827555127 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7800c9b0 con 0x7f5d840c9560 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.241+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d840c5b40 con 0x7f5d840c9560 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.241+0000 7f5d6b7fe700 1 -- 172.21.15.29:0/1827555127 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800cd50 con 0x7f5d840c9560 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.241+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d84157320 con 0x7f5d840c9560 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.242+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8404c3c0 con 0x7f5d840c9560 2023-10-08T15:41:01.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.242+0000 7f5d6b7fe700 1 -- 172.21.15.29:0/1827555127 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d78013680 con 0x7f5d840c9560 2023-10-08T15:41:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.242+0000 7f5d6b7fe700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d70066f30 0x7f5d700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.243+0000 7f5d6b7fe700 1 -- 172.21.15.29:0/1827555127 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d780847f0 con 0x7f5d840c9560 2023-10-08T15:41:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.243+0000 7f5d837fe700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d70066f30 0x7f5d700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.243+0000 7f5d837fe700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d70066f30 0x7f5d700693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d740091e0 tx=0x7f5d74017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.247+0000 7f5d6b7fe700 1 -- 172.21.15.29:0/1827555127 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d78051a60 con 0x7f5d840c9560 2023-10-08T15:41:01.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.485+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5d840c62d0 con 0x7f5d840c9560 2023-10-08T15:41:01.486 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-08T15:41:01.486+0000 7f3b39a11700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T15:41:01.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.488+0000 7f5d6b7fe700 1 -- 172.21.15.29:0/1827555127 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5d78055080 con 0x7f5d840c9560 2023-10-08T15:41:01.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d70066f30 msgr2=0x7f5d700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d70066f30 0x7f5d700693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d740091e0 tx=0x7f5d74017000 comp rx=0 tx=0).stop 2023-10-08T15:41:01.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d840c9560 msgr2=0x7f5d840b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d840c9560 0x7f5d840b1810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800ec80 tx=0x7f5d780091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 shutdown_connections 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5d70066f30 0x7f5d700693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d840c9930 0x7f5d840b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d84069de0 0x7f5d84156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 --2- 172.21.15.29:0/1827555127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d840c9560 0x7f5d840b1810 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.490+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 >> 172.21.15.29:0/1827555127 conn(0x7f5d84067660 msgr2=0x7f5d8406d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.491+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 shutdown_connections 2023-10-08T15:41:01.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.491+0000 7f5d89fc6700 1 -- 172.21.15.29:0/1827555127 wait complete. 2023-10-08T15:41:01.493 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T15:41:01.494 INFO:tasks.ceph.mds.d.smithi183.stderr: -1726> 2023-10-08T15:40:29.677+0000 7fce2bf40700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:41:01.503 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T15:41:01.518 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-10-08T15:41:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.624+0000 7f8b56587700 1 Processor -- start 2023-10-08T15:41:01.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.624+0000 7f8b56587700 1 -- start start 2023-10-08T15:41:01.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b56587700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b5015a290 0x7f8b5006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b56587700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b500b0790 con 0x7f8b5006aae0 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b56587700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5006af20 con 0x7f8b50159ec0 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b56587700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b500ce1f0 con 0x7f8b5015a290 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b5015a290 0x7f8b5006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b54b24700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8b5006aae0 0x7f8b500cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51560/0 (socket says 172.21.15.29:51560) 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b54b24700 1 -- 172.21.15.29:0/2287062860 learned_addr learned my addr 172.21.15.29:0/2287062860 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4f7fe700 1 -- 172.21.15.29:0/2287062860 >> v1:172.21.15.183:6789/0 conn(0x7f8b50159ec0 legacy=0x7f8b500af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4effd700 1 -- 172.21.15.29:0/2287062860 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244641675 0 0) 0x7f8b500b0790 con 0x7f8b5006aae0 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4f7fe700 1 -- 172.21.15.29:0/2287062860 >> v1:172.21.15.29:6789/0 conn(0x7f8b5006aae0 legacy=0x7f8b500cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4f7fe700 1 -- 172.21.15.29:0/2287062860 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500b0b20 con 0x7f8b5015a290 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4f7fe700 1 --2- 172.21.15.29:0/2287062860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5015a290 0x7f8b5006a5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8b440098e0 tx=0x7f8b440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7231265628d4d43c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4effd700 1 -- 172.21.15.29:0/2287062860 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44009e80 con 0x7f8b5015a290 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4effd700 1 -- 172.21.15.29:0/2287062860 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4400b820 con 0x7f8b5015a290 2023-10-08T15:41:01.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.625+0000 7f8b4effd700 1 -- 172.21.15.29:0/2287062860 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4400bba0 con 0x7f8b5015a290 2023-10-08T15:41:01.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.626+0000 7f8b56587700 1 -- 172.21.15.29:0/2287062860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5015a290 msgr2=0x7f8b5006a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.626+0000 7f8b56587700 1 --2- 172.21.15.29:0/2287062860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5015a290 0x7f8b5006a5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8b440098e0 tx=0x7f8b440091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.626+0000 7f8b56587700 1 -- 172.21.15.29:0/2287062860 shutdown_connections 2023-10-08T15:41:01.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.626+0000 7f8b56587700 1 --2- 172.21.15.29:0/2287062860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b5015a290 0x7f8b5006a5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.626+0000 7f8b56587700 1 -- 172.21.15.29:0/2287062860 >> 172.21.15.29:0/2287062860 conn(0x7f8b500d1880 msgr2=0x7f8b500cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:01.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.626+0000 7f8b56587700 1 -- 172.21.15.29:0/2287062860 shutdown_connections 2023-10-08T15:41:01.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.626+0000 7f8b56587700 1 -- 172.21.15.29:0/2287062860 wait complete. 2023-10-08T15:41:01.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.627+0000 7f8b56587700 1 Processor -- start 2023-10-08T15:41:01.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.627+0000 7f8b56587700 1 -- start start 2023-10-08T15:41:01.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b56587700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b5006aae0 0x7f8b501527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b56587700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b50159ec0 0x7f8b50151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b56587700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5015a290 0x7f8b5016a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b56587700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5014ee30 con 0x7f8b50159ec0 2023-10-08T15:41:01.630 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b56587700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b500b4440 con 0x7f8b5015a290 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b56587700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50152ce0 con 0x7f8b5006aae0 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b50159ec0 0x7f8b50151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b50159ec0 0x7f8b50151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49762/0 (socket says 172.21.15.29:49762) 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4f7fe700 1 -- 172.21.15.29:0/886944636 learned_addr learned my addr 172.21.15.29:0/886944636 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b54b24700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5015a290 0x7f8b5016a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4ffff700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b5006aae0 0x7f8b501527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4f7fe700 1 -- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b5006aae0 msgr2=0x7f8b501527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4f7fe700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b5006aae0 0x7f8b501527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4f7fe700 1 -- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5015a290 msgr2=0x7f8b5016a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4f7fe700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5015a290 0x7f8b5016a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.628+0000 7f8b4f7fe700 1 -- 172.21.15.29:0/886944636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44009420 con 0x7f8b50159ec0 2023-10-08T15:41:01.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.629+0000 7f8b4f7fe700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b50159ec0 0x7f8b50151f50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b440030c0 tx=0x7f8b44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.629+0000 7f8b37fff700 1 -- 172.21.15.29:0/886944636 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4400bba0 con 0x7f8b50159ec0 2023-10-08T15:41:01.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.629+0000 7f8b37fff700 1 -- 172.21.15.29:0/886944636 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4401c460 con 0x7f8b50159ec0 2023-10-08T15:41:01.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.629+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b50155ac0 con 0x7f8b50159ec0 2023-10-08T15:41:01.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.629+0000 7f8b37fff700 1 -- 172.21.15.29:0/886944636 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4401c820 con 0x7f8b50159ec0 2023-10-08T15:41:01.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.629+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b50155500 con 0x7f8b50159ec0 2023-10-08T15:41:01.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.630+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b500b45d0 con 0x7f8b50159ec0 2023-10-08T15:41:01.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.630+0000 7f8b37fff700 1 -- 172.21.15.29:0/886944636 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b4401cc10 con 0x7f8b50159ec0 2023-10-08T15:41:01.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.630+0000 7f8b37fff700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b3c066f30 0x7f8b3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:01.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.631+0000 7f8b37fff700 1 -- 172.21.15.29:0/886944636 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8b440869f0 con 0x7f8b50159ec0 2023-10-08T15:41:01.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.631+0000 7f8b4ffff700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b3c066f30 0x7f8b3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:01.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.631+0000 7f8b4ffff700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b3c066f30 0x7f8b3c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8b5014f090 tx=0x7f8b40007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:01.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.635+0000 7f8b37fff700 1 -- 172.21.15.29:0/886944636 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b44053c10 con 0x7f8b50159ec0 2023-10-08T15:41:01.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:01.875+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8b500b4580 con 0x7f8b50159ec0 2023-10-08T15:41:02.490 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.490+0000 7f8b37fff700 1 -- 172.21.15.29:0/886944636 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b44057230 con 0x7f8b50159ec0 2023-10-08T15:41:02.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b3c066f30 msgr2=0x7f8b3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b3c066f30 0x7f8b3c0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8b5014f090 tx=0x7f8b40007ea0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b50159ec0 msgr2=0x7f8b50151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b50159ec0 0x7f8b50151f50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b440030c0 tx=0x7f8b44016000 comp rx=0 tx=0).stop 2023-10-08T15:41:02.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 shutdown_connections 2023-10-08T15:41:02.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b3c066f30 0x7f8b3c0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5015a290 0x7f8b5016a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b5006aae0 0x7f8b501527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 --2- 172.21.15.29:0/886944636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b50159ec0 0x7f8b50151f50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.492+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 >> 172.21.15.29:0/886944636 conn(0x7f8b500d1880 msgr2=0x7f8b501574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:02.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.493+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 shutdown_connections 2023-10-08T15:41:02.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.493+0000 7f8b56587700 1 -- 172.21.15.29:0/886944636 wait complete. 2023-10-08T15:41:02.506 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T15:41:02.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.633+0000 7f02e29ec700 1 Processor -- start 2023-10-08T15:41:02.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.633+0000 7f02e29ec700 1 -- start start 2023-10-08T15:41:02.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02e29ec700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b6a10 0x7f02dc15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02e29ec700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc0b17b0 con 0x7f02dc0b46f0 2023-10-08T15:41:02.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02e29ec700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc0b1a60 con 0x7f02dc159ef0 2023-10-08T15:41:02.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02e29ec700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0b1d40 con 0x7f02dc0b6a10 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02e0f89700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f02dc0b46f0 0x7f02dc0cfe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51568/0 (socket says 172.21.15.29:51568) 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02e0f89700 1 -- 172.21.15.29:0/3781446792 learned_addr learned my addr 172.21.15.29:0/3781446792 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02db7fe700 1 --2- 172.21.15.29:0/3781446792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b6a10 0x7f02dc15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02daffd700 1 -- 172.21.15.29:0/3781446792 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835515692 0 0) 0x7f02dc0b17b0 con 0x7f02dc0b46f0 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02daffd700 1 -- 172.21.15.29:0/3781446792 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c8003570 con 0x7f02dc0b46f0 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02daffd700 1 -- 172.21.15.29:0/3781446792 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964599802 0 0) 0x7f02dc0b1a60 con 0x7f02dc159ef0 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02daffd700 1 -- 172.21.15.29:0/3781446792 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02dc0b17b0 con 0x7f02dc159ef0 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02db7fe700 1 -- 172.21.15.29:0/3781446792 >> v1:172.21.15.183:6789/0 conn(0x7f02dc159ef0 legacy=0x7f02dc0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02db7fe700 1 -- 172.21.15.29:0/3781446792 >> v1:172.21.15.29:6789/0 conn(0x7f02dc0b46f0 legacy=0x7f02dc0cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02daffd700 1 -- 172.21.15.29:0/3781446792 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2190494257 0 0) 0x7f02c8003570 con 0x7f02dc0b46f0 2023-10-08T15:41:02.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.634+0000 7f02db7fe700 1 -- 172.21.15.29:0/3781446792 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0b2020 con 0x7f02dc0b6a10 2023-10-08T15:41:02.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02db7fe700 1 --2- 172.21.15.29:0/3781446792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b6a10 0x7f02dc15a2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009910 tx=0x7f02cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d964f24f7f4364a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02daffd700 1 -- 172.21.15.29:0/3781446792 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40017f0 con 0x7f02dc0b6a10 2023-10-08T15:41:02.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02daffd700 1 -- 172.21.15.29:0/3781446792 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc011420 con 0x7f02dc0b6a10 2023-10-08T15:41:02.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02daffd700 1 -- 172.21.15.29:0/3781446792 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0117c0 con 0x7f02dc0b6a10 2023-10-08T15:41:02.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02e29ec700 1 -- 172.21.15.29:0/3781446792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b6a10 msgr2=0x7f02dc15a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02e29ec700 1 --2- 172.21.15.29:0/3781446792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b6a10 0x7f02dc15a2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009910 tx=0x7f02cc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02e29ec700 1 -- 172.21.15.29:0/3781446792 shutdown_connections 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02e29ec700 1 --2- 172.21.15.29:0/3781446792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b6a10 0x7f02dc15a2c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02e29ec700 1 -- 172.21.15.29:0/3781446792 >> 172.21.15.29:0/3781446792 conn(0x7f02dc09a0a0 msgr2=0x7f02dc067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02e29ec700 1 -- 172.21.15.29:0/3781446792 shutdown_connections 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.635+0000 7f02e29ec700 1 -- 172.21.15.29:0/3781446792 wait complete. 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.636+0000 7f02e29ec700 1 Processor -- start 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.637+0000 7f02e29ec700 1 -- start start 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.637+0000 7f02e29ec700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b46f0 0x7f02dc09dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.637+0000 7f02e29ec700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02dc0b6a10 0x7f02dc157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.637+0000 7f02e29ec700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc159ef0 0x7f02dc157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.637+0000 7f02e29ec700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc14fa70 con 0x7f02dc0b6a10 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.637+0000 7f02e29ec700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc150310 con 0x7f02dc159ef0 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.637+0000 7f02e29ec700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc09e940 con 0x7f02dc0b46f0 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.637+0000 7f02db7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02dc0b6a10 0x7f02dc157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02db7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02dc0b6a10 0x7f02dc157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49768/0 (socket says 172.21.15.29:49768) 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02db7fe700 1 -- 172.21.15.29:0/3150954032 learned_addr learned my addr 172.21.15.29:0/3150954032 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02dbfff700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b46f0 0x7f02dc09dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02e0f89700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc159ef0 0x7f02dc157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02db7fe700 1 -- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b46f0 msgr2=0x7f02dc09dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02db7fe700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b46f0 0x7f02dc09dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02db7fe700 1 -- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc159ef0 msgr2=0x7f02dc157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:02.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02db7fe700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc159ef0 0x7f02dc157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02db7fe700 1 -- 172.21.15.29:0/3150954032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc009420 con 0x7f02dc0b6a10 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02e0f89700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc159ef0 0x7f02dc157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02db7fe700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02dc0b6a10 0x7f02dc157560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0030c0 tx=0x7f02cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02d3fff700 1 -- 172.21.15.29:0/3150954032 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc01cc50 con 0x7f02dc0b6a10 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02d3fff700 1 -- 172.21.15.29:0/3150954032 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc01cdb0 con 0x7f02dc0b6a10 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc14fcc0 con 0x7f02dc0b6a10 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02d3fff700 1 -- 172.21.15.29:0/3150954032 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc01a6a0 con 0x7f02dc0b6a10 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.638+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc09e510 con 0x7f02dc0b6a10 2023-10-08T15:41:02.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.639+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc09e700 con 0x7f02dc0b6a10 2023-10-08T15:41:02.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.639+0000 7f02d3fff700 1 -- 172.21.15.29:0/3150954032 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02cc01aa90 con 0x7f02dc0b6a10 2023-10-08T15:41:02.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.640+0000 7f02d3fff700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f02bc066f30 0x7f02bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:02.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.640+0000 7f02d3fff700 1 -- 172.21.15.29:0/3150954032 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f02cc086490 con 0x7f02dc0b6a10 2023-10-08T15:41:02.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.640+0000 7f02dbfff700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f02bc066f30 0x7f02bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:02.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.641+0000 7f02dbfff700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f02bc066f30 0x7f02bc0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f02c4003950 tx=0x7f02c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:02.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.644+0000 7f02d3fff700 1 -- 172.21.15.29:0/3150954032 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02dc09e700 con 0x7f02dc0b6a10 2023-10-08T15:41:02.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:02.838+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02dc09e700 con 0x7f02dc0b6a10 2023-10-08T15:41:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.604+0000 7f02d3fff700 1 -- 172.21.15.29:0/3150954032 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f02dc09e700 con 0x7f02dc0b6a10 2023-10-08T15:41:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f02bc066f30 msgr2=0x7f02bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f02bc066f30 0x7f02bc0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f02c4003950 tx=0x7f02c4009040 comp rx=0 tx=0).stop 2023-10-08T15:41:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02dc0b6a10 msgr2=0x7f02dc157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02dc0b6a10 0x7f02dc157560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0030c0 tx=0x7f02cc016000 comp rx=0 tx=0).stop 2023-10-08T15:41:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 shutdown_connections 2023-10-08T15:41:03.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f02bc066f30 0x7f02bc0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc159ef0 0x7f02dc157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02dc0b46f0 0x7f02dc09dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 --2- 172.21.15.29:0/3150954032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02dc0b6a10 0x7f02dc157560 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.606+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 >> 172.21.15.29:0/3150954032 conn(0x7f02dc09a0a0 msgr2=0x7f02dc15ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:03.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.607+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 shutdown_connections 2023-10-08T15:41:03.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.607+0000 7f02e29ec700 1 -- 172.21.15.29:0/3150954032 wait complete. 2023-10-08T15:41:03.609 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-08T15:41:03.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T15:41:03.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.753+0000 7f117065a700 1 Processor -- start 2023-10-08T15:41:03.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.753+0000 7f117065a700 1 -- start start 2023-10-08T15:41:03.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f117065a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11680d1450 0x7f11680d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f117065a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f116815a580 0x7f116815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f117065a700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11680d08e0 con 0x7f1168157ac0 2023-10-08T15:41:03.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f117065a700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1168157e90 con 0x7f116815a580 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f117065a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116815b2f0 con 0x7f11680d1450 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116ebf7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f116815a580 0x7f116815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116e3f6700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1168157ac0 0x7f11680d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51580/0 (socket says 172.21.15.29:51580) 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116e3f6700 1 -- 172.21.15.29:0/374106218 learned_addr learned my addr 172.21.15.29:0/374106218 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116dbf5700 1 --2- 172.21.15.29:0/374106218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11680d1450 0x7f11680d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116ebf7700 1 -- 172.21.15.29:0/374106218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11680d1450 msgr2=0x7f11680d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116ebf7700 1 --2- 172.21.15.29:0/374106218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11680d1450 0x7f11680d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116ebf7700 1 -- 172.21.15.29:0/374106218 >> v1:172.21.15.29:6789/0 conn(0x7f1168157ac0 legacy=0x7f11680d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116ebf7700 1 -- 172.21.15.29:0/374106218 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11680cf8e0 con 0x7f116815a580 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.754+0000 7f116d3f4700 1 -- 172.21.15.29:0/374106218 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799574541 0 0) 0x7f1158001490 con 0x7f1168157ac0 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f116ebf7700 1 --2- 172.21.15.29:0/374106218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f116815a580 0x7f116815a9c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f11600098e0 tx=0x7f11600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994816adb2740112 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f116d3f4700 1 -- 172.21.15.29:0/374106218 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000b640 con 0x7f116815a580 2023-10-08T15:41:03.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f116d3f4700 1 -- 172.21.15.29:0/374106218 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000b7a0 con 0x7f116815a580 2023-10-08T15:41:03.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f116d3f4700 1 -- 172.21.15.29:0/374106218 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000bb40 con 0x7f116815a580 2023-10-08T15:41:03.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f117065a700 1 -- 172.21.15.29:0/374106218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f116815a580 msgr2=0x7f116815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f117065a700 1 --2- 172.21.15.29:0/374106218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f116815a580 0x7f116815a9c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f11600098e0 tx=0x7f11600091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f117065a700 1 -- 172.21.15.29:0/374106218 shutdown_connections 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f117065a700 1 --2- 172.21.15.29:0/374106218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f116815a580 0x7f116815a9c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f117065a700 1 --2- 172.21.15.29:0/374106218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11680d1450 0x7f11680d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f117065a700 1 -- 172.21.15.29:0/374106218 >> 172.21.15.29:0/374106218 conn(0x7f11680680f0 msgr2=0x7f11680b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f117065a700 1 -- 172.21.15.29:0/374106218 shutdown_connections 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.755+0000 7f117065a700 1 -- 172.21.15.29:0/374106218 wait complete. 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.756+0000 7f117065a700 1 Processor -- start 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.756+0000 7f117065a700 1 -- start start 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f117065a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11680d1450 0x7f11680c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f117065a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1168157ac0 0x7f1168152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f117065a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f116815a580 0x7f116815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f117065a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680b0230 con 0x7f11680d1450 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f117065a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11680b0510 con 0x7f1168157ac0 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f117065a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11680b07f0 con 0x7f116815a580 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f116e3f6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11680d1450 0x7f11680c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f116e3f6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11680d1450 0x7f11680c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49778/0 (socket says 172.21.15.29:49778) 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f116e3f6700 1 -- 172.21.15.29:0/4155171192 learned_addr learned my addr 172.21.15.29:0/4155171192 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f116ebf7700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f116815a580 0x7f116815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.757+0000 7f116dbf5700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1168157ac0 0x7f1168152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f116e3f6700 1 -- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f116815a580 msgr2=0x7f116815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f116e3f6700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f116815a580 0x7f116815c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f116e3f6700 1 -- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1168157ac0 msgr2=0x7f1168152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f116e3f6700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1168157ac0 0x7f1168152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f116e3f6700 1 -- 172.21.15.29:0/4155171192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1160009420 con 0x7f11680d1450 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f116dbf5700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1168157ac0 0x7f1168152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f116e3f6700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11680d1450 0x7f11680c5c20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f115800cd80 tx=0x7f1158001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f11667fc700 1 -- 172.21.15.29:0/4155171192 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115800ab70 con 0x7f11680d1450 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f11667fc700 1 -- 172.21.15.29:0/4155171192 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115800acd0 con 0x7f11680d1450 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11680b0ad0 con 0x7f11680d1450 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f11667fc700 1 -- 172.21.15.29:0/4155171192 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158007300 con 0x7f11680d1450 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.758+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1168153420 con 0x7f11680d1450 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.759+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116804c3c0 con 0x7f11680d1450 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.759+0000 7f11667fc700 1 -- 172.21.15.29:0/4155171192 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11580076f0 con 0x7f11680d1450 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.760+0000 7f11667fc700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1154066f30 0x7f11540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:03.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.760+0000 7f11667fc700 1 -- 172.21.15.29:0/4155171192 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f1158084750 con 0x7f11680d1450 2023-10-08T15:41:03.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.760+0000 7f116dbf5700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1154066f30 0x7f11540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:03.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.760+0000 7f116dbf5700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1154066f30 0x7f11540693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f115c006f00 tx=0x7f115c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:03.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.764+0000 7f11667fc700 1 -- 172.21.15.29:0/4155171192 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1158051ba0 con 0x7f11680d1450 2023-10-08T15:41:03.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:03.955+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f11680d08e0 con 0x7f11680d1450 2023-10-08T15:41:04.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.613+0000 7f11667fc700 1 -- 172.21.15.29:0/4155171192 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f11680d08e0 con 0x7f11680d1450 2023-10-08T15:41:04.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1154066f30 msgr2=0x7f11540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1154066f30 0x7f11540693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f115c006f00 tx=0x7f115c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:04.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11680d1450 msgr2=0x7f11680c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11680d1450 0x7f11680c5c20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f115800cd80 tx=0x7f1158001ad0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 shutdown_connections 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1154066f30 0x7f11540693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f116815a580 0x7f116815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11680d1450 0x7f11680c5c20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.616+0000 7f117065a700 1 --2- 172.21.15.29:0/4155171192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1168157ac0 0x7f1168152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.617+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 >> 172.21.15.29:0/4155171192 conn(0x7f11680680f0 msgr2=0x7f116815a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.617+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 shutdown_connections 2023-10-08T15:41:04.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.617+0000 7f117065a700 1 -- 172.21.15.29:0/4155171192 wait complete. 2023-10-08T15:41:04.619 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-08T15:41:04.631 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:41:04.631 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T15:41:04.631 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T15:41:04.631 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:04.631 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T15:41:04.631 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T15:41:04.632 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T15:41:04.632 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:04.632 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:41:04.632 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T15:41:04.632 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T15:41:04.633 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:04.633 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T15:41:04.633 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T15:41:04.634 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T15:41:04.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:04.640 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T15:41:04.640 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:41:04.641 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T15:41:04.641 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T15:41:04.643 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T15:41:04.643 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:41:04.644 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T15:41:04.644 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T15:41:04.682 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:41:04.683 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:04.683 INFO:tasks.ceph.mds.c:Started 2023-10-08T15:41:04.683 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:04.685 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:41:04.686 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:04.687 INFO:tasks.ceph.mds.d:Started 2023-10-08T15:41:04.687 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:04.687 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T15:41:04.763 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-08T15:41:04.763 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-08T15:41:04.764 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-08T15:41:04.764+0000 7f1106e4c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-08T15:41:04.765 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-10-08T15:41:04.765 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-10-08T15:41:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.816+0000 7f4e69c07700 1 Processor -- start 2023-10-08T15:41:04.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.816+0000 7f4e69c07700 1 -- start start 2023-10-08T15:41:04.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e69c07700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4e64157870 0x7f4e6415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e69c07700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415a620 0x7f4e6415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e69c07700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4e6415d580 0x7f4e64158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e69c07700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6415cbb0 con 0x7f4e64157870 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e69c07700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6415bfa0 con 0x7f4e6415d580 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e69c07700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6415c280 con 0x7f4e6415a620 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4e64157870 0x7f4e6415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4e64157870 0x7f4e6415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49802/0 (socket says 172.21.15.29:49802) 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 -- 172.21.15.29:0/1710859709 learned_addr learned my addr 172.21.15.29:0/1710859709 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e63fff700 1 --2- 172.21.15.29:0/1710859709 >> v2:172.21.15.183:3300/0 conn(0x7f4e6415d580 0x7f4e64158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e62ffd700 1 --2- 172.21.15.29:0/1710859709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415a620 0x7f4e6415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 -- 172.21.15.29:0/1710859709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415a620 msgr2=0x7f4e6415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:04.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 --2- 172.21.15.29:0/1710859709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415a620 0x7f4e6415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 -- 172.21.15.29:0/1710859709 >> v2:172.21.15.183:3300/0 conn(0x7f4e6415d580 msgr2=0x7f4e64158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 --2- 172.21.15.29:0/1710859709 >> v2:172.21.15.183:3300/0 conn(0x7f4e6415d580 0x7f4e64158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 -- 172.21.15.29:0/1710859709 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6415c560 con 0x7f4e64157870 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e637fe700 1 --2- 172.21.15.29:0/1710859709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e64157870 0x7f4e6415b6a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4e640b03b0 tx=0x7f4e54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76047de869bc2002 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e627fc700 1 -- 172.21.15.29:0/1710859709 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400b640 con 0x7f4e64157870 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e627fc700 1 -- 172.21.15.29:0/1710859709 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400b7a0 con 0x7f4e64157870 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.817+0000 7f4e627fc700 1 -- 172.21.15.29:0/1710859709 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400bb60 con 0x7f4e64157870 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 -- 172.21.15.29:0/1710859709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e64157870 msgr2=0x7f4e6415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 --2- 172.21.15.29:0/1710859709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e64157870 0x7f4e6415b6a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4e640b03b0 tx=0x7f4e54009250 comp rx=0 tx=0).stop 2023-10-08T15:41:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 -- 172.21.15.29:0/1710859709 shutdown_connections 2023-10-08T15:41:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 --2- 172.21.15.29:0/1710859709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e64157870 0x7f4e6415b6a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 --2- 172.21.15.29:0/1710859709 >> v2:172.21.15.183:3300/0 conn(0x7f4e6415d580 0x7f4e64158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 --2- 172.21.15.29:0/1710859709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415a620 0x7f4e6415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 -- 172.21.15.29:0/1710859709 >> 172.21.15.29:0/1710859709 conn(0x7f4e64068ce0 msgr2=0x7f4e640690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 -- 172.21.15.29:0/1710859709 shutdown_connections 2023-10-08T15:41:04.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.818+0000 7f4e69c07700 1 -- 172.21.15.29:0/1710859709 wait complete. 2023-10-08T15:41:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.819+0000 7f4e69c07700 1 Processor -- start 2023-10-08T15:41:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.819+0000 7f4e69c07700 1 -- start start 2023-10-08T15:41:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e69c07700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e64157870 0x7f4e6414b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e69c07700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6415a620 0x7f4e641480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e69c07700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415d580 0x7f4e64148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e69c07700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64148b50 con 0x7f4e6415a620 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e69c07700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6416a9c0 con 0x7f4e64157870 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e69c07700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6416ac60 con 0x7f4e6415d580 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e62ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6415a620 0x7f4e641480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e62ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6415a620 0x7f4e641480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49810/0 (socket says 172.21.15.29:49810) 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e62ffd700 1 -- 172.21.15.29:0/2396192009 learned_addr learned my addr 172.21.15.29:0/2396192009 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e637fe700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e64157870 0x7f4e6414b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e63fff700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415d580 0x7f4e64148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e62ffd700 1 -- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415d580 msgr2=0x7f4e64148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e62ffd700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415d580 0x7f4e64148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e62ffd700 1 -- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e64157870 msgr2=0x7f4e6414b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e62ffd700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e64157870 0x7f4e6414b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.820+0000 7f4e62ffd700 1 -- 172.21.15.29:0/2396192009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540094f0 con 0x7f4e6415a620 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.821+0000 7f4e62ffd700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6415a620 0x7f4e641480d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800ec50 tx=0x7f4e580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.821+0000 7f4e4b7fe700 1 -- 172.21.15.29:0/2396192009 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800c850 con 0x7f4e6415a620 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.821+0000 7f4e4b7fe700 1 -- 172.21.15.29:0/2396192009 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5800c9b0 con 0x7f4e6415a620 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.821+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6416af40 con 0x7f4e6415a620 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.821+0000 7f4e4b7fe700 1 -- 172.21.15.29:0/2396192009 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800cd70 con 0x7f4e6415a620 2023-10-08T15:41:04.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.821+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6416b580 con 0x7f4e6415a620 2023-10-08T15:41:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.822+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6404c3c0 con 0x7f4e6415a620 2023-10-08T15:41:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.822+0000 7f4e4b7fe700 1 -- 172.21.15.29:0/2396192009 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e58013680 con 0x7f4e6415a620 2023-10-08T15:41:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.823+0000 7f4e4b7fe700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4e50066f30 0x7f4e500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.823+0000 7f4e4b7fe700 1 -- 172.21.15.29:0/2396192009 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4e58084440 con 0x7f4e6415a620 2023-10-08T15:41:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.823+0000 7f4e637fe700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4e50066f30 0x7f4e500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.823+0000 7f4e637fe700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4e50066f30 0x7f4e500693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e640b03b0 tx=0x7f4e54017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:04.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:04.827+0000 7f4e4b7fe700 1 -- 172.21.15.29:0/2396192009 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e580519b0 con 0x7f4e6415a620 2023-10-08T15:41:05.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.034+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4e6415c840 con 0x7f4e6415a620 2023-10-08T15:41:05.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.623+0000 7f4e4b7fe700 1 -- 172.21.15.29:0/2396192009 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4e58054fd0 con 0x7f4e6415a620 2023-10-08T15:41:05.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4e50066f30 msgr2=0x7f4e500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4e50066f30 0x7f4e500693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e640b03b0 tx=0x7f4e54017000 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6415a620 msgr2=0x7f4e641480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6415a620 0x7f4e641480d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800ec50 tx=0x7f4e580091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 shutdown_connections 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4e50066f30 0x7f4e500693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e6415d580 0x7f4e64148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e64157870 0x7f4e6414b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 --2- 172.21.15.29:0/2396192009 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6415a620 0x7f4e641480d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 >> 172.21.15.29:0/2396192009 conn(0x7f4e64068ce0 msgr2=0x7f4e641594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 shutdown_connections 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.626+0000 7f4e69c07700 1 -- 172.21.15.29:0/2396192009 wait complete. 2023-10-08T15:41:05.786 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2023-10-08T15:41:05.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T15:41:05.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.914+0000 7f60568a7700 1 Processor -- start 2023-10-08T15:41:05.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.914+0000 7f60568a7700 1 -- start start 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f60568a7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f60501510f0 0x7f605006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f60568a7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6050070700 0x7f6050070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f60568a7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6050071040 con 0x7f60500c9af0 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f60568a7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60500ca0b0 con 0x7f6050070700 2023-10-08T15:41:05.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f60568a7700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6050068a10 con 0x7f60501510f0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f6054e44700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6050070700 0x7f6050070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f6054e44700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6050070700 0x7f6050070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49818/0 (socket says 172.21.15.29:49818) 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f6054e44700 1 -- 172.21.15.29:0/1100947208 learned_addr learned my addr 172.21.15.29:0/1100947208 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f6054e44700 1 -- 172.21.15.29:0/1100947208 >> v2:172.21.15.183:3300/0 conn(0x7f60501510f0 msgr2=0x7f605006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f604ffff700 1 --2- 172.21.15.29:0/1100947208 >> v2:172.21.15.183:3300/0 conn(0x7f60501510f0 0x7f605006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f6054e44700 1 --2- 172.21.15.29:0/1100947208 >> v2:172.21.15.183:3300/0 conn(0x7f60501510f0 0x7f605006ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f6054e44700 1 -- 172.21.15.29:0/1100947208 >> v1:172.21.15.183:6789/0 conn(0x7f60500c9af0 legacy=0x7f605015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:05.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f6054e44700 1 -- 172.21.15.29:0/1100947208 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6050068cf0 con 0x7f6050070700 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.915+0000 7f6054e44700 1 --2- 172.21.15.29:0/1100947208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f6050070b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f605006e0b0 tx=0x7f6048009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29df45375b21f0b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f604effd700 1 -- 172.21.15.29:0/1100947208 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800e070 con 0x7f6050070700 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f604effd700 1 -- 172.21.15.29:0/1100947208 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800ba10 con 0x7f6050070700 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f604effd700 1 -- 172.21.15.29:0/1100947208 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480092e0 con 0x7f6050070700 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f60568a7700 1 -- 172.21.15.29:0/1100947208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 msgr2=0x7f6050070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f60568a7700 1 --2- 172.21.15.29:0/1100947208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f6050070b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f605006e0b0 tx=0x7f6048009840 comp rx=0 tx=0).stop 2023-10-08T15:41:05.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f60568a7700 1 -- 172.21.15.29:0/1100947208 shutdown_connections 2023-10-08T15:41:05.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f60568a7700 1 --2- 172.21.15.29:0/1100947208 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f6050070b00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f60568a7700 1 --2- 172.21.15.29:0/1100947208 >> v2:172.21.15.183:3300/0 conn(0x7f60501510f0 0x7f605006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f60568a7700 1 -- 172.21.15.29:0/1100947208 >> 172.21.15.29:0/1100947208 conn(0x7f60500ca4f0 msgr2=0x7f60500ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:05.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f60568a7700 1 -- 172.21.15.29:0/1100947208 shutdown_connections 2023-10-08T15:41:05.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.916+0000 7f60568a7700 1 -- 172.21.15.29:0/1100947208 wait complete. 2023-10-08T15:41:05.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.917+0000 7f60568a7700 1 Processor -- start 2023-10-08T15:41:05.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.917+0000 7f60568a7700 1 -- start start 2023-10-08T15:41:05.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f60568a7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f605014ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f60568a7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60500c9af0 0x7f60500c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f60568a7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60501510f0 0x7f6050156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f60568a7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605015bd70 con 0x7f6050070700 2023-10-08T15:41:05.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f60568a7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60500c7a30 con 0x7f60501510f0 2023-10-08T15:41:05.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f60568a7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500c7470 con 0x7f60500c9af0 2023-10-08T15:41:05.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f604ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f605014ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f604ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f605014ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49824/0 (socket says 172.21.15.29:49824) 2023-10-08T15:41:05.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f604ffff700 1 -- 172.21.15.29:0/519879490 learned_addr learned my addr 172.21.15.29:0/519879490 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:05.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f604f7fe700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60500c9af0 0x7f60500c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.918+0000 7f6054e44700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60501510f0 0x7f6050156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f604ffff700 1 -- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60500c9af0 msgr2=0x7f60500c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f604ffff700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60500c9af0 0x7f60500c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f604ffff700 1 -- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60501510f0 msgr2=0x7f6050156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:05.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f604ffff700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60501510f0 0x7f6050156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:05.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f604ffff700 1 -- 172.21.15.29:0/519879490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048009ae0 con 0x7f6050070700 2023-10-08T15:41:05.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f604ffff700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f605014ff40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f604000c8b0 tx=0x7f6040008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:05.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f6047fff700 1 -- 172.21.15.29:0/519879490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011600 con 0x7f6050070700 2023-10-08T15:41:05.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f6047fff700 1 -- 172.21.15.29:0/519879490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6040011760 con 0x7f6050070700 2023-10-08T15:41:05.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f6047fff700 1 -- 172.21.15.29:0/519879490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011b00 con 0x7f6050070700 2023-10-08T15:41:05.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60500c7750 con 0x7f6050070700 2023-10-08T15:41:05.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.919+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60500c5560 con 0x7f6050070700 2023-10-08T15:41:05.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.920+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605004c3c0 con 0x7f6050070700 2023-10-08T15:41:05.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.920+0000 7f6047fff700 1 -- 172.21.15.29:0/519879490 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6040018360 con 0x7f6050070700 2023-10-08T15:41:05.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.921+0000 7f6047fff700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6030066f30 0x7f60300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:05.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.921+0000 7f6047fff700 1 -- 172.21.15.29:0/519879490 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6040083ee0 con 0x7f6050070700 2023-10-08T15:41:05.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.921+0000 7f604f7fe700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6030066f30 0x7f60300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:05.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.921+0000 7f604f7fe700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6030066f30 0x7f60300693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f605016df40 tx=0x7f6038009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:05.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:05.925+0000 7f6047fff700 1 -- 172.21.15.29:0/519879490 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6040054f30 con 0x7f6050070700 2023-10-08T15:41:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.195+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6050070ad0 con 0x7f6050070700 2023-10-08T15:41:06.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.196+0000 7f6047fff700 1 -- 172.21.15.29:0/519879490 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6040015090 con 0x7f6050070700 2023-10-08T15:41:06.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:06.196 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlYRZwCRAAGoAPqAnl5NDkgFSuSAb0dQ==", 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.197 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlXJDaFBAAC2AbAwL8n7M+sYYTc2TPsw==", 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.198 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl2PBqEBAAFdiMT6RrjHdj7SRjAbP4sQ==", 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2023-10-08T15:41:06.199 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlsZmxGxAA36NsIsK3XcPqbAnnT92G0Q==", 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlbwxYCxAAi9e56N5uN63J7J+CFrotmQ==", 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.200 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlrFhCEhAAkg2cwfL0v9izcWZW8IkKvA==", 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.201 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlb/xdGxAAXhOqn1ZfBDqVNynmIESgsQ==", 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.202 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlmaSCJBAAD0mbJDLpY+XnpBfW+PxKwg==", 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBSzSJlostbMhAADG+AgRpi1nAPh9OYWKfmXg==", 2023-10-08T15:41:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBSzSJlEG4vORAA0iGg702OP3gHtLsYax/jeg==", 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:06.204 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTzSJlshaZBhAAe3VfHlxRqfigbN61EJnizg==", 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.205 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTzSJlvFS/DxAAOFmLFOOLsMk+glMEkwb+0A==", 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl89iQHxAA+CyqKmHWtMkmRiZd82Bm+A==", 2023-10-08T15:41:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlldcVKBAAZKujKb3x/HYn/QzJ0/iUGA==", 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:41:06.207 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlyMQQJRAA4Wz0XqtCvc38O4gm+T+Ipw==", 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:41:06.208 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl5494LRAAMVyV+XR9M7FmtYcUMmZNSA==", 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.209 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBMzSJlYMULKhAArem31P8khIAGuU9Fghu/tA==", 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mds", 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBWzSJlrA2uKRAAvE4DLDntdcf1pMdGYnEp3g==", 2023-10-08T15:41:06.210 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBWzSJlWxmuKRAAuQDCIj2C4LC16cR2IFmO0g==", 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.211 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-osd", 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBWzSJlXzOuKRAA6G+8PBsKeRMLTUEEKfVoqw==", 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBWzSJlEDyuKRAA5RIlckxln0SIwNnPhI2JMg==", 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.212 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBWzSJlqESuKRAAtq+Om3Qugb3Q/DLboRpJ5Q==", 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBWzSJld02uKRAAncr+NS+EFunUSqvsgUZdCQ==", 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.213 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlvI5NBhAAgIljkxa68BKP6MhsV8a5kA==", 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:06.214 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlAiPhAhAAP7NTLjG1tB3zd69Xz9z/Dw==", 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:06.215 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6030066f30 msgr2=0x7f60300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6030066f30 0x7f60300693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f605016df40 tx=0x7f6038009040 comp rx=0 tx=0).stop 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 msgr2=0x7f605014ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f605014ff40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f604000c8b0 tx=0x7f6040008040 comp rx=0 tx=0).stop 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 shutdown_connections 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6030066f30 0x7f60300693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f60501510f0 0x7f6050156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6050070700 0x7f605014ff40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 --2- 172.21.15.29:0/519879490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f60500c9af0 0x7f60500c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 >> 172.21.15.29:0/519879490 conn(0x7f60500ca4f0 msgr2=0x7f60500afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 shutdown_connections 2023-10-08T15:41:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.198+0000 7f60568a7700 1 -- 172.21.15.29:0/519879490 wait complete. 2023-10-08T15:41:06.218 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T15:41:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.337+0000 7f338b59e700 1 Processor -- start 2023-10-08T15:41:06.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.337+0000 7f338b59e700 1 -- start start 2023-10-08T15:41:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f338b59e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f338c15a170 0x7f338c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f338b59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f338c069040 0x7f338c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f338b59e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338c0694a0 con 0x7f338c159da0 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f338b59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0b34b0 con 0x7f338c069040 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f338b59e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c15ea70 con 0x7f338c15a170 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f338ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f338c069040 0x7f338c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f338ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f338c069040 0x7f338c0af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49840/0 (socket says 172.21.15.29:49840) 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f338ad9d700 1 -- 172.21.15.29:0/139603095 learned_addr learned my addr 172.21.15.29:0/139603095 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.338+0000 7f3389d9b700 1 --2- 172.21.15.29:0/139603095 >> v2:172.21.15.183:3300/0 conn(0x7f338c15a170 0x7f338c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338ad9d700 1 -- 172.21.15.29:0/139603095 >> v2:172.21.15.183:3300/0 conn(0x7f338c15a170 msgr2=0x7f338c068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338ad9d700 1 --2- 172.21.15.29:0/139603095 >> v2:172.21.15.183:3300/0 conn(0x7f338c15a170 0x7f338c068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338ad9d700 1 -- 172.21.15.29:0/139603095 >> v1:172.21.15.183:6789/0 conn(0x7f338c159da0 legacy=0x7f338c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338ad9d700 1 -- 172.21.15.29:0/139603095 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0b3990 con 0x7f338c069040 2023-10-08T15:41:06.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338ad9d700 1 --2- 172.21.15.29:0/139603095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c069040 0x7f338c0af4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f338c0d0b20 tx=0x7f337c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788ddd9cf16b2a49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338959a700 1 -- 172.21.15.29:0/139603095 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c009e70 con 0x7f338c069040 2023-10-08T15:41:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338959a700 1 -- 172.21.15.29:0/139603095 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c00b860 con 0x7f338c069040 2023-10-08T15:41:06.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338959a700 1 -- 172.21.15.29:0/139603095 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c00bc20 con 0x7f338c069040 2023-10-08T15:41:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338b59e700 1 -- 172.21.15.29:0/139603095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c069040 msgr2=0x7f338c0af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.339+0000 7f338b59e700 1 --2- 172.21.15.29:0/139603095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c069040 0x7f338c0af4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f338c0d0b20 tx=0x7f337c009250 comp rx=0 tx=0).stop 2023-10-08T15:41:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.340+0000 7f338b59e700 1 -- 172.21.15.29:0/139603095 shutdown_connections 2023-10-08T15:41:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.340+0000 7f338b59e700 1 --2- 172.21.15.29:0/139603095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c069040 0x7f338c0af4a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.340+0000 7f338b59e700 1 --2- 172.21.15.29:0/139603095 >> v2:172.21.15.183:3300/0 conn(0x7f338c15a170 0x7f338c068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.340+0000 7f338b59e700 1 -- 172.21.15.29:0/139603095 >> 172.21.15.29:0/139603095 conn(0x7f338c0d0bc0 msgr2=0x7f338c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.340+0000 7f338b59e700 1 -- 172.21.15.29:0/139603095 shutdown_connections 2023-10-08T15:41:06.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.340+0000 7f338b59e700 1 -- 172.21.15.29:0/139603095 wait complete. 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.341+0000 7f338b59e700 1 Processor -- start 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.341+0000 7f338b59e700 1 -- start start 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.341+0000 7f338b59e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f338c069040 0x7f338c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.341+0000 7f338b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c159da0 0x7f338c0c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.341+0000 7f338b59e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f338c15a170 0x7f338c14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.341+0000 7f338b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0c7910 con 0x7f338c159da0 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.341+0000 7f338b59e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0c6d00 con 0x7f338c15a170 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.341+0000 7f338b59e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0c6fe0 con 0x7f338c069040 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c159da0 0x7f338c0c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c159da0 0x7f338c0c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49848/0 (socket says 172.21.15.29:49848) 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 -- 172.21.15.29:0/3814899330 learned_addr learned my addr 172.21.15.29:0/3814899330 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:06.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f338a59c700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f338c069040 0x7f338c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f338ad9d700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f338c15a170 0x7f338c14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 -- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f338c069040 msgr2=0x7f338c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f338c069040 0x7f338c0afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 -- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f338c15a170 msgr2=0x7f338c14ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f338c15a170 0x7f338c14ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 -- 172.21.15.29:0/3814899330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0094f0 con 0x7f338c159da0 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f3389d9b700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c159da0 0x7f338c0c6490 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f337400e930 tx=0x7f33740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f33827fc700 1 -- 172.21.15.29:0/3814899330 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374013680 con 0x7f338c159da0 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f33827fc700 1 -- 172.21.15.29:0/3814899330 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33740137e0 con 0x7f338c159da0 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c0c72c0 con 0x7f338c159da0 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f33827fc700 1 -- 172.21.15.29:0/3814899330 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374013b80 con 0x7f338c159da0 2023-10-08T15:41:06.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.342+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c0c69d0 con 0x7f338c159da0 2023-10-08T15:41:06.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.343+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c089480 con 0x7f338c159da0 2023-10-08T15:41:06.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.344+0000 7f33827fc700 1 -- 172.21.15.29:0/3814899330 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f337400c3e0 con 0x7f338c159da0 2023-10-08T15:41:06.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.344+0000 7f33827fc700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f336c066f30 0x7f336c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.344+0000 7f33827fc700 1 -- 172.21.15.29:0/3814899330 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3374084290 con 0x7f338c159da0 2023-10-08T15:41:06.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.344+0000 7f338a59c700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f336c066f30 0x7f336c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.345+0000 7f338a59c700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f336c066f30 0x7f336c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3384007fd0 tx=0x7f3384000f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.348+0000 7f33827fc700 1 -- 172.21.15.29:0/3814899330 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3374051850 con 0x7f338c159da0 2023-10-08T15:41:06.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.622+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f338c0c7760 con 0x7f338c159da0 2023-10-08T15:41:06.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.628+0000 7f33827fc700 1 -- 172.21.15.29:0/3814899330 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3374054e70 con 0x7f338c159da0 2023-10-08T15:41:06.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f336c066f30 msgr2=0x7f336c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f336c066f30 0x7f336c0693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3384007fd0 tx=0x7f3384000f40 comp rx=0 tx=0).stop 2023-10-08T15:41:06.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c159da0 msgr2=0x7f338c0c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c159da0 0x7f338c0c6490 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f337400e930 tx=0x7f33740091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 shutdown_connections 2023-10-08T15:41:06.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f336c066f30 0x7f336c0693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f338c15a170 0x7f338c14ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f338c069040 0x7f338c0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 --2- 172.21.15.29:0/3814899330 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f338c159da0 0x7f338c0c6490 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 >> 172.21.15.29:0/3814899330 conn(0x7f338c0d0bc0 msgr2=0x7f338c159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:06.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 shutdown_connections 2023-10-08T15:41:06.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.630+0000 7f338b59e700 1 -- 172.21.15.29:0/3814899330 wait complete. 2023-10-08T15:41:06.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T15:41:06.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.762+0000 7fc178cd3700 1 Processor -- start 2023-10-08T15:41:06.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.762+0000 7fc178cd3700 1 -- start start 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc178cd3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc17415a620 0x7fc17415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc178cd3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17415cbb0 con 0x7fc174157870 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc178cd3700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17415bfa0 con 0x7fc17415d580 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc178cd3700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17415bdb0 con 0x7fc17415a620 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc174157870 0x7fc17415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51606/0 (socket says 172.21.15.29:51606) 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17259c700 1 -- 172.21.15.29:0/839209114 learned_addr learned my addr 172.21.15.29:0/839209114 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc171d9b700 1 --2- 172.21.15.29:0/839209114 >> v2:172.21.15.183:3300/0 conn(0x7fc17415a620 0x7fc17415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596815464 0 0) 0x7fc17415cbb0 con 0x7fc174157870 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc15c003570 con 0x7fc174157870 2023-10-08T15:41:06.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3396653416 0 0) 0x7fc15c003570 con 0x7fc174157870 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 >> v2:172.21.15.183:3300/0 conn(0x7fc17415a620 msgr2=0x7fc17415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 --2- 172.21.15.29:0/839209114 >> v2:172.21.15.183:3300/0 conn(0x7fc17415a620 0x7fc17415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 >> v1:172.21.15.183:6789/0 conn(0x7fc17415d580 legacy=0x7fc174158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17415c280 con 0x7fc174157870 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fc164001470 con 0x7fc174157870 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 >> v1:172.21.15.29:6789/0 conn(0x7fc174157870 legacy=0x7fc17415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc15c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc15c004810 0x7fc15c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc15c0051c0 0x7fc15c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c00c130 con 0x7fc15c003a60 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.763+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c00c2a0 con 0x7fc15c0051c0 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c00c460 con 0x7fc15c004810 2023-10-08T15:41:06.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17259c700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc15c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc171d9b700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc15c004810 0x7fc15c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc172d9d700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc15c0051c0 0x7fc15c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17259c700 1 -- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc15c004810 msgr2=0x7fc15c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17259c700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc15c004810 0x7fc15c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17259c700 1 -- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc15c0051c0 msgr2=0x7fc15c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17259c700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc15c0051c0 0x7fc15c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc172d9d700 1 -- 172.21.15.29:0/839209114 reap_dead start 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17259c700 1 -- 172.21.15.29:0/839209114 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c003570 con 0x7fc15c003a60 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc171d9b700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc15c004810 0x7fc15c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17259c700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc15c003e70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c3c0 tx=0x7fc164001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2104645f4aa245a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400cc90 con 0x7fc15c003a60 2023-10-08T15:41:06.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16400cdf0 con 0x7fc15c003a60 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.764+0000 7fc17159a700 1 -- 172.21.15.29:0/839209114 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164005b50 con 0x7fc15c003a60 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.765+0000 7fc178cd3700 1 -- 172.21.15.29:0/839209114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 msgr2=0x7fc15c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.765+0000 7fc178cd3700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc15c003e70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c3c0 tx=0x7fc164001e50 comp rx=0 tx=0).stop 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.765+0000 7fc178cd3700 1 -- 172.21.15.29:0/839209114 shutdown_connections 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.765+0000 7fc178cd3700 1 --2- 172.21.15.29:0/839209114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc15c003e70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.765+0000 7fc178cd3700 1 -- 172.21.15.29:0/839209114 >> 172.21.15.29:0/839209114 conn(0x7fc174068ce0 msgr2=0x7fc1740690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.765+0000 7fc178cd3700 1 -- 172.21.15.29:0/839209114 shutdown_connections 2023-10-08T15:41:06.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.765+0000 7fc178cd3700 1 -- 172.21.15.29:0/839209114 wait complete. 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.766+0000 7fc178cd3700 1 Processor -- start 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.766+0000 7fc178cd3700 1 -- start start 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc178cd3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc1741398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc178cd3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17414cee0 0x7fc17414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc178cd3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1741548f0 0x7fc174154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc178cd3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b18d0 con 0x7fc15c003a60 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc178cd3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1741552d0 con 0x7fc17414cee0 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc178cd3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740b0cc0 con 0x7fc1741548f0 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc1741398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc1741398c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49856/0 (socket says 172.21.15.29:49856) 2023-10-08T15:41:06.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 -- 172.21.15.29:0/322357018 learned_addr learned my addr 172.21.15.29:0/322357018 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc171d9b700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17414cee0 0x7fc17414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc172d9d700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1741548f0 0x7fc174154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 -- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1741548f0 msgr2=0x7fc174154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1741548f0 0x7fc174154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 -- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17414cee0 msgr2=0x7fc17414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17414cee0 0x7fc17414d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 -- 172.21.15.29:0/322357018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740b0fa0 con 0x7fc15c003a60 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc17259c700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc1741398c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c9b0 tx=0x7fc164015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc1627fc700 1 -- 172.21.15.29:0/322357018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164021070 con 0x7fc15c003a60 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc1627fc700 1 -- 172.21.15.29:0/322357018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164000bc0 con 0x7fc15c003a60 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc1627fc700 1 -- 172.21.15.29:0/322357018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164007340 con 0x7fc15c003a60 2023-10-08T15:41:06.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740b1280 con 0x7fc15c003a60 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.767+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17414d890 con 0x7fc15c003a60 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.768+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17404c3c0 con 0x7fc15c003a60 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.769+0000 7fc1627fc700 1 -- 172.21.15.29:0/322357018 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1640076f0 con 0x7fc15c003a60 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.769+0000 7fc1627fc700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc154066f30 0x7fc1540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.769+0000 7fc1627fc700 1 -- 172.21.15.29:0/322357018 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc164085130 con 0x7fc15c003a60 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.769+0000 7fc171d9b700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc154066f30 0x7fc1540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.770+0000 7fc171d9b700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc154066f30 0x7fc1540693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc17414eb40 tx=0x7fc168008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:06.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:06.773+0000 7fc1627fc700 1 -- 172.21.15.29:0/322357018 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1640527a0 con 0x7fc15c003a60 2023-10-08T15:41:07.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.050+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc17415c560 con 0x7fc15c003a60 2023-10-08T15:41:07.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.053+0000 7fc1627fc700 1 -- 172.21.15.29:0/322357018 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc164055dc0 con 0x7fc15c003a60 2023-10-08T15:41:07.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc154066f30 msgr2=0x7fc1540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc154066f30 0x7fc1540693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc17414eb40 tx=0x7fc168008040 comp rx=0 tx=0).stop 2023-10-08T15:41:07.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 msgr2=0x7fc1741398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc1741398c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c9b0 tx=0x7fc164015000 comp rx=0 tx=0).stop 2023-10-08T15:41:07.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 shutdown_connections 2023-10-08T15:41:07.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc154066f30 0x7fc1540693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1741548f0 0x7fc174154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc15c003a60 0x7fc1741398c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.055+0000 7fc178cd3700 1 --2- 172.21.15.29:0/322357018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc17414cee0 0x7fc17414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.056+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 >> 172.21.15.29:0/322357018 conn(0x7fc174068ce0 msgr2=0x7fc1741593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:07.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.056+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 shutdown_connections 2023-10-08T15:41:07.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.056+0000 7fc178cd3700 1 -- 172.21.15.29:0/322357018 wait complete. 2023-10-08T15:41:07.068 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T15:41:07.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.188+0000 7fc049e16700 1 Processor -- start 2023-10-08T15:41:07.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.188+0000 7fc049e16700 1 -- start start 2023-10-08T15:41:07.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc049e16700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440cffa0 0x7fc04406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc049e16700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc04415a230 0x7fc04406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc049e16700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0440b3d40 con 0x7fc044159e60 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc049e16700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc044069d70 con 0x7fc04415a230 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc049e16700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440b4300 con 0x7fc0440cffa0 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc042ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440cffa0 0x7fc04406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc043fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc04415a230 0x7fc04406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc042ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440cffa0 0x7fc04406a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:54456/0 (socket says 172.21.15.29:54456) 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc042ffd700 1 -- 172.21.15.29:0/3746476540 learned_addr learned my addr 172.21.15.29:0/3746476540 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc042ffd700 1 -- 172.21.15.29:0/3746476540 >> v2:172.21.15.183:3300/0 conn(0x7fc04415a230 msgr2=0x7fc04406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.189+0000 7fc042ffd700 1 --2- 172.21.15.29:0/3746476540 >> v2:172.21.15.183:3300/0 conn(0x7fc04415a230 0x7fc04406abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc042ffd700 1 -- 172.21.15.29:0/3746476540 >> v1:172.21.15.183:6789/0 conn(0x7fc044159e60 legacy=0x7fc0440b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc042ffd700 1 -- 172.21.15.29:0/3746476540 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0440d0480 con 0x7fc0440cffa0 2023-10-08T15:41:07.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc042ffd700 1 --2- 172.21.15.29:0/3746476540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440cffa0 0x7fc04406a6a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0380099b0 tx=0x7fc038009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=921e41e13877d11c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc0427fc700 1 -- 172.21.15.29:0/3746476540 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038009ea0 con 0x7fc0440cffa0 2023-10-08T15:41:07.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc0427fc700 1 -- 172.21.15.29:0/3746476540 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800b860 con 0x7fc0440cffa0 2023-10-08T15:41:07.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc0427fc700 1 -- 172.21.15.29:0/3746476540 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800bc00 con 0x7fc0440cffa0 2023-10-08T15:41:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc049e16700 1 -- 172.21.15.29:0/3746476540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440cffa0 msgr2=0x7fc04406a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc049e16700 1 --2- 172.21.15.29:0/3746476540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440cffa0 0x7fc04406a6a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0380099b0 tx=0x7fc038009250 comp rx=0 tx=0).stop 2023-10-08T15:41:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc049e16700 1 -- 172.21.15.29:0/3746476540 shutdown_connections 2023-10-08T15:41:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc049e16700 1 --2- 172.21.15.29:0/3746476540 >> v2:172.21.15.183:3300/0 conn(0x7fc04415a230 0x7fc04406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc049e16700 1 --2- 172.21.15.29:0/3746476540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440cffa0 0x7fc04406a6a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc049e16700 1 -- 172.21.15.29:0/3746476540 >> 172.21.15.29:0/3746476540 conn(0x7fc0440d1a50 msgr2=0x7fc044068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:07.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.190+0000 7fc049e16700 1 -- 172.21.15.29:0/3746476540 shutdown_connections 2023-10-08T15:41:07.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.191+0000 7fc049e16700 1 -- 172.21.15.29:0/3746476540 wait complete. 2023-10-08T15:41:07.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.192+0000 7fc049e16700 1 Processor -- start 2023-10-08T15:41:07.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.192+0000 7fc049e16700 1 -- start start 2023-10-08T15:41:07.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc049e16700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440cffa0 0x7fc0440c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc049e16700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc044159e60 0x7fc0440c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc049e16700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc04415a230 0x7fc0440c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc049e16700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04415b660 con 0x7fc04415a230 2023-10-08T15:41:07.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc049e16700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04415bc20 con 0x7fc0440cffa0 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc049e16700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440c8330 con 0x7fc044159e60 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc0437fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440cffa0 0x7fc0440c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc04415a230 0x7fc0440c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc04415a230 0x7fc0440c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49866/0 (socket says 172.21.15.29:49866) 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc0437fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440cffa0 0x7fc0440c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:54440/0 (socket says 172.21.15.29:54440) 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 -- 172.21.15.29:0/1699034840 learned_addr learned my addr 172.21.15.29:0/1699034840 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc042ffd700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc044159e60 0x7fc0440c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 -- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc044159e60 msgr2=0x7fc0440c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc044159e60 0x7fc0440c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 -- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440cffa0 msgr2=0x7fc0440c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440cffa0 0x7fc0440c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 -- 172.21.15.29:0/1699034840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380094f0 con 0x7fc04415a230 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc0437fe700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440cffa0 0x7fc0440c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc043fff700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc04415a230 0x7fc0440c6260 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009df0 tx=0x7fc03c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc02b7fe700 1 -- 172.21.15.29:0/1699034840 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00caa0 con 0x7fc04415a230 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc02b7fe700 1 -- 172.21.15.29:0/1699034840 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c00f040 con 0x7fc04415a230 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0440c8610 con 0x7fc04415a230 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc02b7fe700 1 -- 172.21.15.29:0/1699034840 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00ce50 con 0x7fc04415a230 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.193+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0441559a0 con 0x7fc04415a230 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.194+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04404c3c0 con 0x7fc04415a230 2023-10-08T15:41:07.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.195+0000 7fc02b7fe700 1 -- 172.21.15.29:0/1699034840 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc03c014690 con 0x7fc04415a230 2023-10-08T15:41:07.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.195+0000 7fc02b7fe700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.195+0000 7fc02b7fe700 1 -- 172.21.15.29:0/1699034840 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc03c084960 con 0x7fc04415a230 2023-10-08T15:41:07.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.195+0000 7fc0437fe700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.196+0000 7fc0437fe700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc030066f30 0x7fc0300693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc034001de0 tx=0x7fc034009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.200+0000 7fc02b7fe700 1 -- 172.21.15.29:0/1699034840 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc03c051f20 con 0x7fc04415a230 2023-10-08T15:41:07.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.471+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc0440d0760 con 0x7fc04415a230 2023-10-08T15:41:07.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.474+0000 7fc02b7fe700 1 -- 172.21.15.29:0/1699034840 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc03c055540 con 0x7fc04415a230 2023-10-08T15:41:07.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc030066f30 msgr2=0x7fc0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc030066f30 0x7fc0300693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc034001de0 tx=0x7fc034009040 comp rx=0 tx=0).stop 2023-10-08T15:41:07.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc04415a230 msgr2=0x7fc0440c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc04415a230 0x7fc0440c6260 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009df0 tx=0x7fc03c00b040 comp rx=0 tx=0).stop 2023-10-08T15:41:07.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 shutdown_connections 2023-10-08T15:41:07.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc030066f30 0x7fc0300693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc04415a230 0x7fc0440c6260 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440cffa0 0x7fc0440c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 --2- 172.21.15.29:0/1699034840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc044159e60 0x7fc0440c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 >> 172.21.15.29:0/1699034840 conn(0x7fc0440d1a50 msgr2=0x7fc0440b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:07.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 shutdown_connections 2023-10-08T15:41:07.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.476+0000 7fc049e16700 1 -- 172.21.15.29:0/1699034840 wait complete. 2023-10-08T15:41:07.489 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T15:41:07.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.608+0000 7f8f9c0da700 1 Processor -- start 2023-10-08T15:41:07.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.609+0000 7f8f9c0da700 1 -- start start 2023-10-08T15:41:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.609+0000 7f8f9c0da700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8f940b1220 0x7f8f940c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.609+0000 7f8f9c0da700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9415de60 con 0x7f8f940cb4f0 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.609+0000 7f8f9c0da700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9415e140 con 0x7f8f940b0e50 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.609+0000 7f8f9c0da700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9415e420 con 0x7f8f940b1220 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.609+0000 7f8f9a677700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8f940cb4f0 0x7f8f940679d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51616/0 (socket says 172.21.15.29:51616) 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f9a677700 1 -- 172.21.15.29:0/3550461904 learned_addr learned my addr 172.21.15.29:0/3550461904 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f99675700 1 --2- 172.21.15.29:0/3550461904 >> v2:172.21.15.183:3300/0 conn(0x7f8f940b1220 0x7f8f940c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193045248 0 0) 0x7f8f9415de60 con 0x7f8f940cb4f0 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f7c003570 con 0x7f8f940cb4f0 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099209743 0 0) 0x7f8f7c003570 con 0x7f8f940cb4f0 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 >> v2:172.21.15.183:3300/0 conn(0x7f8f940b1220 msgr2=0x7f8f940c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:07.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 --2- 172.21.15.29:0/3550461904 >> v2:172.21.15.183:3300/0 conn(0x7f8f940b1220 0x7f8f940c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 >> v1:172.21.15.183:6789/0 conn(0x7f8f940b0e50 legacy=0x7f8f9406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9415e700 con 0x7f8f940cb4f0 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f8f840017f0 con 0x7f8f940cb4f0 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 >> v1:172.21.15.29:6789/0 conn(0x7f8f940cb4f0 legacy=0x7f8f940679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f7c003a60 0x7f8f7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f7c004810 0x7f8f7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c0052e0 0x7f8f7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9415e420 con 0x7f8f7c003a60 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c00c2a0 con 0x7f8f7c004810 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c00c460 con 0x7f8f7c0052e0 2023-10-08T15:41:07.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f99e76700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f7c003a60 0x7f8f7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f99675700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f7c004810 0x7f8f7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.610+0000 7f8f9a677700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c0052e0 0x7f8f7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f99e76700 1 -- 172.21.15.29:0/3550461904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c0052e0 msgr2=0x7f8f7c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f99e76700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c0052e0 0x7f8f7c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f99e76700 1 -- 172.21.15.29:0/3550461904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f7c004810 msgr2=0x7f8f7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f99e76700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f7c004810 0x7f8f7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f9a677700 1 -- 172.21.15.29:0/3550461904 reap_dead start 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f99e76700 1 -- 172.21.15.29:0/3550461904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c003570 con 0x7f8f7c003a60 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f99e76700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f7c003a60 0x7f8f7c003e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0018b0 tx=0x7f8f8c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47154212ecf62201 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c012420 con 0x7f8f7c003a60 2023-10-08T15:41:07.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c0125a0 con 0x7f8f7c003a60 2023-10-08T15:41:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f98e74700 1 -- 172.21.15.29:0/3550461904 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c012960 con 0x7f8f7c003a60 2023-10-08T15:41:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f9c0da700 1 -- 172.21.15.29:0/3550461904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f7c003a60 msgr2=0x7f8f7c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f9c0da700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f7c003a60 0x7f8f7c003e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0018b0 tx=0x7f8f8c007d30 comp rx=0 tx=0).stop 2023-10-08T15:41:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f9c0da700 1 -- 172.21.15.29:0/3550461904 shutdown_connections 2023-10-08T15:41:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f9c0da700 1 --2- 172.21.15.29:0/3550461904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f7c003a60 0x7f8f7c003e70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.611+0000 7f8f9c0da700 1 -- 172.21.15.29:0/3550461904 >> 172.21.15.29:0/3550461904 conn(0x7f8f94069870 msgr2=0x7f8f94069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.612+0000 7f8f9c0da700 1 -- 172.21.15.29:0/3550461904 shutdown_connections 2023-10-08T15:41:07.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.612+0000 7f8f9c0da700 1 -- 172.21.15.29:0/3550461904 wait complete. 2023-10-08T15:41:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9c0da700 1 Processor -- start 2023-10-08T15:41:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9c0da700 1 -- start start 2023-10-08T15:41:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9c0da700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c003a60 0x7f8f940b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9c0da700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f940b45e0 0x7f8f9414d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9c0da700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f94150970 0x7f8f94150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9c0da700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940b3270 con 0x7f8f94150970 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9c0da700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9414faf0 con 0x7f8f940b45e0 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9c0da700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f941529b0 con 0x7f8f7c003a60 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9a677700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f94150970 0x7f8f94150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.613+0000 7f8f9a677700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f94150970 0x7f8f94150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49876/0 (socket says 172.21.15.29:49876) 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9a677700 1 -- 172.21.15.29:0/1864592534 learned_addr learned my addr 172.21.15.29:0/1864592534 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f99675700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f940b45e0 0x7f8f9414d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f99e76700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c003a60 0x7f8f940b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9a677700 1 -- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c003a60 msgr2=0x7f8f940b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9a677700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c003a60 0x7f8f940b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9a677700 1 -- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f940b45e0 msgr2=0x7f8f9414d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9a677700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f940b45e0 0x7f8f9414d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9a677700 1 -- 172.21.15.29:0/1864592534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94151320 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9a677700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f94150970 0x7f8f94150de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8f940cd780 tx=0x7f8f840021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f91ffb700 1 -- 172.21.15.29:0/1864592534 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84001f30 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f91ffb700 1 -- 172.21.15.29:0/1864592534 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8400ac90 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f94152c70 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f91ffb700 1 -- 172.21.15.29:0/1864592534 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84013660 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.614+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f940b2cb0 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.615+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f94152e00 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.616+0000 7f8f91ffb700 1 -- 172.21.15.29:0/1864592534 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f84013a10 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.616+0000 7f8f91ffb700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8f80066f30 0x7f8f800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.616+0000 7f8f91ffb700 1 -- 172.21.15.29:0/1864592534 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8f84084a80 con 0x7f8f94150970 2023-10-08T15:41:07.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.616+0000 7f8f99e76700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8f80066f30 0x7f8f800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:07.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.617+0000 7f8f99e76700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8f80066f30 0x7f8f800693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c000c00 tx=0x7f8f8c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:07.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.620+0000 7f8f91ffb700 1 -- 172.21.15.29:0/1864592534 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f84052040 con 0x7f8f94150970 2023-10-08T15:41:07.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.896+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8f9404c3c0 con 0x7f8f94150970 2023-10-08T15:41:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.899+0000 7f8f91ffb700 1 -- 172.21.15.29:0/1864592534 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8f84055660 con 0x7f8f94150970 2023-10-08T15:41:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8f80066f30 msgr2=0x7f8f800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8f80066f30 0x7f8f800693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c000c00 tx=0x7f8f8c015000 comp rx=0 tx=0).stop 2023-10-08T15:41:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f94150970 msgr2=0x7f8f94150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f94150970 0x7f8f94150de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8f940cd780 tx=0x7f8f840021d0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 shutdown_connections 2023-10-08T15:41:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8f80066f30 0x7f8f800693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f94150970 0x7f8f94150de0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7c003a60 0x7f8f940b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 --2- 172.21.15.29:0/1864592534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f940b45e0 0x7f8f9414d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 >> 172.21.15.29:0/1864592534 conn(0x7f8f94069870 msgr2=0x7f8f94069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 shutdown_connections 2023-10-08T15:41:07.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:07.901+0000 7f8f9c0da700 1 -- 172.21.15.29:0/1864592534 wait complete. 2023-10-08T15:41:07.914 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T15:41:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.033+0000 7f77f81d2700 1 Processor -- start 2023-10-08T15:41:08.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.033+0000 7f77f81d2700 1 -- start start 2023-10-08T15:41:08.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.034+0000 7f77f81d2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0152010 0x7f77f015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.034+0000 7f77f81d2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f77f01523e0 0x7f77f006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.034+0000 7f77f81d2700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f006c010 con 0x7f77f0158e50 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.034+0000 7f77f81d2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f006bd10 con 0x7f77f01523e0 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.034+0000 7f77f81d2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f015c060 con 0x7f77f0152010 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.034+0000 7f77f676f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f77f0158e50 0x7f77f00cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:51622/0 (socket says 172.21.15.29:51622) 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.034+0000 7f77f676f700 1 -- 172.21.15.29:0/4221438674 learned_addr learned my addr 172.21.15.29:0/4221438674 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f576d700 1 --2- 172.21.15.29:0/4221438674 >> v2:172.21.15.183:3300/0 conn(0x7f77f01523e0 0x7f77f006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f5f6e700 1 --2- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0152010 0x7f77f015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f4f6c700 1 -- 172.21.15.29:0/4221438674 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081074399 0 0) 0x7f77f006c010 con 0x7f77f0158e50 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f4f6c700 1 -- 172.21.15.29:0/4221438674 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d8003570 con 0x7f77f0158e50 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f576d700 1 -- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0152010 msgr2=0x7f77f015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f576d700 1 --2- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0152010 0x7f77f015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f576d700 1 -- 172.21.15.29:0/4221438674 >> v1:172.21.15.29:6789/0 conn(0x7f77f0158e50 legacy=0x7f77f00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f576d700 1 -- 172.21.15.29:0/4221438674 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f015c340 con 0x7f77f01523e0 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f5f6e700 1 --2- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0152010 0x7f77f015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f576d700 1 --2- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 0x7f77f006c4a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77e40098e0 tx=0x7f77e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0d9db00ba0de5f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f4f6c700 1 -- 172.21.15.29:0/4221438674 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4011630 con 0x7f77f01523e0 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f4f6c700 1 -- 172.21.15.29:0/4221438674 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e4011790 con 0x7f77f01523e0 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.035+0000 7f77f4f6c700 1 -- 172.21.15.29:0/4221438674 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4011b10 con 0x7f77f01523e0 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.036+0000 7f77f81d2700 1 -- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 msgr2=0x7f77f006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.036+0000 7f77f81d2700 1 --2- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 0x7f77f006c4a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77e40098e0 tx=0x7f77e40091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.036+0000 7f77f81d2700 1 -- 172.21.15.29:0/4221438674 shutdown_connections 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.036+0000 7f77f81d2700 1 --2- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0152010 0x7f77f015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.036+0000 7f77f81d2700 1 --2- 172.21.15.29:0/4221438674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 0x7f77f006c4a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.036+0000 7f77f81d2700 1 -- 172.21.15.29:0/4221438674 >> 172.21.15.29:0/4221438674 conn(0x7f77f0069870 msgr2=0x7f77f0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:08.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.036+0000 7f77f81d2700 1 -- 172.21.15.29:0/4221438674 shutdown_connections 2023-10-08T15:41:08.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.036+0000 7f77f81d2700 1 -- 172.21.15.29:0/4221438674 wait complete. 2023-10-08T15:41:08.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.037+0000 7f77f81d2700 1 Processor -- start 2023-10-08T15:41:08.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.037+0000 7f77f81d2700 1 -- start start 2023-10-08T15:41:08.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f81d2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f0152010 0x7f77f01438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f81d2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 0x7f77f00c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f81d2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0158e50 0x7f77f00c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f81d2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0143e00 con 0x7f77f0152010 2023-10-08T15:41:08.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f81d2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00c6870 con 0x7f77f01523e0 2023-10-08T15:41:08.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f81d2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00c6b50 con 0x7f77f0158e50 2023-10-08T15:41:08.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f0152010 0x7f77f01438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f0152010 0x7f77f01438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49892/0 (socket says 172.21.15.29:49892) 2023-10-08T15:41:08.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 -- 172.21.15.29:0/750548251 learned_addr learned my addr 172.21.15.29:0/750548251 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:08.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f576d700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 0x7f77f00c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 -- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0158e50 msgr2=0x7f77f00c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0158e50 0x7f77f00c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 -- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 msgr2=0x7f77f00c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 0x7f77f00c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 -- 172.21.15.29:0/750548251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8009420 con 0x7f77f0152010 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f576d700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 0x7f77f00c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.038+0000 7f77f5f6e700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f0152010 0x7f77f01438c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f77e800ec80 tx=0x7f77e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.039+0000 7f77edffb700 1 -- 172.21.15.29:0/750548251 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e800c9d0 con 0x7f77f0152010 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.039+0000 7f77edffb700 1 -- 172.21.15.29:0/750548251 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e800cb30 con 0x7f77f0152010 2023-10-08T15:41:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.039+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e4009420 con 0x7f77f0152010 2023-10-08T15:41:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.039+0000 7f77edffb700 1 -- 172.21.15.29:0/750548251 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e800ceb0 con 0x7f77f0152010 2023-10-08T15:41:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.039+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f00c7110 con 0x7f77f0152010 2023-10-08T15:41:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.040+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f00b0870 con 0x7f77f0152010 2023-10-08T15:41:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.040+0000 7f77edffb700 1 -- 172.21.15.29:0/750548251 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77e8013680 con 0x7f77f0152010 2023-10-08T15:41:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.041+0000 7f77edffb700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77dc066f30 0x7f77dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.041+0000 7f77edffb700 1 -- 172.21.15.29:0/750548251 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f77e8084630 con 0x7f77f0152010 2023-10-08T15:41:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.041+0000 7f77f576d700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77dc066f30 0x7f77dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.041+0000 7f77f576d700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77dc066f30 0x7f77dc0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77f01527f0 tx=0x7f77e4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.045+0000 7f77edffb700 1 -- 172.21.15.29:0/750548251 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77e8051bf0 con 0x7f77f0152010 2023-10-08T15:41:08.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.316+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f77f004c3c0 con 0x7f77f0152010 2023-10-08T15:41:08.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.320+0000 7f77edffb700 1 -- 172.21.15.29:0/750548251 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f77e8055210 con 0x7f77f0152010 2023-10-08T15:41:08.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77dc066f30 msgr2=0x7f77dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77dc066f30 0x7f77dc0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77f01527f0 tx=0x7f77e4017000 comp rx=0 tx=0).stop 2023-10-08T15:41:08.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f0152010 msgr2=0x7f77f01438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f0152010 0x7f77f01438c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f77e800ec80 tx=0x7f77e80091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 shutdown_connections 2023-10-08T15:41:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77dc066f30 0x7f77dc0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f0158e50 0x7f77f00c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f0152010 0x7f77f01438c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 --2- 172.21.15.29:0/750548251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77f01523e0 0x7f77f00c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 >> 172.21.15.29:0/750548251 conn(0x7f77f0069870 msgr2=0x7f77f006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 shutdown_connections 2023-10-08T15:41:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.322+0000 7f77f81d2700 1 -- 172.21.15.29:0/750548251 wait complete. 2023-10-08T15:41:08.335 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T15:41:08.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.453+0000 7f04d364d700 1 Processor -- start 2023-10-08T15:41:08.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.454+0000 7f04d364d700 1 -- start start 2023-10-08T15:41:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.454+0000 7f04d364d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04cc1523e0 0x7f04cc06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.454+0000 7f04d364d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f04cc158e50 0x7f04cc0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.454+0000 7f04d364d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc06c010 con 0x7f04cc152010 2023-10-08T15:41:08.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.454+0000 7f04d364d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc06bd10 con 0x7f04cc1523e0 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.454+0000 7f04d364d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc15c060 con 0x7f04cc158e50 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.454+0000 7f04d0be8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04cc1523e0 0x7f04cc06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04d13e9700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f04cc152010 0x7f04cc15b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55982/0 (socket says 172.21.15.29:55982) 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04d13e9700 1 -- 172.21.15.29:0/508144450 learned_addr learned my addr 172.21.15.29:0/508144450 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04d1bea700 1 --2- 172.21.15.29:0/508144450 >> v2:172.21.15.183:3300/0 conn(0x7f04cc158e50 0x7f04cc0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04d0be8700 1 -- 172.21.15.29:0/508144450 >> v2:172.21.15.183:3300/0 conn(0x7f04cc158e50 msgr2=0x7f04cc0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04d0be8700 1 --2- 172.21.15.29:0/508144450 >> v2:172.21.15.183:3300/0 conn(0x7f04cc158e50 0x7f04cc0cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04d0be8700 1 -- 172.21.15.29:0/508144450 >> v1:172.21.15.29:6789/0 conn(0x7f04cc152010 legacy=0x7f04cc15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04d0be8700 1 -- 172.21.15.29:0/508144450 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc15c340 con 0x7f04cc1523e0 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04cbfff700 1 -- 172.21.15.29:0/508144450 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246041262 0 0) 0x7f04cc06c010 con 0x7f04cc152010 2023-10-08T15:41:08.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04d0be8700 1 --2- 172.21.15.29:0/508144450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc1523e0 0x7f04cc06c4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f04cc06f170 tx=0x7f04c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc7bd6f65b046c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04cbfff700 1 -- 172.21.15.29:0/508144450 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000b6b0 con 0x7f04cc1523e0 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04cbfff700 1 -- 172.21.15.29:0/508144450 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c000b810 con 0x7f04cc1523e0 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.455+0000 7f04cbfff700 1 -- 172.21.15.29:0/508144450 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000bbb0 con 0x7f04cc1523e0 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.456+0000 7f04d364d700 1 -- 172.21.15.29:0/508144450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc1523e0 msgr2=0x7f04cc06c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.456+0000 7f04d364d700 1 --2- 172.21.15.29:0/508144450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc1523e0 0x7f04cc06c4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f04cc06f170 tx=0x7f04c00091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.456+0000 7f04d364d700 1 -- 172.21.15.29:0/508144450 shutdown_connections 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.456+0000 7f04d364d700 1 --2- 172.21.15.29:0/508144450 >> v2:172.21.15.183:3300/0 conn(0x7f04cc158e50 0x7f04cc0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.456+0000 7f04d364d700 1 --2- 172.21.15.29:0/508144450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc1523e0 0x7f04cc06c4a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.456+0000 7f04d364d700 1 -- 172.21.15.29:0/508144450 >> 172.21.15.29:0/508144450 conn(0x7f04cc069870 msgr2=0x7f04cc069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.456+0000 7f04d364d700 1 -- 172.21.15.29:0/508144450 shutdown_connections 2023-10-08T15:41:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.456+0000 7f04d364d700 1 -- 172.21.15.29:0/508144450 wait complete. 2023-10-08T15:41:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.457+0000 7f04d364d700 1 Processor -- start 2023-10-08T15:41:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.457+0000 7f04d364d700 1 -- start start 2023-10-08T15:41:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d364d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc152010 0x7f04cc152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d364d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04cc1523e0 0x7f04cc0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d364d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04cc158e50 0x7f04cc143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d364d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc159240 con 0x7f04cc152010 2023-10-08T15:41:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d364d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc153050 con 0x7f04cc158e50 2023-10-08T15:41:08.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d364d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc153330 con 0x7f04cc1523e0 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc152010 0x7f04cc152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc152010 0x7f04cc152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57012/0 (socket says 172.21.15.29:57012) 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 -- 172.21.15.29:0/2760361405 learned_addr learned my addr 172.21.15.29:0/2760361405 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d0be8700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04cc1523e0 0x7f04cc0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d1bea700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04cc158e50 0x7f04cc143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 -- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04cc1523e0 msgr2=0x7f04cc0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04cc1523e0 0x7f04cc0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 -- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04cc158e50 msgr2=0x7f04cc143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04cc158e50 0x7f04cc143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 -- 172.21.15.29:0/2760361405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0009420 con 0x7f04cc152010 2023-10-08T15:41:08.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04d13e9700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc152010 0x7f04cc152820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f04c400cc70 tx=0x7f04c4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.458+0000 7f04c97fa700 1 -- 172.21.15.29:0/2760361405 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400ce80 con 0x7f04cc152010 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.459+0000 7f04c97fa700 1 -- 172.21.15.29:0/2760361405 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400ab70 con 0x7f04cc152010 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.459+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc153610 con 0x7f04cc152010 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.459+0000 7f04c97fa700 1 -- 172.21.15.29:0/2760361405 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c40070f0 con 0x7f04cc152010 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.459+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc152d60 con 0x7f04cc152010 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.459+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc0b0ca0 con 0x7f04cc152010 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.460+0000 7f04c97fa700 1 -- 172.21.15.29:0/2760361405 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04c40074e0 con 0x7f04cc152010 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.460+0000 7f04c97fa700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.460+0000 7f04c97fa700 1 -- 172.21.15.29:0/2760361405 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f04c4084680 con 0x7f04cc152010 2023-10-08T15:41:08.463 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.461+0000 7f04d0be8700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.461+0000 7f04d0be8700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f04c00093f0 tx=0x7f04c0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.465+0000 7f04c97fa700 1 -- 172.21.15.29:0/2760361405 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04c4051cc0 con 0x7f04cc152010 2023-10-08T15:41:08.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.736+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f04cc04c3c0 con 0x7f04cc152010 2023-10-08T15:41:08.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.739+0000 7f04c97fa700 1 -- 172.21.15.29:0/2760361405 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f04c40552e0 con 0x7f04cc152010 2023-10-08T15:41:08.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f04b8066f30 msgr2=0x7f04b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f04c00093f0 tx=0x7f04c0017000 comp rx=0 tx=0).stop 2023-10-08T15:41:08.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc152010 msgr2=0x7f04cc152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc152010 0x7f04cc152820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f04c400cc70 tx=0x7f04c4001a30 comp rx=0 tx=0).stop 2023-10-08T15:41:08.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 shutdown_connections 2023-10-08T15:41:08.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f04cc158e50 0x7f04cc143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04cc152010 0x7f04cc152820 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 --2- 172.21.15.29:0/2760361405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04cc1523e0 0x7f04cc0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 >> 172.21.15.29:0/2760361405 conn(0x7f04cc069870 msgr2=0x7f04cc151650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 shutdown_connections 2023-10-08T15:41:08.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.741+0000 7f04d364d700 1 -- 172.21.15.29:0/2760361405 wait complete. 2023-10-08T15:41:08.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:08.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.872+0000 7f1bf1150700 1 Processor -- start 2023-10-08T15:41:08.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.872+0000 7f1bf1150700 1 -- start start 2023-10-08T15:41:08.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf1150700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 0x7f1bec0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf1150700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1bec0cdab0 0x7f1bec15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf1150700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bec15dda0 0x7f1bec15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf1150700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec15e850 con 0x7f1bec15dda0 2023-10-08T15:41:08.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf1150700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec0cd030 con 0x7f1bec0cdab0 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf1150700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0cb7c0 con 0x7f1bec0cd6e0 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf094f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bec15dda0 0x7f1bec15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf094f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1bec15dda0 0x7f1bec15cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57028/0 (socket says 172.21.15.29:57028) 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf094f700 1 -- 172.21.15.29:0/368249571 learned_addr learned my addr 172.21.15.29:0/368249571 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bebfff700 1 --2- 172.21.15.29:0/368249571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 0x7f1bec0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1beb7fe700 1 --2- 172.21.15.29:0/368249571 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0cdab0 0x7f1bec15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf094f700 1 -- 172.21.15.29:0/368249571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 msgr2=0x7f1bec0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf094f700 1 --2- 172.21.15.29:0/368249571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 0x7f1bec0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf094f700 1 -- 172.21.15.29:0/368249571 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0cdab0 msgr2=0x7f1bec15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:08.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf094f700 1 --2- 172.21.15.29:0/368249571 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0cdab0 0x7f1bec15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.873+0000 7f1bf094f700 1 -- 172.21.15.29:0/368249571 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec15e290 con 0x7f1bec15dda0 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf094f700 1 --2- 172.21.15.29:0/368249571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec15dda0 0x7f1bec15cbd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bec089b50 tx=0x7f1be4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737cc679bba38bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1beaffd700 1 -- 172.21.15.29:0/368249571 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400e070 con 0x7f1bec15dda0 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1beaffd700 1 -- 172.21.15.29:0/368249571 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be400b970 con 0x7f1bec15dda0 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1beaffd700 1 -- 172.21.15.29:0/368249571 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be40092e0 con 0x7f1bec15dda0 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 -- 172.21.15.29:0/368249571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec15dda0 msgr2=0x7f1bec15cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 --2- 172.21.15.29:0/368249571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec15dda0 0x7f1bec15cbd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bec089b50 tx=0x7f1be4009840 comp rx=0 tx=0).stop 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 -- 172.21.15.29:0/368249571 shutdown_connections 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 --2- 172.21.15.29:0/368249571 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec15dda0 0x7f1bec15cbd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 --2- 172.21.15.29:0/368249571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 0x7f1bec0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 --2- 172.21.15.29:0/368249571 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0cdab0 0x7f1bec15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 -- 172.21.15.29:0/368249571 >> 172.21.15.29:0/368249571 conn(0x7f1bec067660 msgr2=0x7f1bec067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 -- 172.21.15.29:0/368249571 shutdown_connections 2023-10-08T15:41:08.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.874+0000 7f1bf1150700 1 -- 172.21.15.29:0/368249571 wait complete. 2023-10-08T15:41:08.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.875+0000 7f1bf1150700 1 Processor -- start 2023-10-08T15:41:08.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.876+0000 7f1bf1150700 1 -- start start 2023-10-08T15:41:08.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.876+0000 7f1bf1150700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 0x7f1bec144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.876+0000 7f1bf1150700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec0cdab0 0x7f1bec169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.876+0000 7f1bf1150700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec15dda0 0x7f1bec0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.876+0000 7f1bf1150700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0b3e20 con 0x7f1bec0cdab0 2023-10-08T15:41:08.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.876+0000 7f1bf1150700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec16a4f0 con 0x7f1bec15dda0 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.876+0000 7f1bf1150700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec16a7d0 con 0x7f1bec0cd6e0 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec0cdab0 0x7f1bec169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec0cdab0 0x7f1bec169b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57036/0 (socket says 172.21.15.29:57036) 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 -- 172.21.15.29:0/2646617097 learned_addr learned my addr 172.21.15.29:0/2646617097 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1bf094f700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec15dda0 0x7f1bec0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1bebfff700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 0x7f1bec144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 -- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 msgr2=0x7f1bec144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 0x7f1bec144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 -- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec15dda0 msgr2=0x7f1bec0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec15dda0 0x7f1bec0b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 -- 172.21.15.29:0/2646617097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be4009ae0 con 0x7f1bec0cdab0 2023-10-08T15:41:08.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1beb7fe700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec0cdab0 0x7f1bec169b60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00ec80 tx=0x7f1bdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1be3fff700 1 -- 172.21.15.29:0/2646617097 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00c850 con 0x7f1bec0cdab0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1be3fff700 1 -- 172.21.15.29:0/2646617097 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00c9b0 con 0x7f1bec0cdab0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec16aab0 con 0x7f1bec0cdab0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1be3fff700 1 -- 172.21.15.29:0/2646617097 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00cd50 con 0x7f1bec0cdab0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.877+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec144a70 con 0x7f1bec0cdab0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.878+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec089280 con 0x7f1bec0cdab0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.879+0000 7f1be3fff700 1 -- 172.21.15.29:0/2646617097 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bdc013680 con 0x7f1bec0cdab0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.879+0000 7f1be3fff700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1bcc066f30 0x7f1bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.879+0000 7f1be3fff700 1 -- 172.21.15.29:0/2646617097 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1bdc084440 con 0x7f1bec0cdab0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.879+0000 7f1bebfff700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1bcc066f30 0x7f1bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:08.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.880+0000 7f1bebfff700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1bcc066f30 0x7f1bcc0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009d10 tx=0x7f1bd40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:08.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:08.883+0000 7f1be3fff700 1 -- 172.21.15.29:0/2646617097 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bdc051a00 con 0x7f1bec0cdab0 2023-10-08T15:41:09.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.080+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bec0b3f60 con 0x7f1bec0cdab0 2023-10-08T15:41:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.080+0000 7f1be3fff700 1 -- 172.21.15.29:0/2646617097 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f1bdc055020 con 0x7f1bec0cdab0 2023-10-08T15:41:09.081 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:09.081 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:05.627706+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:09.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.082+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1bcc066f30 msgr2=0x7f1bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.082+0000 7f1bf1150700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1bcc066f30 0x7f1bcc0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009d10 tx=0x7f1bd40091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.082+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec0cdab0 msgr2=0x7f1bec169b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.082+0000 7f1bf1150700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec0cdab0 0x7f1bec169b60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00ec80 tx=0x7f1bdc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.083+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 shutdown_connections 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.083+0000 7f1bf1150700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1bcc066f30 0x7f1bcc0693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.083+0000 7f1bf1150700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec15dda0 0x7f1bec0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.083+0000 7f1bf1150700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0cd6e0 0x7f1bec144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.083+0000 7f1bf1150700 1 --2- 172.21.15.29:0/2646617097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bec0cdab0 0x7f1bec169b60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.083+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 >> 172.21.15.29:0/2646617097 conn(0x7f1bec067660 msgr2=0x7f1bec157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.083+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 shutdown_connections 2023-10-08T15:41:09.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.083+0000 7f1bf1150700 1 -- 172.21.15.29:0/2646617097 wait complete. 2023-10-08T15:41:09.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:41:09.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:41:09.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.217+0000 7f59c57df700 1 Processor -- start 2023-10-08T15:41:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.217+0000 7f59c57df700 1 -- start start 2023-10-08T15:41:09.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.217+0000 7f59c57df700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f59c015a290 0x7f59c006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59c57df700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c00b0790 con 0x7f59c0159ec0 2023-10-08T15:41:09.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59c57df700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c006af20 con 0x7f59c006aae0 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59c57df700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c00ce1f0 con 0x7f59c015a290 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59beffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f59c0159ec0 0x7f59c00af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55992/0 (socket says 172.21.15.29:55992) 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59beffd700 1 -- 172.21.15.29:0/2878143515 learned_addr learned my addr 172.21.15.29:0/2878143515 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198805455 0 0) 0x7f59c00b0790 con 0x7f59c0159ec0 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59be7fc700 1 --2- 172.21.15.29:0/2878143515 >> v2:172.21.15.183:3300/0 conn(0x7f59c015a290 0x7f59c006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ac003570 con 0x7f59c0159ec0 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2948345061 0 0) 0x7f59ac003570 con 0x7f59c0159ec0 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 >> v2:172.21.15.183:3300/0 conn(0x7f59c015a290 msgr2=0x7f59c006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 --2- 172.21.15.29:0/2878143515 >> v2:172.21.15.183:3300/0 conn(0x7f59c015a290 0x7f59c006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 >> v1:172.21.15.183:6789/0 conn(0x7f59c006aae0 legacy=0x7f59c00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00b0b20 con 0x7f59c0159ec0 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f59b8001470 con 0x7f59c0159ec0 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 >> v1:172.21.15.29:6789/0 conn(0x7f59c0159ec0 legacy=0x7f59c00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59ac003a60 0x7f59ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59ac004810 0x7f59ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00ce1f0 con 0x7f59ac0051c0 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac00c160 con 0x7f59ac004810 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac00c320 con 0x7f59ac003a60 2023-10-08T15:41:09.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59bf7fe700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.218+0000 7f59beffd700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59ac003a60 0x7f59ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59be7fc700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59ac004810 0x7f59ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bf7fe700 1 -- 172.21.15.29:0/2878143515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59ac003a60 msgr2=0x7f59ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bf7fe700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59ac003a60 0x7f59ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bf7fe700 1 -- 172.21.15.29:0/2878143515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59ac004810 msgr2=0x7f59ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bf7fe700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59ac004810 0x7f59ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bf7fe700 1 -- 172.21.15.29:0/2878143515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac003570 con 0x7f59ac0051c0 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bf7fe700 1 -- 172.21.15.29:0/2878143515 reap_dead start 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bf7fe700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59ac00ba60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f59b0001fc0 tx=0x7f59b0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fde37df2cdf50d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0001950 con 0x7f59ac0051c0 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000c8b0 con 0x7f59ac0051c0 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59bdffb700 1 -- 172.21.15.29:0/2878143515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000cc90 con 0x7f59ac0051c0 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59c57df700 1 -- 172.21.15.29:0/2878143515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 msgr2=0x7f59ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.219+0000 7f59c57df700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59ac00ba60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f59b0001fc0 tx=0x7f59b0001640 comp rx=0 tx=0).stop 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.220+0000 7f59c57df700 1 -- 172.21.15.29:0/2878143515 shutdown_connections 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.220+0000 7f59c57df700 1 --2- 172.21.15.29:0/2878143515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59ac00ba60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.220+0000 7f59c57df700 1 -- 172.21.15.29:0/2878143515 >> 172.21.15.29:0/2878143515 conn(0x7f59c00d1880 msgr2=0x7f59c00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.220+0000 7f59c57df700 1 -- 172.21.15.29:0/2878143515 shutdown_connections 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.220+0000 7f59c57df700 1 -- 172.21.15.29:0/2878143515 wait complete. 2023-10-08T15:41:09.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.221+0000 7f59c57df700 1 Processor -- start 2023-10-08T15:41:09.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.221+0000 7f59c57df700 1 -- start start 2023-10-08T15:41:09.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.221+0000 7f59c57df700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59c015b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.221+0000 7f59c57df700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c015d070 0x7f59c015d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59c57df700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c00cf490 0x7f59c00cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59c57df700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00cfe50 con 0x7f59ac0051c0 2023-10-08T15:41:09.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59c57df700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c016ae40 con 0x7f59c00cf490 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59c57df700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c015b8d0 con 0x7f59c015d070 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59c015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59c015b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57048/0 (socket says 172.21.15.29:57048) 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 -- 172.21.15.29:0/637299600 learned_addr learned my addr 172.21.15.29:0/637299600 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59be7fc700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c015d070 0x7f59c015d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59bf7fe700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c00cf490 0x7f59c00cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 -- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c015d070 msgr2=0x7f59c015d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c015d070 0x7f59c015d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 -- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c00cf490 msgr2=0x7f59c00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c00cf490 0x7f59c00cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 -- 172.21.15.29:0/637299600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c016a2c0 con 0x7f59ac0051c0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59beffd700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59c015b390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f59b80073c0 tx=0x7f59b8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59b6ffd700 1 -- 172.21.15.29:0/637299600 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8011590 con 0x7f59ac0051c0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59b6ffd700 1 -- 172.21.15.29:0/637299600 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b80116f0 con 0x7f59ac0051c0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c016a5a0 con 0x7f59ac0051c0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59b6ffd700 1 -- 172.21.15.29:0/637299600 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8011a90 con 0x7f59ac0051c0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.222+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c016ab60 con 0x7f59ac0051c0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.223+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c0167bb0 con 0x7f59ac0051c0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.224+0000 7f59b6ffd700 1 -- 172.21.15.29:0/637299600 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59b801e3b0 con 0x7f59ac0051c0 2023-10-08T15:41:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.224+0000 7f59b6ffd700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f59a0066f30 0x7f59a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.224+0000 7f59b6ffd700 1 -- 172.21.15.29:0/637299600 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f59b8083cc0 con 0x7f59ac0051c0 2023-10-08T15:41:09.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.224+0000 7f59be7fc700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f59a0066f30 0x7f59a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.225+0000 7f59be7fc700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f59a0066f30 0x7f59a00693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f59a8006f00 tx=0x7f59a80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.228+0000 7f59b6ffd700 1 -- 172.21.15.29:0/637299600 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59c0167bb0 con 0x7f59ac0051c0 2023-10-08T15:41:09.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.421+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59c0167bb0 con 0x7f59ac0051c0 2023-10-08T15:41:09.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.421+0000 7f59b6ffd700 1 -- 172.21.15.29:0/637299600 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59c0167bb0 con 0x7f59ac0051c0 2023-10-08T15:41:09.422 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:41:09.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f59a0066f30 msgr2=0x7f59a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f59a0066f30 0x7f59a00693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f59a8006f00 tx=0x7f59a80091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 msgr2=0x7f59c015b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59c015b390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f59b80073c0 tx=0x7f59b8001e50 comp rx=0 tx=0).stop 2023-10-08T15:41:09.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 shutdown_connections 2023-10-08T15:41:09.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f59a0066f30 0x7f59a00693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c00cf490 0x7f59c00cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ac0051c0 0x7f59c015b390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 --2- 172.21.15.29:0/637299600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c015d070 0x7f59c015d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 >> 172.21.15.29:0/637299600 conn(0x7f59c00d1880 msgr2=0x7f59c0157730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 shutdown_connections 2023-10-08T15:41:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.423+0000 7f59c57df700 1 -- 172.21.15.29:0/637299600 wait complete. 2023-10-08T15:41:09.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:41:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.554+0000 7f0a28912700 1 Processor -- start 2023-10-08T15:41:09.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.554+0000 7f0a28912700 1 -- start start 2023-10-08T15:41:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a28912700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0a2415cbd0 0x7f0a2415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a28912700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240cb7c0 con 0x7f0a240cd6e0 2023-10-08T15:41:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a28912700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2415e290 con 0x7f0a240cdab0 2023-10-08T15:41:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a28912700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2415e850 con 0x7f0a2415cbd0 2023-10-08T15:41:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a22d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0a240cd6e0 0x7f0a240cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55998/0 (socket says 172.21.15.29:55998) 2023-10-08T15:41:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a22d9d700 1 -- 172.21.15.29:0/1840874738 learned_addr learned my addr 172.21.15.29:0/1840874738 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a2359e700 1 --2- 172.21.15.29:0/1840874738 >> v2:172.21.15.183:3300/0 conn(0x7f0a2415cbd0 0x7f0a2415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a21d9b700 1 -- 172.21.15.29:0/1840874738 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989996978 0 0) 0x7f0a240cb7c0 con 0x7f0a240cd6e0 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a21d9b700 1 -- 172.21.15.29:0/1840874738 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a10003570 con 0x7f0a240cd6e0 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.555+0000 7f0a21d9b700 1 -- 172.21.15.29:0/1840874738 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3123336687 0 0) 0x7f0a10003570 con 0x7f0a240cd6e0 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a2359e700 1 -- 172.21.15.29:0/1840874738 >> v1:172.21.15.183:6789/0 conn(0x7f0a240cdab0 legacy=0x7f0a2415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a2359e700 1 -- 172.21.15.29:0/1840874738 >> v1:172.21.15.29:6789/0 conn(0x7f0a240cd6e0 legacy=0x7f0a240cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a2359e700 1 -- 172.21.15.29:0/1840874738 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2415e570 con 0x7f0a2415cbd0 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a2359e700 1 --2- 172.21.15.29:0/1840874738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 0x7f0a2415d050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0098e0 tx=0x7f0a1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c201bbc47798ea25 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a21d9b700 1 -- 172.21.15.29:0/1840874738 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a140017f0 con 0x7f0a2415cbd0 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a21d9b700 1 -- 172.21.15.29:0/1840874738 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c011420 con 0x7f0a2415cbd0 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a21d9b700 1 -- 172.21.15.29:0/1840874738 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0117c0 con 0x7f0a2415cbd0 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a28912700 1 -- 172.21.15.29:0/1840874738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 msgr2=0x7f0a2415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a28912700 1 --2- 172.21.15.29:0/1840874738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 0x7f0a2415d050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0098e0 tx=0x7f0a1c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a28912700 1 -- 172.21.15.29:0/1840874738 shutdown_connections 2023-10-08T15:41:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a28912700 1 --2- 172.21.15.29:0/1840874738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 0x7f0a2415d050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a28912700 1 -- 172.21.15.29:0/1840874738 >> 172.21.15.29:0/1840874738 conn(0x7f0a24067660 msgr2=0x7f0a24067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a28912700 1 -- 172.21.15.29:0/1840874738 shutdown_connections 2023-10-08T15:41:09.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.556+0000 7f0a28912700 1 -- 172.21.15.29:0/1840874738 wait complete. 2023-10-08T15:41:09.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.558+0000 7f0a28912700 1 Processor -- start 2023-10-08T15:41:09.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.558+0000 7f0a28912700 1 -- start start 2023-10-08T15:41:09.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.558+0000 7f0a28912700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a240cd6e0 0x7f0a240c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.558+0000 7f0a28912700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240cdab0 0x7f0a2415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.558+0000 7f0a28912700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 0x7f0a240b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.558+0000 7f0a28912700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240cc360 con 0x7f0a240cdab0 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.558+0000 7f0a28912700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2416ef20 con 0x7f0a2415cbd0 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.558+0000 7f0a28912700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241560d0 con 0x7f0a240cd6e0 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240cdab0 0x7f0a2415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240cdab0 0x7f0a2415bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57050/0 (socket says 172.21.15.29:57050) 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 -- 172.21.15.29:0/4184829016 learned_addr learned my addr 172.21.15.29:0/4184829016 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2359e700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 0x7f0a240b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a22d9d700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a240cd6e0 0x7f0a240c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 -- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a240cd6e0 msgr2=0x7f0a240c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a240cd6e0 0x7f0a240c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 -- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 msgr2=0x7f0a240b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 0x7f0a240b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 -- 172.21.15.29:0/4184829016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c009420 con 0x7f0a240cdab0 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a2259c700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240cdab0 0x7f0a2415bda0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00c590 tx=0x7f0a0c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a1affd700 1 -- 172.21.15.29:0/4184829016 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011590 con 0x7f0a240cdab0 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a1affd700 1 -- 172.21.15.29:0/4184829016 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c011710 con 0x7f0a240cdab0 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a240c8510 con 0x7f0a240cdab0 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a1affd700 1 -- 172.21.15.29:0/4184829016 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011ad0 con 0x7f0a240cdab0 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.559+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a240c7ec0 con 0x7f0a240cdab0 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.560+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a240c86a0 con 0x7f0a240cdab0 2023-10-08T15:41:09.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.561+0000 7f0a1affd700 1 -- 172.21.15.29:0/4184829016 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a0c01b3b0 con 0x7f0a240cdab0 2023-10-08T15:41:09.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.561+0000 7f0a1affd700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0a04066f30 0x7f0a040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.561+0000 7f0a1affd700 1 -- 172.21.15.29:0/4184829016 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0a0c0835f0 con 0x7f0a240cdab0 2023-10-08T15:41:09.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.561+0000 7f0a22d9d700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0a04066f30 0x7f0a040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.562+0000 7f0a22d9d700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0a04066f30 0x7f0a040693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a14001560 tx=0x7f0a14000f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.565+0000 7f0a1affd700 1 -- 172.21.15.29:0/4184829016 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a0c050bb0 con 0x7f0a240cdab0 2023-10-08T15:41:09.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.759+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0a2404bb80 con 0x7f0a240cdab0 2023-10-08T15:41:09.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.759+0000 7f0a1affd700 1 -- 172.21.15.29:0/4184829016 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0a0c017020 con 0x7f0a240cdab0 2023-10-08T15:41:09.760 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:09.760 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-08T15:41:09.760 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:09.760 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-08T15:41:09.760 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-08T15:41:09.761 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:09.761 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-08T15:41:09.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0a04066f30 msgr2=0x7f0a040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0a04066f30 0x7f0a040693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a14001560 tx=0x7f0a14000f40 comp rx=0 tx=0).stop 2023-10-08T15:41:09.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240cdab0 msgr2=0x7f0a2415bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240cdab0 0x7f0a2415bda0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00c590 tx=0x7f0a0c00c8a0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 shutdown_connections 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0a04066f30 0x7f0a040693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a2415cbd0 0x7f0a240b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a240cd6e0 0x7f0a240c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 --2- 172.21.15.29:0/4184829016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240cdab0 0x7f0a2415bda0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 >> 172.21.15.29:0/4184829016 conn(0x7f0a24067660 msgr2=0x7f0a240d1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 shutdown_connections 2023-10-08T15:41:09.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.761+0000 7f0a28912700 1 -- 172.21.15.29:0/4184829016 wait complete. 2023-10-08T15:41:09.774 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:41:09.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:41:09.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.896+0000 7feea904f700 1 Processor -- start 2023-10-08T15:41:09.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.896+0000 7feea904f700 1 -- start start 2023-10-08T15:41:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea904f700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feea40c9240 0x7feea406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea904f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feea406fa90 0x7feea415a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea904f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40cae00 con 0x7feea40cc180 2023-10-08T15:41:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea904f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40cb0e0 con 0x7feea406fa90 2023-10-08T15:41:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea904f700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40cb3c0 con 0x7feea40c9240 2023-10-08T15:41:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feea406fa90 0x7feea415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feea406fa90 0x7feea415a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57054/0 (socket says 172.21.15.29:57054) 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea359e700 1 -- 172.21.15.29:0/2719371605 learned_addr learned my addr 172.21.15.29:0/2719371605 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea2d9d700 1 --2- 172.21.15.29:0/2719371605 >> v2:172.21.15.183:3300/0 conn(0x7feea40c9240 0x7feea406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea359e700 1 -- 172.21.15.29:0/2719371605 >> v2:172.21.15.183:3300/0 conn(0x7feea40c9240 msgr2=0x7feea406f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea359e700 1 --2- 172.21.15.29:0/2719371605 >> v2:172.21.15.183:3300/0 conn(0x7feea40c9240 0x7feea406f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.897+0000 7feea359e700 1 -- 172.21.15.29:0/2719371605 >> v1:172.21.15.183:6789/0 conn(0x7feea40cc180 legacy=0x7feea4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea359e700 1 -- 172.21.15.29:0/2719371605 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40cb6a0 con 0x7feea406fa90 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea359e700 1 --2- 172.21.15.29:0/2719371605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea406fa90 0x7feea415a010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fee940099b0 tx=0x7fee94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adf920e0c5eb58 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea1d9b700 1 -- 172.21.15.29:0/2719371605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400b7e0 con 0x7feea406fa90 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea1d9b700 1 -- 172.21.15.29:0/2719371605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9400b940 con 0x7feea406fa90 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea1d9b700 1 -- 172.21.15.29:0/2719371605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400bce0 con 0x7feea406fa90 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea904f700 1 -- 172.21.15.29:0/2719371605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea406fa90 msgr2=0x7feea415a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea904f700 1 --2- 172.21.15.29:0/2719371605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea406fa90 0x7feea415a010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fee940099b0 tx=0x7fee94009250 comp rx=0 tx=0).stop 2023-10-08T15:41:09.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea904f700 1 -- 172.21.15.29:0/2719371605 shutdown_connections 2023-10-08T15:41:09.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea904f700 1 --2- 172.21.15.29:0/2719371605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea406fa90 0x7feea415a010 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea904f700 1 --2- 172.21.15.29:0/2719371605 >> v2:172.21.15.183:3300/0 conn(0x7feea40c9240 0x7feea406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea904f700 1 -- 172.21.15.29:0/2719371605 >> 172.21.15.29:0/2719371605 conn(0x7feea4068130 msgr2=0x7feea40cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:09.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea904f700 1 -- 172.21.15.29:0/2719371605 shutdown_connections 2023-10-08T15:41:09.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.898+0000 7feea904f700 1 -- 172.21.15.29:0/2719371605 wait complete. 2023-10-08T15:41:09.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea904f700 1 Processor -- start 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea904f700 1 -- start start 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea904f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea406fa90 0x7feea415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea904f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea40c9240 0x7feea415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea904f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea40cc180 0x7feea416ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea904f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea4145b90 con 0x7feea40c9240 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea904f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea415cf10 con 0x7feea40cc180 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea904f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea415c900 con 0x7feea406fa90 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.900+0000 7feea259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea40c9240 0x7feea415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea40c9240 0x7feea415a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57068/0 (socket says 172.21.15.29:57068) 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea259c700 1 -- 172.21.15.29:0/3857153194 learned_addr learned my addr 172.21.15.29:0/3857153194 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea359e700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea40cc180 0x7feea416ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea259c700 1 -- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea406fa90 msgr2=0x7feea415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea2d9d700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea406fa90 0x7feea415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea259c700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea406fa90 0x7feea415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea259c700 1 -- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea40cc180 msgr2=0x7feea416ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea259c700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea40cc180 0x7feea416ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea259c700 1 -- 172.21.15.29:0/3857153194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee940094f0 con 0x7feea40c9240 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea259c700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea40c9240 0x7feea415a570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00b5e0 tx=0x7fee8c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7fee9affd700 1 -- 172.21.15.29:0/3857153194 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00f510 con 0x7feea40c9240 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7fee9affd700 1 -- 172.21.15.29:0/3857153194 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00f6b0 con 0x7feea40c9240 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea415aee0 con 0x7feea40c9240 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7fee9affd700 1 -- 172.21.15.29:0/3857153194 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00fa70 con 0x7feea40c9240 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.901+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea415b1c0 con 0x7feea40c9240 2023-10-08T15:41:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.902+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea415c760 con 0x7feea40c9240 2023-10-08T15:41:09.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.902+0000 7fee9affd700 1 -- 172.21.15.29:0/3857153194 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee8c01a400 con 0x7feea40c9240 2023-10-08T15:41:09.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.903+0000 7fee9affd700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee84066f30 0x7fee840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:09.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.903+0000 7fee9affd700 1 -- 172.21.15.29:0/3857153194 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fee8c083d00 con 0x7feea40c9240 2023-10-08T15:41:09.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.903+0000 7feea2d9d700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee84066f30 0x7fee840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:09.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.904+0000 7feea2d9d700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee84066f30 0x7fee840693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee9c007460 tx=0x7fee9c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:09.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:09.907+0000 7fee9affd700 1 -- 172.21.15.29:0/3857153194 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea415c760 con 0x7feea40c9240 2023-10-08T15:41:10.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.103+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feea415c760 con 0x7feea40c9240 2023-10-08T15:41:10.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.632+0000 7fee9affd700 1 -- 172.21.15.29:0/3857153194 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7feea415c760 con 0x7feea40c9240 2023-10-08T15:41:10.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.635+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee84066f30 msgr2=0x7fee840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.635+0000 7feea904f700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee84066f30 0x7fee840693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee9c007460 tx=0x7fee9c00b040 comp rx=0 tx=0).stop 2023-10-08T15:41:10.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.635+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea40c9240 msgr2=0x7feea415a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.635+0000 7feea904f700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea40c9240 0x7feea415a570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00b5e0 tx=0x7fee8c0090f0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.636+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 shutdown_connections 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.636+0000 7feea904f700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee84066f30 0x7fee840693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.636+0000 7feea904f700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feea40cc180 0x7feea416ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.636+0000 7feea904f700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feea406fa90 0x7feea415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.636+0000 7feea904f700 1 --2- 172.21.15.29:0/3857153194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feea40c9240 0x7feea415a570 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.636+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 >> 172.21.15.29:0/3857153194 conn(0x7feea4068130 msgr2=0x7feea40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.636+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 shutdown_connections 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.636+0000 7feea904f700 1 -- 172.21.15.29:0/3857153194 wait complete. 2023-10-08T15:41:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-08T15:41:10.650 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:41:10.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.779+0000 7f17f8ba2700 1 Processor -- start 2023-10-08T15:41:10.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.779+0000 7f17f8ba2700 1 -- start start 2023-10-08T15:41:10.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.779+0000 7f17f8ba2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17f4068fc0 0x7f17f40adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f8ba2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f17f4067c80 0x7f17f4159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f8ba2700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f40ae000 con 0x7f17f40678b0 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f8ba2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f40c94a0 con 0x7f17f4068fc0 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f8ba2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f40ae230 con 0x7f17f4067c80 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f1d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17f4068fc0 0x7f17f40adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f1d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17f4068fc0 0x7f17f40adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57076/0 (socket says 172.21.15.29:57076) 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f1d9b700 1 -- 172.21.15.29:0/2979424069 learned_addr learned my addr 172.21.15.29:0/2979424069 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f2d9d700 1 --2- 172.21.15.29:0/2979424069 >> v2:172.21.15.183:3300/0 conn(0x7f17f4067c80 0x7f17f4159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f1d9b700 1 -- 172.21.15.29:0/2979424069 >> v2:172.21.15.183:3300/0 conn(0x7f17f4067c80 msgr2=0x7f17f4159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f1d9b700 1 --2- 172.21.15.29:0/2979424069 >> v2:172.21.15.183:3300/0 conn(0x7f17f4067c80 0x7f17f4159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f1d9b700 1 -- 172.21.15.29:0/2979424069 >> v1:172.21.15.183:6789/0 conn(0x7f17f40678b0 legacy=0x7f17f41597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:10.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f1d9b700 1 -- 172.21.15.29:0/2979424069 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f40cb480 con 0x7f17f4068fc0 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f1d9b700 1 --2- 172.21.15.29:0/2979424069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f4068fc0 0x7f17f40adac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f17f4068cc0 tx=0x7f17dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498077f9fc8afb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f159a700 1 -- 172.21.15.29:0/2979424069 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00b820 con 0x7f17f4068fc0 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f159a700 1 -- 172.21.15.29:0/2979424069 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00b980 con 0x7f17f4068fc0 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.780+0000 7f17f159a700 1 -- 172.21.15.29:0/2979424069 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00bd20 con 0x7f17f4068fc0 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.781+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2979424069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f4068fc0 msgr2=0x7f17f40adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.781+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2979424069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f4068fc0 0x7f17f40adac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f17f4068cc0 tx=0x7f17dc009250 comp rx=0 tx=0).stop 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.781+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2979424069 shutdown_connections 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.781+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2979424069 >> v2:172.21.15.183:3300/0 conn(0x7f17f4067c80 0x7f17f4159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.781+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2979424069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f4068fc0 0x7f17f40adac0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.781+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2979424069 >> 172.21.15.29:0/2979424069 conn(0x7f17f4069870 msgr2=0x7f17f4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:10.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.781+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2979424069 shutdown_connections 2023-10-08T15:41:10.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.781+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2979424069 wait complete. 2023-10-08T15:41:10.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.782+0000 7f17f8ba2700 1 Processor -- start 2023-10-08T15:41:10.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.782+0000 7f17f8ba2700 1 -- start start 2023-10-08T15:41:10.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f8ba2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f40678b0 0x7f17f40c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f8ba2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17f4067c80 0x7f17f40c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f8ba2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f4068fc0 0x7f17f416a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f8ba2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40c5780 con 0x7f17f40678b0 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f8ba2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40ab240 con 0x7f17f4068fc0 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f8ba2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f40ad210 con 0x7f17f4067c80 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f40678b0 0x7f17f40c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f40678b0 0x7f17f40c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57078/0 (socket says 172.21.15.29:57078) 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f259c700 1 -- 172.21.15.29:0/2793282170 learned_addr learned my addr 172.21.15.29:0/2793282170 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f2d9d700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f4068fc0 0x7f17f416a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f1d9b700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17f4067c80 0x7f17f40c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f259c700 1 -- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17f4067c80 msgr2=0x7f17f40c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f259c700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17f4067c80 0x7f17f40c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f259c700 1 -- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f4068fc0 msgr2=0x7f17f416a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f259c700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f4068fc0 0x7f17f416a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:10.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f259c700 1 -- 172.21.15.29:0/2793282170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0094f0 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.783+0000 7f17f1d9b700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17f4067c80 0x7f17f40c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.784+0000 7f17f259c700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f40678b0 0x7f17f40c5240 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c950 tx=0x7f17e4002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.784+0000 7f17ea7fc700 1 -- 172.21.15.29:0/2793282170 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4012630 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.784+0000 7f17ea7fc700 1 -- 172.21.15.29:0/2793282170 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4012790 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.784+0000 7f17ea7fc700 1 -- 172.21.15.29:0/2793282170 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4012b50 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.784+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f40ad4f0 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.784+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f40ab4e0 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.785+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f40ab6d0 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.785+0000 7f17ea7fc700 1 -- 172.21.15.29:0/2793282170 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17e400a420 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.786+0000 7f17ea7fc700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f17d4066f30 0x7f17d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.786+0000 7f17ea7fc700 1 -- 172.21.15.29:0/2793282170 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f17e40847d0 con 0x7f17f40678b0 2023-10-08T15:41:10.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.786+0000 7f17f1d9b700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f17d4066f30 0x7f17d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:10.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.786+0000 7f17f1d9b700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f17d4066f30 0x7f17d40693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17f4068cc0 tx=0x7f17dc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:10.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.790+0000 7f17ea7fc700 1 -- 172.21.15.29:0/2793282170 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17e4051c20 con 0x7f17f40678b0 2023-10-08T15:41:10.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:10.984+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f17f404c3c0 con 0x7f17f40678b0 2023-10-08T15:41:11.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.634+0000 7f17ea7fc700 1 -- 172.21.15.29:0/2793282170 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f17e4055240 con 0x7f17f40678b0 2023-10-08T15:41:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.640+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f17d4066f30 msgr2=0x7f17d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.640 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.640+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f17d4066f30 0x7f17d40693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17f4068cc0 tx=0x7f17dc016000 comp rx=0 tx=0).stop 2023-10-08T15:41:11.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.640+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f40678b0 msgr2=0x7f17f40c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.640+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f40678b0 0x7f17f40c5240 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c950 tx=0x7f17e4002760 comp rx=0 tx=0).stop 2023-10-08T15:41:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.643+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 shutdown_connections 2023-10-08T15:41:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.643+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f17d4066f30 0x7f17d40693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.643+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17f4068fc0 0x7f17f416a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.643+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17f40678b0 0x7f17f40c5240 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.643+0000 7f17f8ba2700 1 --2- 172.21.15.29:0/2793282170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17f4067c80 0x7f17f40c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.643+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 >> 172.21.15.29:0/2793282170 conn(0x7f17f4069870 msgr2=0x7f17f40af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.644+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 shutdown_connections 2023-10-08T15:41:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.644+0000 7f17f8ba2700 1 -- 172.21.15.29:0/2793282170 wait complete. 2023-10-08T15:41:11.645 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-08T15:41:11.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:41:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.783+0000 7fe516c4d700 1 Processor -- start 2023-10-08T15:41:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.783+0000 7fe516c4d700 1 -- start start 2023-10-08T15:41:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe516c4d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe516c4d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5100b4c30 0x7fe510159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe516c4d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5100b14f0 con 0x7fe510159fd0 2023-10-08T15:41:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe516c4d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5100b17d0 con 0x7fe5100b4c30 2023-10-08T15:41:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe516c4d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100b1ab0 con 0x7fe5100b4860 2023-10-08T15:41:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe50ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5100b4c30 0x7fe510159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe5151ea700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe510159fd0 0x7fe5100cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56002/0 (socket says 172.21.15.29:56002) 2023-10-08T15:41:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe5151ea700 1 -- 172.21.15.29:0/1722021028 learned_addr learned my addr 172.21.15.29:0/1722021028 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.784+0000 7fe50ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5100b4c30 0x7fe510159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57086/0 (socket says 172.21.15.29:57086) 2023-10-08T15:41:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe5149e9700 1 --2- 172.21.15.29:0/1722021028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50ffff700 1 -- 172.21.15.29:0/1722021028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 msgr2=0x7fe5100b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50ffff700 1 --2- 172.21.15.29:0/1722021028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50ffff700 1 -- 172.21.15.29:0/1722021028 >> v1:172.21.15.29:6789/0 conn(0x7fe510159fd0 legacy=0x7fe5100cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50ffff700 1 -- 172.21.15.29:0/1722021028 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100b1d90 con 0x7fe5100b4c30 2023-10-08T15:41:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50f7fe700 1 -- 172.21.15.29:0/1722021028 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432855657 0 0) 0x7fe5100b14f0 con 0x7fe510159fd0 2023-10-08T15:41:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe5149e9700 1 --2- 172.21.15.29:0/1722021028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50ffff700 1 --2- 172.21.15.29:0/1722021028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5100b4c30 0x7fe510159a90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe500009e60 tx=0x7fe500009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a1042cb9af9c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50f7fe700 1 -- 172.21.15.29:0/1722021028 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000e070 con 0x7fe5100b4c30 2023-10-08T15:41:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50f7fe700 1 -- 172.21.15.29:0/1722021028 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50000bcc0 con 0x7fe5100b4c30 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe50f7fe700 1 -- 172.21.15.29:0/1722021028 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500012680 con 0x7fe5100b4c30 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe516c4d700 1 -- 172.21.15.29:0/1722021028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5100b4c30 msgr2=0x7fe510159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe516c4d700 1 --2- 172.21.15.29:0/1722021028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5100b4c30 0x7fe510159a90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe500009e60 tx=0x7fe500009780 comp rx=0 tx=0).stop 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe516c4d700 1 -- 172.21.15.29:0/1722021028 shutdown_connections 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe516c4d700 1 --2- 172.21.15.29:0/1722021028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe516c4d700 1 --2- 172.21.15.29:0/1722021028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5100b4c30 0x7fe510159a90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.785+0000 7fe516c4d700 1 -- 172.21.15.29:0/1722021028 >> 172.21.15.29:0/1722021028 conn(0x7fe51009a0f0 msgr2=0x7fe510067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.786+0000 7fe516c4d700 1 -- 172.21.15.29:0/1722021028 shutdown_connections 2023-10-08T15:41:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.786+0000 7fe516c4d700 1 -- 172.21.15.29:0/1722021028 wait complete. 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.787+0000 7fe516c4d700 1 Processor -- start 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.787+0000 7fe516c4d700 1 -- start start 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.787+0000 7fe516c4d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.787+0000 7fe516c4d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5100b4c30 0x7fe51015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.787+0000 7fe516c4d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe510159fd0 0x7fe51015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.787+0000 7fe516c4d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100ac790 con 0x7fe510159fd0 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.787+0000 7fe516c4d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51016a890 con 0x7fe5100b4c30 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.787+0000 7fe516c4d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100abe60 con 0x7fe5100b4860 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe510159fd0 0x7fe51015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe510159fd0 0x7fe51015c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57096/0 (socket says 172.21.15.29:57096) 2023-10-08T15:41:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 -- 172.21.15.29:0/2956878387 learned_addr learned my addr 172.21.15.29:0/2956878387 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5149e9700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe50ffff700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5100b4c30 0x7fe51015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 -- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 msgr2=0x7fe5100af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 -- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5100b4c30 msgr2=0x7fe51015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5100b4c30 0x7fe51015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 -- 172.21.15.29:0/2956878387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe500009a20 con 0x7fe510159fd0 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe50ffff700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5100b4c30 0x7fe51015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe5151ea700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe510159fd0 0x7fe51015c5f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800c4f0 tx=0x7fe4f8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe50cff9700 1 -- 172.21.15.29:0/2956878387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8005b30 con 0x7fe510159fd0 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe50cff9700 1 -- 172.21.15.29:0/2956878387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8005cb0 con 0x7fe510159fd0 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe50cff9700 1 -- 172.21.15.29:0/2956878387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8007320 con 0x7fe510159fd0 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5100ac140 con 0x7fe510159fd0 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.788+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5100acc20 con 0x7fe510159fd0 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.789+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5100ac900 con 0x7fe510159fd0 2023-10-08T15:41:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.790+0000 7fe50cff9700 1 -- 172.21.15.29:0/2956878387 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4f801b3b0 con 0x7fe510159fd0 2023-10-08T15:41:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.790+0000 7fe50cff9700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe4f0066f30 0x7fe4f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.790+0000 7fe50cff9700 1 -- 172.21.15.29:0/2956878387 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fe4f8083a30 con 0x7fe510159fd0 2023-10-08T15:41:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.790+0000 7fe5149e9700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe4f0066f30 0x7fe4f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.791+0000 7fe5149e9700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe4f0066f30 0x7fe4f00693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe50800ab80 tx=0x7fe508008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:11.795+0000 7fe50cff9700 1 -- 172.21.15.29:0/2956878387 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4f8050c60 con 0x7fe510159fd0 2023-10-08T15:41:12.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.037+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe51016aa00 con 0x7fe510159fd0 2023-10-08T15:41:12.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.663+0000 7fe50cff9700 1 -- 172.21.15.29:0/2956878387 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe51016aa00 con 0x7fe510159fd0 2023-10-08T15:41:12.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe4f0066f30 msgr2=0x7fe4f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe4f0066f30 0x7fe4f00693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe50800ab80 tx=0x7fe508008040 comp rx=0 tx=0).stop 2023-10-08T15:41:12.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe510159fd0 msgr2=0x7fe51015c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe510159fd0 0x7fe51015c5f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800c4f0 tx=0x7fe4f8007f50 comp rx=0 tx=0).stop 2023-10-08T15:41:12.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 shutdown_connections 2023-10-08T15:41:12.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe4f0066f30 0x7fe4f00693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe510159fd0 0x7fe51015c5f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5100b4860 0x7fe5100af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 --2- 172.21.15.29:0/2956878387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5100b4c30 0x7fe51015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.668+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 >> 172.21.15.29:0/2956878387 conn(0x7fe51009a0f0 msgr2=0x7fe510158110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:12.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.669+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 shutdown_connections 2023-10-08T15:41:12.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.669+0000 7fe516c4d700 1 -- 172.21.15.29:0/2956878387 wait complete. 2023-10-08T15:41:12.672 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T15:41:12.684 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:12.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.805+0000 7efd5579f700 1 Processor -- start 2023-10-08T15:41:12.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.805+0000 7efd5579f700 1 -- start start 2023-10-08T15:41:12.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.806+0000 7efd5579f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efd501569a0 0x7efd500c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.806+0000 7efd5579f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5006efe0 con 0x7efd5006e7c0 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.806+0000 7efd5579f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5006ed00 con 0x7efd5006a0e0 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.806+0000 7efd5579f700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd500c81c0 con 0x7efd501569a0 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.806+0000 7efd4effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efd501569a0 0x7efd500c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.806+0000 7efd4f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efd5006e7c0 0x7efd50067870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56018/0 (socket says 172.21.15.29:56018) 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.806+0000 7efd4f7fe700 1 -- 172.21.15.29:0/147484292 learned_addr learned my addr 172.21.15.29:0/147484292 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd4effd700 1 -- 172.21.15.29:0/147484292 >> v1:172.21.15.183:6789/0 conn(0x7efd5006a0e0 legacy=0x7efd5006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd4effd700 1 -- 172.21.15.29:0/147484292 >> v1:172.21.15.29:6789/0 conn(0x7efd5006e7c0 legacy=0x7efd50067870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd4effd700 1 -- 172.21.15.29:0/147484292 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500c84a0 con 0x7efd501569a0 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd4dffb700 1 -- 172.21.15.29:0/147484292 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078835457 0 0) 0x7efd5006efe0 con 0x7efd5006e7c0 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd4effd700 1 --2- 172.21.15.29:0/147484292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd501569a0 0x7efd500c8ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efd480098e0 tx=0x7efd480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa551d20ca8dc28 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd4dffb700 1 -- 172.21.15.29:0/147484292 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48009e80 con 0x7efd501569a0 2023-10-08T15:41:12.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd4dffb700 1 -- 172.21.15.29:0/147484292 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4800b860 con 0x7efd501569a0 2023-10-08T15:41:12.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd4dffb700 1 -- 172.21.15.29:0/147484292 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4800bbe0 con 0x7efd501569a0 2023-10-08T15:41:12.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd5579f700 1 -- 172.21.15.29:0/147484292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd501569a0 msgr2=0x7efd500c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd5579f700 1 --2- 172.21.15.29:0/147484292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd501569a0 0x7efd500c8ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efd480098e0 tx=0x7efd480091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd5579f700 1 -- 172.21.15.29:0/147484292 shutdown_connections 2023-10-08T15:41:12.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.807+0000 7efd5579f700 1 --2- 172.21.15.29:0/147484292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd501569a0 0x7efd500c8ca0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.808+0000 7efd5579f700 1 -- 172.21.15.29:0/147484292 >> 172.21.15.29:0/147484292 conn(0x7efd500cd8d0 msgr2=0x7efd500cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:12.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.808+0000 7efd5579f700 1 -- 172.21.15.29:0/147484292 shutdown_connections 2023-10-08T15:41:12.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.808+0000 7efd5579f700 1 -- 172.21.15.29:0/147484292 wait complete. 2023-10-08T15:41:12.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.809+0000 7efd5579f700 1 Processor -- start 2023-10-08T15:41:12.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.809+0000 7efd5579f700 1 -- start start 2023-10-08T15:41:12.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd5579f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5006a0e0 0x7efd500c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd5579f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd5006e7c0 0x7efd50167d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd5579f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd501569a0 0x7efd500b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd5579f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd500c36f0 con 0x7efd5006a0e0 2023-10-08T15:41:12.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd5579f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd500c39d0 con 0x7efd501569a0 2023-10-08T15:41:12.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd5579f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd500c3cb0 con 0x7efd5006e7c0 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5006a0e0 0x7efd500c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5006a0e0 0x7efd500c2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57122/0 (socket says 172.21.15.29:57122) 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 -- 172.21.15.29:0/3096101122 learned_addr learned my addr 172.21.15.29:0/3096101122 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4f7fe700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd501569a0 0x7efd500b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4e7fc700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd5006e7c0 0x7efd50167d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 -- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd5006e7c0 msgr2=0x7efd50167d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd5006e7c0 0x7efd50167d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 -- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd501569a0 msgr2=0x7efd500b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd501569a0 0x7efd500b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 -- 172.21.15.29:0/3096101122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48009420 con 0x7efd5006a0e0 2023-10-08T15:41:12.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd4effd700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5006a0e0 0x7efd500c2d20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efd500ce430 tx=0x7efd48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd46ffd700 1 -- 172.21.15.29:0/3096101122 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4801f070 con 0x7efd5006a0e0 2023-10-08T15:41:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd46ffd700 1 -- 172.21.15.29:0/3096101122 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd48000c90 con 0x7efd5006a0e0 2023-10-08T15:41:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd500c3f90 con 0x7efd5006a0e0 2023-10-08T15:41:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd46ffd700 1 -- 172.21.15.29:0/3096101122 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48025420 con 0x7efd5006a0e0 2023-10-08T15:41:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.810+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd500c7520 con 0x7efd5006a0e0 2023-10-08T15:41:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.811+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5006d5d0 con 0x7efd5006a0e0 2023-10-08T15:41:12.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.812+0000 7efd46ffd700 1 -- 172.21.15.29:0/3096101122 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd48023070 con 0x7efd5006a0e0 2023-10-08T15:41:12.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.812+0000 7efd46ffd700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd30066f30 0x7efd300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:12.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.812+0000 7efd46ffd700 1 -- 172.21.15.29:0/3096101122 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd48085970 con 0x7efd5006a0e0 2023-10-08T15:41:12.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.812+0000 7efd4e7fc700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd30066f30 0x7efd300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:12.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.813+0000 7efd4e7fc700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd30066f30 0x7efd300693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd500cc490 tx=0x7efd38007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:12.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:12.817+0000 7efd46ffd700 1 -- 172.21.15.29:0/3096101122 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd48052be0 con 0x7efd5006a0e0 2023-10-08T15:41:13.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.011+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd5004bb80 con 0x7efd5006a0e0 2023-10-08T15:41:13.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.011+0000 7efd46ffd700 1 -- 172.21.15.29:0/3096101122 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15363 (secure 0 0 0) 0x7efd48015090 con 0x7efd5006a0e0 2023-10-08T15:41:13.012 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:13.012 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:12.038931+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:10.133425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:11.014819+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:13.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd30066f30 msgr2=0x7efd300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd30066f30 0x7efd300693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd500cc490 tx=0x7efd38007ec0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5006a0e0 msgr2=0x7efd500c2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5006a0e0 0x7efd500c2d20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efd500ce430 tx=0x7efd48017000 comp rx=0 tx=0).stop 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 shutdown_connections 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efd30066f30 0x7efd300693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd501569a0 0x7efd500b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd5006a0e0 0x7efd500c2d20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 --2- 172.21.15.29:0/3096101122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd5006e7c0 0x7efd50167d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.013+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 >> 172.21.15.29:0/3096101122 conn(0x7efd500cd8d0 msgr2=0x7efd5006e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.014+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 shutdown_connections 2023-10-08T15:41:13.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.014+0000 7efd5579f700 1 -- 172.21.15.29:0/3096101122 wait complete. 2023-10-08T15:41:13.026 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:13.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.144+0000 7f3fbf39c700 1 Processor -- start 2023-10-08T15:41:13.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.144+0000 7f3fbf39c700 1 -- start start 2023-10-08T15:41:13.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.145+0000 7f3fbf39c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.145+0000 7f3fbf39c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fb80c87a0 0x7f3fb806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.145+0000 7f3fbf39c700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb8067ba0 con 0x7f3fb80ad9b0 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.145+0000 7f3fbf39c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb815aa90 con 0x7f3fb80c87a0 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.145+0000 7f3fbf39c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8067870 con 0x7f3fb81568d0 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.145+0000 7f3fbd939700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fb80c87a0 0x7f3fb806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.145+0000 7f3fbd939700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fb80c87a0 0x7f3fb806a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57126/0 (socket says 172.21.15.29:57126) 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fbd939700 1 -- 172.21.15.29:0/2552997060 learned_addr learned my addr 172.21.15.29:0/2552997060 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fbd138700 1 --2- 172.21.15.29:0/2552997060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fb7fff700 1 -- 172.21.15.29:0/2552997060 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110345099 0 0) 0x7f3fb8067ba0 con 0x7f3fb80ad9b0 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fbd939700 1 -- 172.21.15.29:0/2552997060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 msgr2=0x7f3fb8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fbd939700 1 --2- 172.21.15.29:0/2552997060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fbd939700 1 -- 172.21.15.29:0/2552997060 >> v1:172.21.15.183:6789/0 conn(0x7f3fb80ad9b0 legacy=0x7f3fb80c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fbd939700 1 -- 172.21.15.29:0/2552997060 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80c8ca0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fbd138700 1 --2- 172.21.15.29:0/2552997060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fbd939700 1 --2- 172.21.15.29:0/2552997060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb806a360 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009f20 tx=0x7f3fa8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf23d4de964c76b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fb7fff700 1 -- 172.21.15.29:0/2552997060 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800e070 con 0x7f3fb80c87a0 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fb7fff700 1 -- 172.21.15.29:0/2552997060 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa800b9d0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.146+0000 7f3fb7fff700 1 -- 172.21.15.29:0/2552997060 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80092e0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.147+0000 7f3fbf39c700 1 -- 172.21.15.29:0/2552997060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 msgr2=0x7f3fb806a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.147+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/2552997060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb806a360 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009f20 tx=0x7f3fa8009840 comp rx=0 tx=0).stop 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.147+0000 7f3fbf39c700 1 -- 172.21.15.29:0/2552997060 shutdown_connections 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.147+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/2552997060 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb806a360 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.147+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/2552997060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.147+0000 7f3fbf39c700 1 -- 172.21.15.29:0/2552997060 >> 172.21.15.29:0/2552997060 conn(0x7f3fb80cda50 msgr2=0x7f3fb80cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:13.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.147+0000 7f3fbf39c700 1 -- 172.21.15.29:0/2552997060 shutdown_connections 2023-10-08T15:41:13.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.147+0000 7f3fbf39c700 1 -- 172.21.15.29:0/2552997060 wait complete. 2023-10-08T15:41:13.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.148+0000 7f3fbf39c700 1 Processor -- start 2023-10-08T15:41:13.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.148+0000 7f3fbf39c700 1 -- start start 2023-10-08T15:41:13.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbf39c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fb80ad9b0 0x7f3fb80c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbf39c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb81697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbf39c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb80af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbf39c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80b01c0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbf39c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8169360 con 0x7f3fb80ad9b0 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbf39c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80c4490 con 0x7f3fb81568d0 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb81697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb81697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57142/0 (socket says 172.21.15.29:57142) 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 -- 172.21.15.29:0/3281826081 learned_addr learned my addr 172.21.15.29:0/3281826081 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbd939700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb80af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbd138700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fb80ad9b0 0x7f3fb80c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 -- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 msgr2=0x7f3fb80af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb80af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 -- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fb80ad9b0 msgr2=0x7f3fb80c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fb80ad9b0 0x7f3fb80c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 -- 172.21.15.29:0/3281826081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0009420 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fbc937700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb81697f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00c590 tx=0x7f3fac007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fb57fa700 1 -- 172.21.15.29:0/3281826081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac011590 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.149+0000 7f3fb57fa700 1 -- 172.21.15.29:0/3281826081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac011710 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.150+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa8009ae0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.150+0000 7f3fb57fa700 1 -- 172.21.15.29:0/3281826081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac011ad0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.150+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb80afee0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.150+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb804c3c0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.151+0000 7f3fb57fa700 1 -- 172.21.15.29:0/3281826081 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fac01b3b0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.151+0000 7f3fb57fa700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3fa4066f30 0x7f3fa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.152+0000 7f3fb57fa700 1 -- 172.21.15.29:0/3281826081 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fac0838a0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.152+0000 7f3fbd138700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3fa4066f30 0x7f3fa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.152+0000 7f3fbd138700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3fa4066f30 0x7f3fa40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009f40 tx=0x7f3fb00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:13.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.156+0000 7f3fb57fa700 1 -- 172.21.15.29:0/3281826081 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fac050b10 con 0x7f3fb80c87a0 2023-10-08T15:41:13.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.351+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fb81694a0 con 0x7f3fb80c87a0 2023-10-08T15:41:13.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.352+0000 7f3fb57fa700 1 -- 172.21.15.29:0/3281826081 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f3fac017070 con 0x7f3fb80c87a0 2023-10-08T15:41:13.352 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:13.353 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":30,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:12.038931+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:10.133425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:11.014819+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3fa4066f30 msgr2=0x7f3fa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3fa4066f30 0x7f3fa40693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009f40 tx=0x7f3fb00091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 msgr2=0x7f3fb81697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb81697f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00c590 tx=0x7f3fac007f50 comp rx=0 tx=0).stop 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 shutdown_connections 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3fa4066f30 0x7f3fa40693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fb81568d0 0x7f3fb80af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fb80ad9b0 0x7f3fb80c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 --2- 172.21.15.29:0/3281826081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb80c87a0 0x7f3fb81697f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 >> 172.21.15.29:0/3281826081 conn(0x7f3fb80cda50 msgr2=0x7f3fb8070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:13.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 shutdown_connections 2023-10-08T15:41:13.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.354+0000 7f3fbf39c700 1 -- 172.21.15.29:0/3281826081 wait complete. 2023-10-08T15:41:13.367 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:41:13.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.488+0000 7fcc31e33700 1 Processor -- start 2023-10-08T15:41:13.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.488+0000 7fcc31e33700 1 -- start start 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc31e33700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcc2c0b4860 0x7fcc2c0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc31e33700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcc2c0b3570 0x7fcc2c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc31e33700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2c0b14f0 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc31e33700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c0b17d0 con 0x7fcc2c0b4860 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc31e33700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c0b1ab0 con 0x7fcc2c0b3570 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcc2c0b4860 0x7fcc2c0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2affd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcc2c0b4c30 0x7fcc2c159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56034/0 (socket says 172.21.15.29:56034) 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2affd700 1 -- 172.21.15.29:0/3448255781 learned_addr learned my addr 172.21.15.29:0/3448255781 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2bfff700 1 --2- 172.21.15.29:0/3448255781 >> v2:172.21.15.183:3300/0 conn(0x7fcc2c0b3570 0x7fcc2c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2b7fe700 1 -- 172.21.15.29:0/3448255781 >> v2:172.21.15.183:3300/0 conn(0x7fcc2c0b3570 msgr2=0x7fcc2c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2b7fe700 1 --2- 172.21.15.29:0/3448255781 >> v2:172.21.15.183:3300/0 conn(0x7fcc2c0b3570 0x7fcc2c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2b7fe700 1 -- 172.21.15.29:0/3448255781 >> v1:172.21.15.29:6789/0 conn(0x7fcc2c0b4c30 legacy=0x7fcc2c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2b7fe700 1 -- 172.21.15.29:0/3448255781 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0b1d90 con 0x7fcc2c0b4860 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2a7fc700 1 -- 172.21.15.29:0/3448255781 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134545679 0 0) 0x7fcc2c0b14f0 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2b7fe700 1 --2- 172.21.15.29:0/3448255781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4860 0x7fcc2c0b6700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0b0460 tx=0x7fcc1c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5a2a0ac196320d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.489+0000 7fcc2a7fc700 1 -- 172.21.15.29:0/3448255781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c005c10 con 0x7fcc2c0b4860 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc2a7fc700 1 -- 172.21.15.29:0/3448255781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c005d70 con 0x7fcc2c0b4860 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc2a7fc700 1 -- 172.21.15.29:0/3448255781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c006260 con 0x7fcc2c0b4860 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc31e33700 1 -- 172.21.15.29:0/3448255781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4860 msgr2=0x7fcc2c0b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3448255781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4860 0x7fcc2c0b6700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0b0460 tx=0x7fcc1c009120 comp rx=0 tx=0).stop 2023-10-08T15:41:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc31e33700 1 -- 172.21.15.29:0/3448255781 shutdown_connections 2023-10-08T15:41:13.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3448255781 >> v2:172.21.15.183:3300/0 conn(0x7fcc2c0b3570 0x7fcc2c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3448255781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4860 0x7fcc2c0b6700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc31e33700 1 -- 172.21.15.29:0/3448255781 >> 172.21.15.29:0/3448255781 conn(0x7fcc2c09a0f0 msgr2=0x7fcc2c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:13.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc31e33700 1 -- 172.21.15.29:0/3448255781 shutdown_connections 2023-10-08T15:41:13.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.490+0000 7fcc31e33700 1 -- 172.21.15.29:0/3448255781 wait complete. 2023-10-08T15:41:13.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.491+0000 7fcc31e33700 1 Processor -- start 2023-10-08T15:41:13.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.491+0000 7fcc31e33700 1 -- start start 2023-10-08T15:41:13.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc31e33700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc2c0b3570 0x7fcc2c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.495 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc31e33700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc2c0b4860 0x7fcc2c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc31e33700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4c30 0x7fcc2c0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc31e33700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0ad2a0 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc31e33700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c14b830 con 0x7fcc2c0b3570 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc31e33700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0acce0 con 0x7fcc2c0b4860 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4c30 0x7fcc2c0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4c30 0x7fcc2c0adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57158/0 (socket says 172.21.15.29:57158) 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2bfff700 1 -- 172.21.15.29:0/3886164154 learned_addr learned my addr 172.21.15.29:0/3886164154 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2bfff700 1 -- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc2c0b4860 msgr2=0x7fcc2c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2affd700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc2c0b4860 0x7fcc2c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2b7fe700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc2c0b3570 0x7fcc2c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.496 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2bfff700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc2c0b4860 0x7fcc2c09e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2bfff700 1 -- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc2c0b3570 msgr2=0x7fcc2c14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.492+0000 7fcc2bfff700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc2c0b3570 0x7fcc2c14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.493+0000 7fcc2bfff700 1 -- 172.21.15.29:0/3886164154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0093c0 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.493+0000 7fcc2bfff700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4c30 0x7fcc2c0adc40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009ec0 tx=0x7fcc2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.493+0000 7fcc137fe700 1 -- 172.21.15.29:0/3886164154 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400cc20 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.493+0000 7fcc137fe700 1 -- 172.21.15.29:0/3886164154 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2400f040 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.493+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c0acfc0 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.493+0000 7fcc137fe700 1 -- 172.21.15.29:0/3886164154 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24014480 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.493+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c09b700 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.494+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c09b920 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.494+0000 7fcc137fe700 1 -- 172.21.15.29:0/3886164154 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc24014830 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.495+0000 7fcc137fe700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:13.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.495+0000 7fcc137fe700 1 -- 172.21.15.29:0/3886164154 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc240851a0 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.495+0000 7fcc2b7fe700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:13.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.495+0000 7fcc2b7fe700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcc18066f30 0x7fcc180693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009160 tx=0x7fcc1c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:13.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.499+0000 7fcc137fe700 1 -- 172.21.15.29:0/3886164154 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc24052410 con 0x7fcc2c0b4c30 2023-10-08T15:41:13.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:13.738+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcc2c04c3c0 con 0x7fcc2c0b4c30 2023-10-08T15:41:14.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.673+0000 7fcc137fe700 1 -- 172.21.15.29:0/3886164154 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcc24055a30 con 0x7fcc2c0b4c30 2023-10-08T15:41:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcc18066f30 msgr2=0x7fcc180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcc18066f30 0x7fcc180693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009160 tx=0x7fcc1c016000 comp rx=0 tx=0).stop 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4c30 msgr2=0x7fcc2c0adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4c30 0x7fcc2c0adc40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009ec0 tx=0x7fcc2400b040 comp rx=0 tx=0).stop 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 shutdown_connections 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc2c0b4c30 0x7fcc2c0adc40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc2c0b3570 0x7fcc2c14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 --2- 172.21.15.29:0/3886164154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc2c0b4860 0x7fcc2c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 >> 172.21.15.29:0/3886164154 conn(0x7fcc2c09a0f0 msgr2=0x7fcc2c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 shutdown_connections 2023-10-08T15:41:14.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.676+0000 7fcc31e33700 1 -- 172.21.15.29:0/3886164154 wait complete. 2023-10-08T15:41:14.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:41:14.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.820+0000 7f3c89990700 1 Processor -- start 2023-10-08T15:41:14.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.820+0000 7f3c89990700 1 -- start start 2023-10-08T15:41:14.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.820+0000 7f3c89990700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.820+0000 7f3c89990700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c840cbf10 0x7f3c8415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.820+0000 7f3c89990700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c840cae70 con 0x7f3c840c9390 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.820+0000 7f3c89990700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c840cb150 con 0x7f3c840cbf10 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.820+0000 7f3c89990700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c840cb430 con 0x7f3c840678b0 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c827fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c840cbf10 0x7f3c8415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c837fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3c840c9390 0x7f3c8406bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56038/0 (socket says 172.21.15.29:56038) 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c827fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3c840cbf10 0x7f3c8415e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57170/0 (socket says 172.21.15.29:57170) 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c837fe700 1 -- 172.21.15.29:0/2292513143 learned_addr learned my addr 172.21.15.29:0/2292513143 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c82ffd700 1 --2- 172.21.15.29:0/2292513143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:14.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c827fc700 1 -- 172.21.15.29:0/2292513143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 msgr2=0x7f3c8415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c827fc700 1 --2- 172.21.15.29:0/2292513143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c827fc700 1 -- 172.21.15.29:0/2292513143 >> v1:172.21.15.29:6789/0 conn(0x7f3c840c9390 legacy=0x7f3c8406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c827fc700 1 -- 172.21.15.29:0/2292513143 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c840cb710 con 0x7f3c840cbf10 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c81ffb700 1 -- 172.21.15.29:0/2292513143 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892428353 0 0) 0x7f3c840cae70 con 0x7f3c840c9390 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c82ffd700 1 --2- 172.21.15.29:0/2292513143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c827fc700 1 --2- 172.21.15.29:0/2292513143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840cbf10 0x7f3c8415e0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0098e0 tx=0x7f3c6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efbe93d5d2c45b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c81ffb700 1 -- 172.21.15.29:0/2292513143 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c009e80 con 0x7f3c840cbf10 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c81ffb700 1 -- 172.21.15.29:0/2292513143 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c00b860 con 0x7f3c840cbf10 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.821+0000 7f3c81ffb700 1 -- 172.21.15.29:0/2292513143 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00bbe0 con 0x7f3c840cbf10 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.822+0000 7f3c89990700 1 -- 172.21.15.29:0/2292513143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840cbf10 msgr2=0x7f3c8415e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:14.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.822+0000 7f3c89990700 1 --2- 172.21.15.29:0/2292513143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840cbf10 0x7f3c8415e0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0098e0 tx=0x7f3c6c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.822+0000 7f3c89990700 1 -- 172.21.15.29:0/2292513143 shutdown_connections 2023-10-08T15:41:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.822+0000 7f3c89990700 1 --2- 172.21.15.29:0/2292513143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.822+0000 7f3c89990700 1 --2- 172.21.15.29:0/2292513143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840cbf10 0x7f3c8415e0c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.822+0000 7f3c89990700 1 -- 172.21.15.29:0/2292513143 >> 172.21.15.29:0/2292513143 conn(0x7f3c84069870 msgr2=0x7f3c84069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.822+0000 7f3c89990700 1 -- 172.21.15.29:0/2292513143 shutdown_connections 2023-10-08T15:41:14.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.822+0000 7f3c89990700 1 -- 172.21.15.29:0/2292513143 wait complete. 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.823+0000 7f3c89990700 1 Processor -- start 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.823+0000 7f3c89990700 1 -- start start 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c89990700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c89990700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840c9390 0x7f3c8414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c89990700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c840cbf10 0x7f3c8414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c89990700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8414f3d0 con 0x7f3c840c9390 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c89990700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8414e7c0 con 0x7f3c840cbf10 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c89990700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8414eaa0 con 0x7f3c840678b0 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840c9390 0x7f3c8414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:14.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840c9390 0x7f3c8414d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57178/0 (socket says 172.21.15.29:57178) 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 -- 172.21.15.29:0/1591725066 learned_addr learned my addr 172.21.15.29:0/1591725066 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c82ffd700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c837fe700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c840cbf10 0x7f3c8414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 -- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 msgr2=0x7f3c8415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 -- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c840cbf10 msgr2=0x7f3c8414e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c840cbf10 0x7f3c8414e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 -- 172.21.15.29:0/1591725066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009420 con 0x7f3c840c9390 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c82ffd700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.824+0000 7f3c827fc700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840c9390 0x7f3c8414d8b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3c8406a380 tx=0x7f3c6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.825+0000 7f3c7affd700 1 -- 172.21.15.29:0/1591725066 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00bad0 con 0x7f3c840c9390 2023-10-08T15:41:14.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.825+0000 7f3c7affd700 1 -- 172.21.15.29:0/1591725066 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c025420 con 0x7f3c840c9390 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.825+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8414ed80 con 0x7f3c840c9390 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.825+0000 7f3c7affd700 1 -- 172.21.15.29:0/1591725066 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0257e0 con 0x7f3c840c9390 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.825+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8406c160 con 0x7f3c840c9390 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.825+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c840ca430 con 0x7f3c840c9390 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.826+0000 7f3c7affd700 1 -- 172.21.15.29:0/1591725066 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c6c023070 con 0x7f3c840c9390 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.826+0000 7f3c7affd700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c64066f30 0x7f3c640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.826+0000 7f3c7affd700 1 -- 172.21.15.29:0/1591725066 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c6c085c00 con 0x7f3c840c9390 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.827+0000 7f3c82ffd700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c64066f30 0x7f3c640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:14.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.827+0000 7f3c82ffd700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c64066f30 0x7f3c640693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c007fd0 tx=0x7f3c7c0077a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:14.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:14.831+0000 7f3c7affd700 1 -- 172.21.15.29:0/1591725066 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c6c08c080 con 0x7f3c840c9390 2023-10-08T15:41:15.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.066+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3c8404c3c0 con 0x7f3c840c9390 2023-10-08T15:41:15.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.674+0000 7f3c7affd700 1 -- 172.21.15.29:0/1591725066 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c6c0150c0 con 0x7f3c840c9390 2023-10-08T15:41:15.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c64066f30 msgr2=0x7f3c640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:15.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c64066f30 0x7f3c640693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c007fd0 tx=0x7f3c7c0077a0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840c9390 msgr2=0x7f3c8414d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:15.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840c9390 0x7f3c8414d8b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3c8406a380 tx=0x7f3c6c017000 comp rx=0 tx=0).stop 2023-10-08T15:41:15.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 shutdown_connections 2023-10-08T15:41:15.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c64066f30 0x7f3c640693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c840cbf10 0x7f3c8414e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c840678b0 0x7f3c8415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 --2- 172.21.15.29:0/1591725066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c840c9390 0x7f3c8414d8b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 >> 172.21.15.29:0/1591725066 conn(0x7f3c84069870 msgr2=0x7f3c84150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 shutdown_connections 2023-10-08T15:41:15.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.676+0000 7f3c89990700 1 -- 172.21.15.29:0/1591725066 wait complete. 2023-10-08T15:41:15.691 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:15.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.813+0000 7f1aed131700 1 Processor -- start 2023-10-08T15:41:15.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.813+0000 7f1aed131700 1 -- start start 2023-10-08T15:41:15.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.813+0000 7f1aed131700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1ae8157870 0x7f1ae815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:15.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.813+0000 7f1aed131700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:15.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.813+0000 7f1aed131700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae815cbb0 con 0x7f1ae815a620 2023-10-08T15:41:15.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.813+0000 7f1aed131700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae815bfa0 con 0x7f1ae8157870 2023-10-08T15:41:15.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.813+0000 7f1aed131700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae815c280 con 0x7f1ae8157c40 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae759e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae6d9d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1ae8157870 0x7f1ae815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae759e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae8158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:47126/0 (socket says 172.21.15.29:47126) 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae759e700 1 -- 172.21.15.29:0/533450836 learned_addr learned my addr 172.21.15.29:0/533450836 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae6d9d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1ae8157870 0x7f1ae815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.29:52336/0 (socket says 172.21.15.29:52336) 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae659c700 1 --1- 172.21.15.29:0/533450836 >> v1:172.21.15.183:6789/0 conn(0x7f1ae815a620 0x7f1ae815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:51084/0 (socket says 172.21.15.29:51084) 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae759e700 1 -- 172.21.15.29:0/533450836 >> v2:172.21.15.183:3300/0 conn(0x7f1ae8157870 msgr2=0x7f1ae815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae759e700 1 --2- 172.21.15.29:0/533450836 >> v2:172.21.15.183:3300/0 conn(0x7f1ae8157870 0x7f1ae815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae759e700 1 -- 172.21.15.29:0/533450836 >> v1:172.21.15.183:6789/0 conn(0x7f1ae815a620 legacy=0x7f1ae815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae759e700 1 -- 172.21.15.29:0/533450836 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae815c560 con 0x7f1ae8157c40 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae6d9d700 1 --2- 172.21.15.29:0/533450836 >> v2:172.21.15.183:3300/0 conn(0x7f1ae8157870 0x7f1ae815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:15.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.814+0000 7f1ae759e700 1 --2- 172.21.15.29:0/533450836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae8158110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00099b0 tx=0x7f1ae0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e71006c57e1cc4bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1ae5d9b700 1 -- 172.21.15.29:0/533450836 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0009ea0 con 0x7f1ae8157c40 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1ae5d9b700 1 -- 172.21.15.29:0/533450836 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000b860 con 0x7f1ae8157c40 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1ae5d9b700 1 -- 172.21.15.29:0/533450836 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000bc00 con 0x7f1ae8157c40 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1aed131700 1 -- 172.21.15.29:0/533450836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 msgr2=0x7f1ae8158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1aed131700 1 --2- 172.21.15.29:0/533450836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae8158110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00099b0 tx=0x7f1ae0009250 comp rx=0 tx=0).stop 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1aed131700 1 -- 172.21.15.29:0/533450836 shutdown_connections 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1aed131700 1 --2- 172.21.15.29:0/533450836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae8158110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1aed131700 1 --2- 172.21.15.29:0/533450836 >> v2:172.21.15.183:3300/0 conn(0x7f1ae8157870 0x7f1ae815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1aed131700 1 -- 172.21.15.29:0/533450836 >> 172.21.15.29:0/533450836 conn(0x7f1ae8068ce0 msgr2=0x7f1ae80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1aed131700 1 -- 172.21.15.29:0/533450836 shutdown_connections 2023-10-08T15:41:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.815+0000 7f1aed131700 1 -- 172.21.15.29:0/533450836 wait complete. 2023-10-08T15:41:15.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.816+0000 7f1aed131700 1 Processor -- start 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1aed131700 1 -- start start 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1aed131700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8157870 0x7f1ae8153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1aed131700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1aed131700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae815a620 0x7f1ae814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1aed131700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae814d670 con 0x7f1ae8157870 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1aed131700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae812a160 con 0x7f1ae815a620 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1aed131700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae81505f0 con 0x7f1ae8157c40 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1ae6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8157870 0x7f1ae8153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1ae6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8157870 0x7f1ae8153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57184/0 (socket says 172.21.15.29:57184) 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.817+0000 7f1ae6d9d700 1 -- 172.21.15.29:0/595621557 learned_addr learned my addr 172.21.15.29:0/595621557 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:15.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae659c700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae759e700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae815a620 0x7f1ae814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae6d9d700 1 -- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 msgr2=0x7f1ae80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae6d9d700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae80b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae6d9d700 1 -- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae815a620 msgr2=0x7f1ae814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae6d9d700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae815a620 0x7f1ae814f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae6d9d700 1 -- 172.21.15.29:0/595621557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8009a20 con 0x7f1ae8157870 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae659c700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae80b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae759e700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae815a620 0x7f1ae814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1ae6d9d700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8157870 0x7f1ae8153da0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c170 tx=0x7f1ad800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1aceffd700 1 -- 172.21.15.29:0/595621557 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800ce10 con 0x7f1ae8157870 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1aceffd700 1 -- 172.21.15.29:0/595621557 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800f040 con 0x7f1ae8157870 2023-10-08T15:41:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae00094f0 con 0x7f1ae8157870 2023-10-08T15:41:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1aceffd700 1 -- 172.21.15.29:0/595621557 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8014690 con 0x7f1ae8157870 2023-10-08T15:41:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.818+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae8150bb0 con 0x7f1ae8157870 2023-10-08T15:41:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.819+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae812a440 con 0x7f1ae8157870 2023-10-08T15:41:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.819+0000 7f1aceffd700 1 -- 172.21.15.29:0/595621557 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ad8014a00 con 0x7f1ae8157870 2023-10-08T15:41:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.820+0000 7f1aceffd700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.820+0000 7f1aceffd700 1 -- 172.21.15.29:0/595621557 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ad80854b0 con 0x7f1ae8157870 2023-10-08T15:41:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.820+0000 7f1ae659c700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.821+0000 7f1ae659c700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ad4066f30 0x7f1ad40693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1ae816d9e0 tx=0x7f1adc007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:15.824+0000 7f1aceffd700 1 -- 172.21.15.29:0/595621557 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad8052680 con 0x7f1ae8157870 2023-10-08T15:41:16.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.061+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ae804c3c0 con 0x7f1ae8157870 2023-10-08T15:41:16.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.061+0000 7f1aceffd700 1 -- 172.21.15.29:0/595621557 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f1ad8014cb0 con 0x7f1ae8157870 2023-10-08T15:41:16.062 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:16.062 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:12.039331+0000","modified":"2023-10-08T15:41:15.672568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/470731948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":470731948},{"type":"v1","addr":"172.21.15.29:6835","nonce":470731948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:41:16.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ad4066f30 msgr2=0x7f1ad40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ad4066f30 0x7f1ad40693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1ae816d9e0 tx=0x7f1adc007d80 comp rx=0 tx=0).stop 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8157870 msgr2=0x7f1ae8153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8157870 0x7f1ae8153da0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c170 tx=0x7f1ad800b040 comp rx=0 tx=0).stop 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 shutdown_connections 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ae815a620 0x7f1ae814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae8157870 0x7f1ae8153da0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 --2- 172.21.15.29:0/595621557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ae8157c40 0x7f1ae80b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 >> 172.21.15.29:0/595621557 conn(0x7f1ae8068ce0 msgr2=0x7f1ae80b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 shutdown_connections 2023-10-08T15:41:16.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.064+0000 7f1aed131700 1 -- 172.21.15.29:0/595621557 wait complete. 2023-10-08T15:41:16.066 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-08T15:41:16.076 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:16.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.195+0000 7fc89e1cc700 1 Processor -- start 2023-10-08T15:41:16.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.195+0000 7fc89e1cc700 1 -- start start 2023-10-08T15:41:16.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.196+0000 7fc89e1cc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8980b1220 0x7fc8980c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.196+0000 7fc89e1cc700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89815de60 con 0x7fc8980b0e50 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.196+0000 7fc89e1cc700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89815e140 con 0x7fc8980cb4f0 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.196+0000 7fc89e1cc700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89815e420 con 0x7fc8980b1220 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.196+0000 7fc8977fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc8980b0e50 0x7fc89806d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56050/0 (socket says 172.21.15.29:56050) 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.196+0000 7fc8977fe700 1 -- 172.21.15.29:0/206953099 learned_addr learned my addr 172.21.15.29:0/206953099 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836636765 0 0) 0x7fc89815de60 con 0x7fc8980b0e50 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc880003570 con 0x7fc8980b0e50 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc896ffd700 1 --2- 172.21.15.29:0/206953099 >> v2:172.21.15.183:3300/0 conn(0x7fc8980b1220 0x7fc8980c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2767609138 0 0) 0x7fc880003570 con 0x7fc8980b0e50 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 >> v2:172.21.15.183:3300/0 conn(0x7fc8980b1220 msgr2=0x7fc8980c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:16.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 --2- 172.21.15.29:0/206953099 >> v2:172.21.15.183:3300/0 conn(0x7fc8980b1220 0x7fc8980c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 >> v1:172.21.15.183:6789/0 conn(0x7fc8980cb4f0 legacy=0x7fc8980679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89815e700 con 0x7fc8980b0e50 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fc888001470 con 0x7fc8980b0e50 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 >> v1:172.21.15.29:6789/0 conn(0x7fc8980b0e50 legacy=0x7fc89806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880003a60 0x7fc880003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc880004810 0x7fc880004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8800052e0 0x7fc88000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89815e420 con 0x7fc880004810 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88000c2a0 con 0x7fc8800052e0 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88000c460 con 0x7fc880003a60 2023-10-08T15:41:16.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc896ffd700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc880004810 0x7fc880004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc8977fe700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880003a60 0x7fc880003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc897fff700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8800052e0 0x7fc88000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc896ffd700 1 -- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880003a60 msgr2=0x7fc880003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc896ffd700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880003a60 0x7fc880003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc896ffd700 1 -- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8800052e0 msgr2=0x7fc88000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc896ffd700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8800052e0 0x7fc88000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc896ffd700 1 -- 172.21.15.29:0/206953099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880003570 con 0x7fc880004810 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc897fff700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8800052e0 0x7fc88000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:16.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.197+0000 7fc897fff700 1 -- 172.21.15.29:0/206953099 reap_dead start 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc896ffd700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc880004810 0x7fc880004c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc8980b1680 tx=0x7fc88c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b76c5b2b7801c91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00e710 con 0x7fc880004810 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c00e870 con 0x7fc880004810 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc8967fc700 1 -- 172.21.15.29:0/206953099 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00ec30 con 0x7fc880004810 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc89e1cc700 1 -- 172.21.15.29:0/206953099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc880004810 msgr2=0x7fc880004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc89e1cc700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc880004810 0x7fc880004c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc8980b1680 tx=0x7fc88c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc89e1cc700 1 -- 172.21.15.29:0/206953099 shutdown_connections 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc89e1cc700 1 --2- 172.21.15.29:0/206953099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc880004810 0x7fc880004c80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc89e1cc700 1 -- 172.21.15.29:0/206953099 >> 172.21.15.29:0/206953099 conn(0x7fc898069870 msgr2=0x7fc898069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:16.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc89e1cc700 1 -- 172.21.15.29:0/206953099 shutdown_connections 2023-10-08T15:41:16.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.198+0000 7fc89e1cc700 1 -- 172.21.15.29:0/206953099 wait complete. 2023-10-08T15:41:16.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.200+0000 7fc89e1cc700 1 Processor -- start 2023-10-08T15:41:16.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.200+0000 7fc89e1cc700 1 -- start start 2023-10-08T15:41:16.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.200+0000 7fc89e1cc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880004810 0x7fc8981500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.200+0000 7fc89e1cc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8980b41c0 0x7fc898153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.200+0000 7fc89e1cc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8980b4630 0x7fc898154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.200+0000 7fc89e1cc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980b18e0 con 0x7fc8980b4630 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.200+0000 7fc89e1cc700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980b1bc0 con 0x7fc8980b41c0 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.200+0000 7fc89e1cc700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89815afc0 con 0x7fc880004810 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8980b4630 0x7fc898154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8980b4630 0x7fc898154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57200/0 (socket says 172.21.15.29:57200) 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 -- 172.21.15.29:0/1107078670 learned_addr learned my addr 172.21.15.29:0/1107078670 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc896ffd700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8980b41c0 0x7fc898153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc8977fe700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880004810 0x7fc8981500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 -- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880004810 msgr2=0x7fc8981500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880004810 0x7fc8981500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 -- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8980b41c0 msgr2=0x7fc898153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8980b41c0 0x7fc898153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 -- 172.21.15.29:0/1107078670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898152de0 con 0x7fc8980b4630 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc897fff700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8980b4630 0x7fc898154490 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc8980cb8c0 tx=0x7fc890009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc87f7fe700 1 -- 172.21.15.29:0/1107078670 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890012590 con 0x7fc8980b4630 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc87f7fe700 1 -- 172.21.15.29:0/1107078670 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8900126f0 con 0x7fc8980b4630 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8981530c0 con 0x7fc8980b4630 2023-10-08T15:41:16.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc87f7fe700 1 -- 172.21.15.29:0/1107078670 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890012ab0 con 0x7fc8980b4630 2023-10-08T15:41:16.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.201+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8981505e0 con 0x7fc8980b4630 2023-10-08T15:41:16.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.202+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8980b1d70 con 0x7fc8980b4630 2023-10-08T15:41:16.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.203+0000 7fc87f7fe700 1 -- 172.21.15.29:0/1107078670 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc890003030 con 0x7fc8980b4630 2023-10-08T15:41:16.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.203+0000 7fc87f7fe700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc884066f30 0x7fc8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.203+0000 7fc87f7fe700 1 -- 172.21.15.29:0/1107078670 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8900841d0 con 0x7fc8980b4630 2023-10-08T15:41:16.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.203+0000 7fc8977fe700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc884066f30 0x7fc8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.204+0000 7fc8977fe700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc884066f30 0x7fc8840693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc89815d850 tx=0x7fc888001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.207+0000 7fc87f7fe700 1 -- 172.21.15.29:0/1107078670 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8980b1d70 con 0x7fc8980b4630 2023-10-08T15:41:16.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.401+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8980b1d70 con 0x7fc8980b4630 2023-10-08T15:41:16.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.402+0000 7fc87f7fe700 1 -- 172.21.15.29:0/1107078670 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc8980b1d70 con 0x7fc8980b4630 2023-10-08T15:41:16.403 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:16.403 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":31,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:13.645808+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:10.133425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:11.014819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:16.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc884066f30 msgr2=0x7fc8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc884066f30 0x7fc8840693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc89815d850 tx=0x7fc888001e50 comp rx=0 tx=0).stop 2023-10-08T15:41:16.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8980b4630 msgr2=0x7fc898154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8980b4630 0x7fc898154490 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc8980cb8c0 tx=0x7fc890009040 comp rx=0 tx=0).stop 2023-10-08T15:41:16.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 shutdown_connections 2023-10-08T15:41:16.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc884066f30 0x7fc8840693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8980b4630 0x7fc898154490 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc880004810 0x7fc8981500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 --2- 172.21.15.29:0/1107078670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8980b41c0 0x7fc898153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 >> 172.21.15.29:0/1107078670 conn(0x7fc898069870 msgr2=0x7fc8981517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:16.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 shutdown_connections 2023-10-08T15:41:16.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.404+0000 7fc89e1cc700 1 -- 172.21.15.29:0/1107078670 wait complete. 2023-10-08T15:41:16.417 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:41:16.417 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:41:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.536+0000 7f18a531c700 1 Processor -- start 2023-10-08T15:41:16.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.536+0000 7f18a531c700 1 -- start start 2023-10-08T15:41:16.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f18a531c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f18a015a030 0x7f18a015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f18a531c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18a00cf100 0x7f18a00cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f18a531c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00d1960 con 0x7f18a00b40b0 2023-10-08T15:41:16.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f18a531c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00d0610 con 0x7f18a00cf100 2023-10-08T15:41:16.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f18a531c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a015a940 con 0x7f18a015a030 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f189f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18a00cf100 0x7f18a00cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f18a4b1b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f18a00b40b0 0x7f18a00b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56056/0 (socket says 172.21.15.29:56056) 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f189f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18a00cf100 0x7f18a00cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57206/0 (socket says 172.21.15.29:57206) 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f18a4b1b700 1 -- 172.21.15.29:0/2883933120 learned_addr learned my addr 172.21.15.29:0/2883933120 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f189ffff700 1 --2- 172.21.15.29:0/2883933120 >> v2:172.21.15.183:3300/0 conn(0x7f18a015a030 0x7f18a015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f189f7fe700 1 -- 172.21.15.29:0/2883933120 >> v2:172.21.15.183:3300/0 conn(0x7f18a015a030 msgr2=0x7f18a015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f189f7fe700 1 --2- 172.21.15.29:0/2883933120 >> v2:172.21.15.183:3300/0 conn(0x7f18a015a030 0x7f18a015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f189f7fe700 1 -- 172.21.15.29:0/2883933120 >> v1:172.21.15.29:6789/0 conn(0x7f18a00b40b0 legacy=0x7f18a00b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f189f7fe700 1 -- 172.21.15.29:0/2883933120 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00cfab0 con 0x7f18a00cf100 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.537+0000 7f189effd700 1 -- 172.21.15.29:0/2883933120 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385030037 0 0) 0x7f18a00d1960 con 0x7f18a00b40b0 2023-10-08T15:41:16.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f189f7fe700 1 --2- 172.21.15.29:0/2883933120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a00cf100 0x7f18a00cf570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f18a006b8e0 tx=0x7f18880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b64b27f32749e2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f189effd700 1 -- 172.21.15.29:0/2883933120 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188800b6b0 con 0x7f18a00cf100 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f189effd700 1 -- 172.21.15.29:0/2883933120 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188800b810 con 0x7f18a00cf100 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f189effd700 1 -- 172.21.15.29:0/2883933120 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188800bbb0 con 0x7f18a00cf100 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f18a531c700 1 -- 172.21.15.29:0/2883933120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a00cf100 msgr2=0x7f18a00cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f18a531c700 1 --2- 172.21.15.29:0/2883933120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a00cf100 0x7f18a00cf570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f18a006b8e0 tx=0x7f18880091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f18a531c700 1 -- 172.21.15.29:0/2883933120 shutdown_connections 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f18a531c700 1 --2- 172.21.15.29:0/2883933120 >> v2:172.21.15.183:3300/0 conn(0x7f18a015a030 0x7f18a015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f18a531c700 1 --2- 172.21.15.29:0/2883933120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a00cf100 0x7f18a00cf570 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f18a531c700 1 -- 172.21.15.29:0/2883933120 >> 172.21.15.29:0/2883933120 conn(0x7f18a0067e40 msgr2=0x7f18a00d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f18a531c700 1 -- 172.21.15.29:0/2883933120 shutdown_connections 2023-10-08T15:41:16.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.538+0000 7f18a531c700 1 -- 172.21.15.29:0/2883933120 wait complete. 2023-10-08T15:41:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.539+0000 7f18a531c700 1 Processor -- start 2023-10-08T15:41:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.540+0000 7f18a531c700 1 -- start start 2023-10-08T15:41:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.540+0000 7f18a531c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18a00b40b0 0x7f18a016aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.540+0000 7f18a531c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18a00cf100 0x7f18a00b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.540+0000 7f18a531c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a015a030 0x7f18a015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.540+0000 7f18a531c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a015b540 con 0x7f18a015a030 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.540+0000 7f18a531c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00b2d40 con 0x7f18a00b40b0 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.540+0000 7f18a531c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a015d090 con 0x7f18a00cf100 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a015a030 0x7f18a015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a015a030 0x7f18a015c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57222/0 (socket says 172.21.15.29:57222) 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 -- 172.21.15.29:0/1343371702 learned_addr learned my addr 172.21.15.29:0/1343371702 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f189f7fe700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18a00cf100 0x7f18a00b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f189ffff700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18a00b40b0 0x7f18a016aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 -- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18a00cf100 msgr2=0x7f18a00b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18a00cf100 0x7f18a00b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 -- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18a00b40b0 msgr2=0x7f18a016aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18a00b40b0 0x7f18a016aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 -- 172.21.15.29:0/1343371702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888009420 con 0x7f18a015a030 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a4b1b700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a015a030 0x7f18a015c8d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f189800cc90 tx=0x7f1898001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f1897fff700 1 -- 172.21.15.29:0/1343371702 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800a810 con 0x7f18a015a030 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f1897fff700 1 -- 172.21.15.29:0/1343371702 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800a970 con 0x7f18a015a030 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a015ce10 con 0x7f18a015a030 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f1897fff700 1 -- 172.21.15.29:0/1343371702 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800ad30 con 0x7f18a015a030 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.541+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a015aef0 con 0x7f18a015a030 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.542+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a015b6f0 con 0x7f18a015a030 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.543+0000 7f1897fff700 1 -- 172.21.15.29:0/1343371702 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1898007300 con 0x7f18a015a030 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.543+0000 7f1897fff700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.543+0000 7f1897fff700 1 -- 172.21.15.29:0/1343371702 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1898084790 con 0x7f18a015a030 2023-10-08T15:41:16.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.543+0000 7f189ffff700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.544+0000 7f189ffff700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1880066f30 0x7f18800693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f18900061f0 tx=0x7f1890008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.548+0000 7f1897fff700 1 -- 172.21.15.29:0/1343371702 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18a015b6f0 con 0x7f18a015a030 2023-10-08T15:41:16.629 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-08T15:41:16.629+0000 7f1100e40700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:41:16.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.734+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18a015b6f0 con 0x7f1880066f30 2023-10-08T15:41:16.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.743+0000 7f1897fff700 1 -- 172.21.15.29:0/1343371702 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266219 (secure 0 0 0) 0x7f18a015b6f0 con 0x7f1880066f30 2023-10-08T15:41:16.747 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:16.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1880066f30 msgr2=0x7f18800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1880066f30 0x7f18800693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f18900061f0 tx=0x7f1890008040 comp rx=0 tx=0).stop 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a015a030 msgr2=0x7f18a015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a015a030 0x7f18a015c8d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f189800cc90 tx=0x7f1898001a20 comp rx=0 tx=0).stop 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 shutdown_connections 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18a015a030 0x7f18a015c8d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18a00b40b0 0x7f18a016aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 --2- 172.21.15.29:0/1343371702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18a00cf100 0x7f18a00b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 >> 172.21.15.29:0/1343371702 conn(0x7f18a0067e40 msgr2=0x7f18a0159070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 shutdown_connections 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.746+0000 7f18a531c700 1 -- 172.21.15.29:0/1343371702 wait complete. 2023-10-08T15:41:16.750 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:41:16.758 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-08T15:41:16.314307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2109,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560390,"statfs":{"total":1600000000,"available":1597840066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672263"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661021+0000","last_change":"2023-10-08T15:41:12.661021+0000","last_active":"2023-10-08T15:41:12.661021+0000","last_peered":"2023-10-08T15:41:12.661021+0000","last_clean":"2023-10-08T15:41:12.661021+0000","last_became_active":"2023-10-08T15:41:12.658721+0000","last_became_peered":"2023-10-08T15:41:12.658721+0000","last_unstale":"2023-10-08T15:41:12.661021+0000","last_undegraded":"2023-10-08T15:41:12.661021+0000","last_fullsized":"2023-10-08T15:41:12.661021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:40.936790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657015+0000","last_change":"2023-10-08T15:41:12.657015+0000","last_active":"2023-10-08T15:41:12.657015+0000","last_peered":"2023-10-08T15:41:12.657015+0000","last_clean":"2023-10-08T15:41:12.657015+0000","last_became_active":"2023-10-08T15:41:12.656639+0000","last_became_peered":"2023-10-08T15:41:12.656639+0000","last_unstale":"2023-10-08T15:41:12.657015+0000","last_undegraded":"2023-10-08T15:41:12.657015+0000","last_fullsized":"2023-10-08T15:41:12.657015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:54.689846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655673+0000","last_change":"2023-10-08T15:41:12.655673+0000","last_active":"2023-10-08T15:41:12.655673+0000","last_peered":"2023-10-08T15:41:12.655673+0000","last_clean":"2023-10-08T15:41:12.655673+0000","last_became_active":"2023-10-08T15:41:12.652247+0000","last_became_peered":"2023-10-08T15:41:12.652247+0000","last_unstale":"2023-10-08T15:41:12.655673+0000","last_undegraded":"2023-10-08T15:41:12.655673+0000","last_fullsized":"2023-10-08T15:41:12.655673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:03.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.652966+0000","last_change":"2023-10-08T15:41:12.652966+0000","last_active":"2023-10-08T15:41:12.652966+0000","last_peered":"2023-10-08T15:41:12.652966+0000","last_clean":"2023-10-08T15:41:12.652966+0000","last_became_active":"2023-10-08T15:41:12.652319+0000","last_became_peered":"2023-10-08T15:41:12.652319+0000","last_unstale":"2023-10-08T15:41:12.652966+0000","last_undegraded":"2023-10-08T15:41:12.652966+0000","last_fullsized":"2023-10-08T15:41:12.652966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:39.043594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657025+0000","last_change":"2023-10-08T15:41:12.657025+0000","last_active":"2023-10-08T15:41:12.657025+0000","last_peered":"2023-10-08T15:41:12.657025+0000","last_clean":"2023-10-08T15:41:12.657025+0000","last_became_active":"2023-10-08T15:41:12.656162+0000","last_became_peered":"2023-10-08T15:41:12.656162+0000","last_unstale":"2023-10-08T15:41:12.657025+0000","last_undegraded":"2023-10-08T15:41:12.657025+0000","last_fullsized":"2023-10-08T15:41:12.657025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:22.265704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.660195+0000","last_change":"2023-10-08T15:41:12.660195+0000","last_active":"2023-10-08T15:41:12.660195+0000","last_peered":"2023-10-08T15:41:12.660195+0000","last_clean":"2023-10-08T15:41:12.660195+0000","last_became_active":"2023-10-08T15:41:12.660036+0000","last_became_peered":"2023-10-08T15:41:12.660036+0000","last_unstale":"2023-10-08T15:41:12.660195+0000","last_undegraded":"2023-10-08T15:41:12.660195+0000","last_fullsized":"2023-10-08T15:41:12.660195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:51.561758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662025+0000","last_change":"2023-10-08T15:41:12.662025+0000","last_active":"2023-10-08T15:41:12.662025+0000","last_peered":"2023-10-08T15:41:12.662025+0000","last_clean":"2023-10-08T15:41:12.662025+0000","last_became_active":"2023-10-08T15:41:12.661284+0000","last_became_peered":"2023-10-08T15:41:12.661284+0000","last_unstale":"2023-10-08T15:41:12.662025+0000","last_undegraded":"2023-10-08T15:41:12.662025+0000","last_fullsized":"2023-10-08T15:41:12.662025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:19.303260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657804+0000","last_change":"2023-10-08T15:41:12.657804+0000","last_active":"2023-10-08T15:41:12.657804+0000","last_peered":"2023-10-08T15:41:12.657804+0000","last_clean":"2023-10-08T15:41:12.657804+0000","last_became_active":"2023-10-08T15:41:12.657512+0000","last_became_peered":"2023-10-08T15:41:12.657512+0000","last_unstale":"2023-10-08T15:41:12.657804+0000","last_undegraded":"2023-10-08T15:41:12.657804+0000","last_fullsized":"2023-10-08T15:41:12.657804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:33.532228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.654992+0000","last_change":"2023-10-08T15:41:12.654992+0000","last_active":"2023-10-08T15:41:12.654992+0000","last_peered":"2023-10-08T15:41:12.654992+0000","last_clean":"2023-10-08T15:41:12.654992+0000","last_became_active":"2023-10-08T15:41:12.654685+0000","last_became_peered":"2023-10-08T15:41:12.654685+0000","last_unstale":"2023-10-08T15:41:12.654992+0000","last_undegraded":"2023-10-08T15:41:12.654992+0000","last_fullsized":"2023-10-08T15:41:12.654992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:47.151660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657203+0000","last_change":"2023-10-08T15:41:12.657203+0000","last_active":"2023-10-08T15:41:12.657203+0000","last_peered":"2023-10-08T15:41:12.657203+0000","last_clean":"2023-10-08T15:41:12.657203+0000","last_became_active":"2023-10-08T15:41:12.656659+0000","last_became_peered":"2023-10-08T15:41:12.656659+0000","last_unstale":"2023-10-08T15:41:12.657203+0000","last_undegraded":"2023-10-08T15:41:12.657203+0000","last_fullsized":"2023-10-08T15:41:12.657203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:31:08.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659038+0000","last_change":"2023-10-08T15:41:12.659038+0000","last_active":"2023-10-08T15:41:12.659038+0000","last_peered":"2023-10-08T15:41:12.659038+0000","last_clean":"2023-10-08T15:41:12.659038+0000","last_became_active":"2023-10-08T15:41:12.655502+0000","last_became_peered":"2023-10-08T15:41:12.655502+0000","last_unstale":"2023-10-08T15:41:12.659038+0000","last_undegraded":"2023-10-08T15:41:12.659038+0000","last_fullsized":"2023-10-08T15:41:12.659038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:51.561758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657958+0000","last_change":"2023-10-08T15:41:12.657958+0000","last_active":"2023-10-08T15:41:12.657958+0000","last_peered":"2023-10-08T15:41:12.657958+0000","last_clean":"2023-10-08T15:41:12.657958+0000","last_became_active":"2023-10-08T15:41:12.656857+0000","last_became_peered":"2023-10-08T15:41:12.656857+0000","last_unstale":"2023-10-08T15:41:12.657958+0000","last_undegraded":"2023-10-08T15:41:12.657958+0000","last_fullsized":"2023-10-08T15:41:12.657958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:51.561758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.664453+0000","last_change":"2023-10-08T15:41:12.664453+0000","last_active":"2023-10-08T15:41:12.664453+0000","last_peered":"2023-10-08T15:41:12.664453+0000","last_clean":"2023-10-08T15:41:12.664453+0000","last_became_active":"2023-10-08T15:41:12.664207+0000","last_became_peered":"2023-10-08T15:41:12.664207+0000","last_unstale":"2023-10-08T15:41:12.664453+0000","last_undegraded":"2023-10-08T15:41:12.664453+0000","last_fullsized":"2023-10-08T15:41:12.664453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:48.506737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659060+0000","last_change":"2023-10-08T15:41:12.659060+0000","last_active":"2023-10-08T15:41:12.659060+0000","last_peered":"2023-10-08T15:41:12.659060+0000","last_clean":"2023-10-08T15:41:12.659060+0000","last_became_active":"2023-10-08T15:41:12.658232+0000","last_became_peered":"2023-10-08T15:41:12.658232+0000","last_unstale":"2023-10-08T15:41:12.659060+0000","last_undegraded":"2023-10-08T15:41:12.659060+0000","last_fullsized":"2023-10-08T15:41:12.659060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.138449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659562+0000","last_change":"2023-10-08T15:41:12.659562+0000","last_active":"2023-10-08T15:41:12.659562+0000","last_peered":"2023-10-08T15:41:12.659562+0000","last_clean":"2023-10-08T15:41:12.659562+0000","last_became_active":"2023-10-08T15:41:12.659329+0000","last_became_peered":"2023-10-08T15:41:12.659329+0000","last_unstale":"2023-10-08T15:41:12.659562+0000","last_undegraded":"2023-10-08T15:41:12.659562+0000","last_fullsized":"2023-10-08T15:41:12.659562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:42.275778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661200+0000","last_change":"2023-10-08T15:41:12.661200+0000","last_active":"2023-10-08T15:41:12.661200+0000","last_peered":"2023-10-08T15:41:12.661200+0000","last_clean":"2023-10-08T15:41:12.661200+0000","last_became_active":"2023-10-08T15:41:12.660982+0000","last_became_peered":"2023-10-08T15:41:12.660982+0000","last_unstale":"2023-10-08T15:41:12.661200+0000","last_undegraded":"2023-10-08T15:41:12.661200+0000","last_fullsized":"2023-10-08T15:41:12.661200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:04:45.812538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662316+0000","last_change":"2023-10-08T15:41:12.662316+0000","last_active":"2023-10-08T15:41:12.662316+0000","last_peered":"2023-10-08T15:41:12.662316+0000","last_clean":"2023-10-08T15:41:12.662316+0000","last_became_active":"2023-10-08T15:41:12.661793+0000","last_became_peered":"2023-10-08T15:41:12.661793+0000","last_unstale":"2023-10-08T15:41:12.662316+0000","last_undegraded":"2023-10-08T15:41:12.662316+0000","last_fullsized":"2023-10-08T15:41:12.662316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:42.275778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662765+0000","last_change":"2023-10-08T15:41:12.662765+0000","last_active":"2023-10-08T15:41:12.662765+0000","last_peered":"2023-10-08T15:41:12.662765+0000","last_clean":"2023-10-08T15:41:12.662765+0000","last_became_active":"2023-10-08T15:41:12.662570+0000","last_became_peered":"2023-10-08T15:41:12.662570+0000","last_unstale":"2023-10-08T15:41:12.662765+0000","last_undegraded":"2023-10-08T15:41:12.662765+0000","last_fullsized":"2023-10-08T15:41:12.662765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:17.813719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655392+0000","last_change":"2023-10-08T15:41:12.655392+0000","last_active":"2023-10-08T15:41:12.655392+0000","last_peered":"2023-10-08T15:41:12.655392+0000","last_clean":"2023-10-08T15:41:12.655392+0000","last_became_active":"2023-10-08T15:41:12.655146+0000","last_became_peered":"2023-10-08T15:41:12.655146+0000","last_unstale":"2023-10-08T15:41:12.655392+0000","last_undegraded":"2023-10-08T15:41:12.655392+0000","last_fullsized":"2023-10-08T15:41:12.655392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:35.052726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658150+0000","last_change":"2023-10-08T15:41:12.658150+0000","last_active":"2023-10-08T15:41:12.658150+0000","last_peered":"2023-10-08T15:41:12.658150+0000","last_clean":"2023-10-08T15:41:12.658150+0000","last_became_active":"2023-10-08T15:41:12.657747+0000","last_became_peered":"2023-10-08T15:41:12.657747+0000","last_unstale":"2023-10-08T15:41:12.658150+0000","last_undegraded":"2023-10-08T15:41:12.658150+0000","last_fullsized":"2023-10-08T15:41:12.658150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:49.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662345+0000","last_change":"2023-10-08T15:41:12.662345+0000","last_active":"2023-10-08T15:41:12.662345+0000","last_peered":"2023-10-08T15:41:12.662345+0000","last_clean":"2023-10-08T15:41:12.662345+0000","last_became_active":"2023-10-08T15:41:12.656818+0000","last_became_peered":"2023-10-08T15:41:12.656818+0000","last_unstale":"2023-10-08T15:41:12.662345+0000","last_undegraded":"2023-10-08T15:41:12.662345+0000","last_fullsized":"2023-10-08T15:41:12.662345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:02.369267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655831+0000","last_change":"2023-10-08T15:41:12.655831+0000","last_active":"2023-10-08T15:41:12.655831+0000","last_peered":"2023-10-08T15:41:12.655831+0000","last_clean":"2023-10-08T15:41:12.655831+0000","last_became_active":"2023-10-08T15:41:12.655451+0000","last_became_peered":"2023-10-08T15:41:12.655451+0000","last_unstale":"2023-10-08T15:41:12.655831+0000","last_undegraded":"2023-10-08T15:41:12.655831+0000","last_fullsized":"2023-10-08T15:41:12.655831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:54.721532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661934+0000","last_change":"2023-10-08T15:41:12.661934+0000","last_active":"2023-10-08T15:41:12.661934+0000","last_peered":"2023-10-08T15:41:12.661934+0000","last_clean":"2023-10-08T15:41:12.661934+0000","last_became_active":"2023-10-08T15:41:12.661706+0000","last_became_peered":"2023-10-08T15:41:12.661706+0000","last_unstale":"2023-10-08T15:41:12.661934+0000","last_undegraded":"2023-10-08T15:41:12.661934+0000","last_fullsized":"2023-10-08T15:41:12.661934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:02.369267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.656996+0000","last_change":"2023-10-08T15:41:12.656996+0000","last_active":"2023-10-08T15:41:12.656996+0000","last_peered":"2023-10-08T15:41:12.656996+0000","last_clean":"2023-10-08T15:41:12.656996+0000","last_became_active":"2023-10-08T15:41:12.656748+0000","last_became_peered":"2023-10-08T15:41:12.656748+0000","last_unstale":"2023-10-08T15:41:12.656996+0000","last_undegraded":"2023-10-08T15:41:12.656996+0000","last_fullsized":"2023-10-08T15:41:12.656996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:18:51.820488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657348+0000","last_change":"2023-10-08T15:41:12.657348+0000","last_active":"2023-10-08T15:41:12.657348+0000","last_peered":"2023-10-08T15:41:12.657348+0000","last_clean":"2023-10-08T15:41:12.657348+0000","last_became_active":"2023-10-08T15:41:12.656980+0000","last_became_peered":"2023-10-08T15:41:12.656980+0000","last_unstale":"2023-10-08T15:41:12.657348+0000","last_undegraded":"2023-10-08T15:41:12.657348+0000","last_fullsized":"2023-10-08T15:41:12.657348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:11.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661318+0000","last_change":"2023-10-08T15:41:12.661318+0000","last_active":"2023-10-08T15:41:12.661318+0000","last_peered":"2023-10-08T15:41:12.661318+0000","last_clean":"2023-10-08T15:41:12.661318+0000","last_became_active":"2023-10-08T15:41:12.661102+0000","last_became_peered":"2023-10-08T15:41:12.661102+0000","last_unstale":"2023-10-08T15:41:12.661318+0000","last_undegraded":"2023-10-08T15:41:12.661318+0000","last_fullsized":"2023-10-08T15:41:12.661318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:33.532228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.650219+0000","last_change":"2023-10-08T15:41:12.650219+0000","last_active":"2023-10-08T15:41:12.650219+0000","last_peered":"2023-10-08T15:41:12.650219+0000","last_clean":"2023-10-08T15:41:12.650219+0000","last_became_active":"2023-10-08T15:41:12.649994+0000","last_became_peered":"2023-10-08T15:41:12.649994+0000","last_unstale":"2023-10-08T15:41:12.650219+0000","last_undegraded":"2023-10-08T15:41:12.650219+0000","last_fullsized":"2023-10-08T15:41:12.650219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:02.369267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657764+0000","last_change":"2023-10-08T15:41:12.657764+0000","last_active":"2023-10-08T15:41:12.657764+0000","last_peered":"2023-10-08T15:41:12.657764+0000","last_clean":"2023-10-08T15:41:12.657764+0000","last_became_active":"2023-10-08T15:41:12.657583+0000","last_became_peered":"2023-10-08T15:41:12.657583+0000","last_unstale":"2023-10-08T15:41:12.657764+0000","last_undegraded":"2023-10-08T15:41:12.657764+0000","last_fullsized":"2023-10-08T15:41:12.657764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:17.813719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.654192+0000","last_change":"2023-10-08T15:41:12.654192+0000","last_active":"2023-10-08T15:41:12.654192+0000","last_peered":"2023-10-08T15:41:12.654192+0000","last_clean":"2023-10-08T15:41:12.654192+0000","last_became_active":"2023-10-08T15:41:12.653902+0000","last_became_peered":"2023-10-08T15:41:12.653902+0000","last_unstale":"2023-10-08T15:41:12.654192+0000","last_undegraded":"2023-10-08T15:41:12.654192+0000","last_fullsized":"2023-10-08T15:41:12.654192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:39.043594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659755+0000","last_change":"2023-10-08T15:41:12.659755+0000","last_active":"2023-10-08T15:41:12.659755+0000","last_peered":"2023-10-08T15:41:12.659755+0000","last_clean":"2023-10-08T15:41:12.659755+0000","last_became_active":"2023-10-08T15:41:12.659401+0000","last_became_peered":"2023-10-08T15:41:12.659401+0000","last_unstale":"2023-10-08T15:41:12.659755+0000","last_undegraded":"2023-10-08T15:41:12.659755+0000","last_fullsized":"2023-10-08T15:41:12.659755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:17.013674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.656384+0000","last_change":"2023-10-08T15:41:12.656384+0000","last_active":"2023-10-08T15:41:12.656384+0000","last_peered":"2023-10-08T15:41:12.656384+0000","last_clean":"2023-10-08T15:41:12.656384+0000","last_became_active":"2023-10-08T15:41:12.656027+0000","last_became_peered":"2023-10-08T15:41:12.656027+0000","last_unstale":"2023-10-08T15:41:12.656384+0000","last_undegraded":"2023-10-08T15:41:12.656384+0000","last_fullsized":"2023-10-08T15:41:12.656384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:31.957245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662168+0000","last_change":"2023-10-08T15:41:12.662168+0000","last_active":"2023-10-08T15:41:12.662168+0000","last_peered":"2023-10-08T15:41:12.662168+0000","last_clean":"2023-10-08T15:41:12.662168+0000","last_became_active":"2023-10-08T15:41:12.661516+0000","last_became_peered":"2023-10-08T15:41:12.661516+0000","last_unstale":"2023-10-08T15:41:12.662168+0000","last_undegraded":"2023-10-08T15:41:12.662168+0000","last_fullsized":"2023-10-08T15:41:12.662168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:11.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.663272+0000","last_change":"2023-10-08T15:41:12.663272+0000","last_active":"2023-10-08T15:41:12.663272+0000","last_peered":"2023-10-08T15:41:12.663272+0000","last_clean":"2023-10-08T15:41:12.663272+0000","last_became_active":"2023-10-08T15:41:12.663058+0000","last_became_peered":"2023-10-08T15:41:12.663058+0000","last_unstale":"2023-10-08T15:41:12.663272+0000","last_undegraded":"2023-10-08T15:41:12.663272+0000","last_fullsized":"2023-10-08T15:41:12.663272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:40.936790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.671542+0000","last_change":"2023-10-08T15:41:11.647552+0000","last_active":"2023-10-08T15:41:12.671542+0000","last_peered":"2023-10-08T15:41:12.671542+0000","last_clean":"2023-10-08T15:41:12.671542+0000","last_became_active":"2023-10-08T15:41:11.647319+0000","last_became_peered":"2023-10-08T15:41:11.647319+0000","last_unstale":"2023-10-08T15:41:12.671542+0000","last_undegraded":"2023-10-08T15:41:12.671542+0000","last_fullsized":"2023-10-08T15:41:12.671542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.174103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.660125+0000","last_change":"2023-10-08T15:41:12.660125+0000","last_active":"2023-10-08T15:41:12.660125+0000","last_peered":"2023-10-08T15:41:12.660125+0000","last_clean":"2023-10-08T15:41:12.660125+0000","last_became_active":"2023-10-08T15:41:12.659883+0000","last_became_peered":"2023-10-08T15:41:12.659883+0000","last_unstale":"2023-10-08T15:41:12.660125+0000","last_undegraded":"2023-10-08T15:41:12.660125+0000","last_fullsized":"2023-10-08T15:41:12.660125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:10.188055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661294+0000","last_change":"2023-10-08T15:41:11.646644+0000","last_active":"2023-10-08T15:41:12.661294+0000","last_peered":"2023-10-08T15:41:12.661294+0000","last_clean":"2023-10-08T15:41:12.661294+0000","last_became_active":"2023-10-08T15:41:11.646415+0000","last_became_peered":"2023-10-08T15:41:11.646415+0000","last_unstale":"2023-10-08T15:41:12.661294+0000","last_undegraded":"2023-10-08T15:41:12.661294+0000","last_fullsized":"2023-10-08T15:41:12.661294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:50.988899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.651344+0000","last_change":"2023-10-08T15:41:12.651344+0000","last_active":"2023-10-08T15:41:12.651344+0000","last_peered":"2023-10-08T15:41:12.651344+0000","last_clean":"2023-10-08T15:41:12.651344+0000","last_became_active":"2023-10-08T15:41:12.651124+0000","last_became_peered":"2023-10-08T15:41:12.651124+0000","last_unstale":"2023-10-08T15:41:12.651344+0000","last_undegraded":"2023-10-08T15:41:12.651344+0000","last_fullsized":"2023-10-08T15:41:12.651344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:40.936790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.675044+0000","last_change":"2023-10-08T15:41:11.644894+0000","last_active":"2023-10-08T15:41:12.675044+0000","last_peered":"2023-10-08T15:41:12.675044+0000","last_clean":"2023-10-08T15:41:12.675044+0000","last_became_active":"2023-10-08T15:41:11.644630+0000","last_became_peered":"2023-10-08T15:41:11.644630+0000","last_unstale":"2023-10-08T15:41:12.675044+0000","last_undegraded":"2023-10-08T15:41:12.675044+0000","last_fullsized":"2023-10-08T15:41:12.675044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:09.183464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.650892+0000","last_change":"2023-10-08T15:41:12.650892+0000","last_active":"2023-10-08T15:41:12.650892+0000","last_peered":"2023-10-08T15:41:12.650892+0000","last_clean":"2023-10-08T15:41:12.650892+0000","last_became_active":"2023-10-08T15:41:12.650651+0000","last_became_peered":"2023-10-08T15:41:12.650651+0000","last_unstale":"2023-10-08T15:41:12.650892+0000","last_undegraded":"2023-10-08T15:41:12.650892+0000","last_fullsized":"2023-10-08T15:41:12.650892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:47.151660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.669471+0000","last_change":"2023-10-08T15:41:11.639218+0000","last_active":"2023-10-08T15:41:12.669471+0000","last_peered":"2023-10-08T15:41:12.669471+0000","last_clean":"2023-10-08T15:41:12.669471+0000","last_became_active":"2023-10-08T15:41:11.638688+0000","last_became_peered":"2023-10-08T15:41:11.638688+0000","last_unstale":"2023-10-08T15:41:12.669471+0000","last_undegraded":"2023-10-08T15:41:12.669471+0000","last_fullsized":"2023-10-08T15:41:12.669471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:12.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659236+0000","last_change":"2023-10-08T15:41:12.659236+0000","last_active":"2023-10-08T15:41:12.659236+0000","last_peered":"2023-10-08T15:41:12.659236+0000","last_clean":"2023-10-08T15:41:12.659236+0000","last_became_active":"2023-10-08T15:41:12.658849+0000","last_became_peered":"2023-10-08T15:41:12.658849+0000","last_unstale":"2023-10-08T15:41:12.659236+0000","last_undegraded":"2023-10-08T15:41:12.659236+0000","last_fullsized":"2023-10-08T15:41:12.659236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:03.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.649108+0000","last_change":"2023-10-08T15:41:11.641471+0000","last_active":"2023-10-08T15:41:12.649108+0000","last_peered":"2023-10-08T15:41:12.649108+0000","last_clean":"2023-10-08T15:41:12.649108+0000","last_became_active":"2023-10-08T15:41:11.640227+0000","last_became_peered":"2023-10-08T15:41:11.640227+0000","last_unstale":"2023-10-08T15:41:12.649108+0000","last_undegraded":"2023-10-08T15:41:12.649108+0000","last_fullsized":"2023-10-08T15:41:12.649108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:21:31.605682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658575+0000","last_change":"2023-10-08T15:41:12.658575+0000","last_active":"2023-10-08T15:41:12.658575+0000","last_peered":"2023-10-08T15:41:12.658575+0000","last_clean":"2023-10-08T15:41:12.658575+0000","last_became_active":"2023-10-08T15:41:12.657149+0000","last_became_peered":"2023-10-08T15:41:12.657149+0000","last_unstale":"2023-10-08T15:41:12.658575+0000","last_undegraded":"2023-10-08T15:41:12.658575+0000","last_fullsized":"2023-10-08T15:41:12.658575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:53.272096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.648160+0000","last_change":"2023-10-08T15:41:11.640411+0000","last_active":"2023-10-08T15:41:12.648160+0000","last_peered":"2023-10-08T15:41:12.648160+0000","last_clean":"2023-10-08T15:41:12.648160+0000","last_became_active":"2023-10-08T15:41:11.639838+0000","last_became_peered":"2023-10-08T15:41:11.639838+0000","last_unstale":"2023-10-08T15:41:12.648160+0000","last_undegraded":"2023-10-08T15:41:12.648160+0000","last_fullsized":"2023-10-08T15:41:12.648160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:36.657183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661332+0000","last_change":"2023-10-08T15:41:12.661332+0000","last_active":"2023-10-08T15:41:12.661332+0000","last_peered":"2023-10-08T15:41:12.661332+0000","last_clean":"2023-10-08T15:41:12.661332+0000","last_became_active":"2023-10-08T15:41:12.661107+0000","last_became_peered":"2023-10-08T15:41:12.661107+0000","last_unstale":"2023-10-08T15:41:12.661332+0000","last_undegraded":"2023-10-08T15:41:12.661332+0000","last_fullsized":"2023-10-08T15:41:12.661332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:01:26.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643094+0000","last_change":"2023-10-08T15:41:11.643013+0000","last_active":"2023-10-08T15:41:11.643094+0000","last_peered":"2023-10-08T15:41:11.643094+0000","last_clean":"2023-10-08T15:41:11.643094+0000","last_became_active":"2023-10-08T15:41:11.642752+0000","last_became_peered":"2023-10-08T15:41:11.642752+0000","last_unstale":"2023-10-08T15:41:11.643094+0000","last_undegraded":"2023-10-08T15:41:11.643094+0000","last_fullsized":"2023-10-08T15:41:11.643094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:01.364676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.653172+0000","last_change":"2023-10-08T15:41:12.653172+0000","last_active":"2023-10-08T15:41:12.653172+0000","last_peered":"2023-10-08T15:41:12.653172+0000","last_clean":"2023-10-08T15:41:12.653172+0000","last_became_active":"2023-10-08T15:41:12.652711+0000","last_became_peered":"2023-10-08T15:41:12.652711+0000","last_unstale":"2023-10-08T15:41:12.653172+0000","last_undegraded":"2023-10-08T15:41:12.653172+0000","last_fullsized":"2023-10-08T15:41:12.653172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:53.102340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.645616+0000","last_change":"2023-10-08T15:41:11.645102+0000","last_active":"2023-10-08T15:41:11.645616+0000","last_peered":"2023-10-08T15:41:11.645616+0000","last_clean":"2023-10-08T15:41:11.645616+0000","last_became_active":"2023-10-08T15:41:11.644671+0000","last_became_peered":"2023-10-08T15:41:11.644671+0000","last_unstale":"2023-10-08T15:41:11.645616+0000","last_undegraded":"2023-10-08T15:41:11.645616+0000","last_fullsized":"2023-10-08T15:41:11.645616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657798+0000","last_change":"2023-10-08T15:41:12.657798+0000","last_active":"2023-10-08T15:41:12.657798+0000","last_peered":"2023-10-08T15:41:12.657798+0000","last_clean":"2023-10-08T15:41:12.657798+0000","last_became_active":"2023-10-08T15:41:12.656471+0000","last_became_peered":"2023-10-08T15:41:12.656471+0000","last_unstale":"2023-10-08T15:41:12.657798+0000","last_undegraded":"2023-10-08T15:41:12.657798+0000","last_fullsized":"2023-10-08T15:41:12.657798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:19.303260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.648215+0000","last_change":"2023-10-08T15:41:11.648143+0000","last_active":"2023-10-08T15:41:11.648215+0000","last_peered":"2023-10-08T15:41:11.648215+0000","last_clean":"2023-10-08T15:41:11.648215+0000","last_became_active":"2023-10-08T15:41:11.647663+0000","last_became_peered":"2023-10-08T15:41:11.647663+0000","last_unstale":"2023-10-08T15:41:11.648215+0000","last_undegraded":"2023-10-08T15:41:11.648215+0000","last_fullsized":"2023-10-08T15:41:11.648215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:53.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655287+0000","last_change":"2023-10-08T15:41:12.655287+0000","last_active":"2023-10-08T15:41:12.655287+0000","last_peered":"2023-10-08T15:41:12.655287+0000","last_clean":"2023-10-08T15:41:12.655287+0000","last_became_active":"2023-10-08T15:41:12.655053+0000","last_became_peered":"2023-10-08T15:41:12.655053+0000","last_unstale":"2023-10-08T15:41:12.655287+0000","last_undegraded":"2023-10-08T15:41:12.655287+0000","last_fullsized":"2023-10-08T15:41:12.655287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:03.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.646727+0000","last_change":"2023-10-08T15:41:11.646678+0000","last_active":"2023-10-08T15:41:11.646727+0000","last_peered":"2023-10-08T15:41:11.646727+0000","last_clean":"2023-10-08T15:41:11.646727+0000","last_became_active":"2023-10-08T15:41:11.646441+0000","last_became_peered":"2023-10-08T15:41:11.646441+0000","last_unstale":"2023-10-08T15:41:11.646727+0000","last_undegraded":"2023-10-08T15:41:11.646727+0000","last_fullsized":"2023-10-08T15:41:11.646727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:48.720701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661243+0000","last_change":"2023-10-08T15:41:12.661243+0000","last_active":"2023-10-08T15:41:12.661243+0000","last_peered":"2023-10-08T15:41:12.661243+0000","last_clean":"2023-10-08T15:41:12.661243+0000","last_became_active":"2023-10-08T15:41:12.661022+0000","last_became_peered":"2023-10-08T15:41:12.661022+0000","last_unstale":"2023-10-08T15:41:12.661243+0000","last_undegraded":"2023-10-08T15:41:12.661243+0000","last_fullsized":"2023-10-08T15:41:12.661243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:11.626909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.671499+0000","last_change":"2023-10-08T15:41:11.647080+0000","last_active":"2023-10-08T15:41:12.671499+0000","last_peered":"2023-10-08T15:41:12.671499+0000","last_clean":"2023-10-08T15:41:12.671499+0000","last_became_active":"2023-10-08T15:41:11.646856+0000","last_became_peered":"2023-10-08T15:41:11.646856+0000","last_unstale":"2023-10-08T15:41:12.671499+0000","last_undegraded":"2023-10-08T15:41:12.671499+0000","last_fullsized":"2023-10-08T15:41:12.671499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:09.183464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662915+0000","last_change":"2023-10-08T15:41:12.662915+0000","last_active":"2023-10-08T15:41:12.662915+0000","last_peered":"2023-10-08T15:41:12.662915+0000","last_clean":"2023-10-08T15:41:12.662915+0000","last_became_active":"2023-10-08T15:41:12.662706+0000","last_became_peered":"2023-10-08T15:41:12.662706+0000","last_unstale":"2023-10-08T15:41:12.662915+0000","last_undegraded":"2023-10-08T15:41:12.662915+0000","last_fullsized":"2023-10-08T15:41:12.662915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:17.013674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.675811+0000","last_change":"2023-10-08T15:41:11.647297+0000","last_active":"2023-10-08T15:41:12.675811+0000","last_peered":"2023-10-08T15:41:12.675811+0000","last_clean":"2023-10-08T15:41:12.675811+0000","last_became_active":"2023-10-08T15:41:11.646360+0000","last_became_peered":"2023-10-08T15:41:11.646360+0000","last_unstale":"2023-10-08T15:41:12.675811+0000","last_undegraded":"2023-10-08T15:41:12.675811+0000","last_fullsized":"2023-10-08T15:41:12.675811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:46.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.654266+0000","last_change":"2023-10-08T15:41:12.654266+0000","last_active":"2023-10-08T15:41:12.654266+0000","last_peered":"2023-10-08T15:41:12.654266+0000","last_clean":"2023-10-08T15:41:12.654266+0000","last_became_active":"2023-10-08T15:41:12.653512+0000","last_became_peered":"2023-10-08T15:41:12.653512+0000","last_unstale":"2023-10-08T15:41:12.654266+0000","last_undegraded":"2023-10-08T15:41:12.654266+0000","last_fullsized":"2023-10-08T15:41:12.654266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:01:26.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.670818+0000","last_change":"2023-10-08T15:41:11.644927+0000","last_active":"2023-10-08T15:41:12.670818+0000","last_peered":"2023-10-08T15:41:12.670818+0000","last_clean":"2023-10-08T15:41:12.670818+0000","last_became_active":"2023-10-08T15:41:11.644349+0000","last_became_peered":"2023-10-08T15:41:11.644349+0000","last_unstale":"2023-10-08T15:41:12.670818+0000","last_undegraded":"2023-10-08T15:41:12.670818+0000","last_fullsized":"2023-10-08T15:41:12.670818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:40.902826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.656535+0000","last_change":"2023-10-08T15:41:12.656535+0000","last_active":"2023-10-08T15:41:12.656535+0000","last_peered":"2023-10-08T15:41:12.656535+0000","last_clean":"2023-10-08T15:41:12.656535+0000","last_became_active":"2023-10-08T15:41:12.656313+0000","last_became_peered":"2023-10-08T15:41:12.656313+0000","last_unstale":"2023-10-08T15:41:12.656535+0000","last_undegraded":"2023-10-08T15:41:12.656535+0000","last_fullsized":"2023-10-08T15:41:12.656535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:04:45.812538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.642211+0000","last_change":"2023-10-08T15:41:11.642140+0000","last_active":"2023-10-08T15:41:11.642211+0000","last_peered":"2023-10-08T15:41:11.642211+0000","last_clean":"2023-10-08T15:41:11.642211+0000","last_became_active":"2023-10-08T15:41:11.641900+0000","last_became_peered":"2023-10-08T15:41:11.641900+0000","last_unstale":"2023-10-08T15:41:11.642211+0000","last_undegraded":"2023-10-08T15:41:11.642211+0000","last_fullsized":"2023-10-08T15:41:11.642211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659086+0000","last_change":"2023-10-08T15:41:12.659086+0000","last_active":"2023-10-08T15:41:12.659086+0000","last_peered":"2023-10-08T15:41:12.659086+0000","last_clean":"2023-10-08T15:41:12.659086+0000","last_became_active":"2023-10-08T15:41:12.658507+0000","last_became_peered":"2023-10-08T15:41:12.658507+0000","last_unstale":"2023-10-08T15:41:12.659086+0000","last_undegraded":"2023-10-08T15:41:12.659086+0000","last_fullsized":"2023-10-08T15:41:12.659086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:17.813719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.646180+0000","last_change":"2023-10-08T15:41:11.646123+0000","last_active":"2023-10-08T15:41:11.646180+0000","last_peered":"2023-10-08T15:41:11.646180+0000","last_clean":"2023-10-08T15:41:11.646180+0000","last_became_active":"2023-10-08T15:41:11.645877+0000","last_became_peered":"2023-10-08T15:41:11.645877+0000","last_unstale":"2023-10-08T15:41:11.646180+0000","last_undegraded":"2023-10-08T15:41:11.646180+0000","last_fullsized":"2023-10-08T15:41:11.646180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:50.424720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.660329+0000","last_change":"2023-10-08T15:41:12.660329+0000","last_active":"2023-10-08T15:41:12.660329+0000","last_peered":"2023-10-08T15:41:12.660329+0000","last_clean":"2023-10-08T15:41:12.660329+0000","last_became_active":"2023-10-08T15:41:12.660068+0000","last_became_peered":"2023-10-08T15:41:12.660068+0000","last_unstale":"2023-10-08T15:41:12.660329+0000","last_undegraded":"2023-10-08T15:41:12.660329+0000","last_fullsized":"2023-10-08T15:41:12.660329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:48.959442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.675298+0000","last_change":"2023-10-08T15:41:11.645155+0000","last_active":"2023-10-08T15:41:12.675298+0000","last_peered":"2023-10-08T15:41:12.675298+0000","last_clean":"2023-10-08T15:41:12.675298+0000","last_became_active":"2023-10-08T15:41:11.644731+0000","last_became_peered":"2023-10-08T15:41:11.644731+0000","last_unstale":"2023-10-08T15:41:12.675298+0000","last_undegraded":"2023-10-08T15:41:12.675298+0000","last_fullsized":"2023-10-08T15:41:12.675298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:04:53.270699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657301+0000","last_change":"2023-10-08T15:41:12.657301+0000","last_active":"2023-10-08T15:41:12.657301+0000","last_peered":"2023-10-08T15:41:12.657301+0000","last_clean":"2023-10-08T15:41:12.657301+0000","last_became_active":"2023-10-08T15:41:12.657064+0000","last_became_peered":"2023-10-08T15:41:12.657064+0000","last_unstale":"2023-10-08T15:41:12.657301+0000","last_undegraded":"2023-10-08T15:41:12.657301+0000","last_fullsized":"2023-10-08T15:41:12.657301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:53.102340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.646859+0000","last_change":"2023-10-08T15:41:11.645030+0000","last_active":"2023-10-08T15:41:12.646859+0000","last_peered":"2023-10-08T15:41:12.646859+0000","last_clean":"2023-10-08T15:41:12.646859+0000","last_became_active":"2023-10-08T15:41:11.644808+0000","last_became_peered":"2023-10-08T15:41:11.644808+0000","last_unstale":"2023-10-08T15:41:12.646859+0000","last_undegraded":"2023-10-08T15:41:12.646859+0000","last_fullsized":"2023-10-08T15:41:12.646859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:40.902826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.654508+0000","last_change":"2023-10-08T15:41:12.654508+0000","last_active":"2023-10-08T15:41:12.654508+0000","last_peered":"2023-10-08T15:41:12.654508+0000","last_clean":"2023-10-08T15:41:12.654508+0000","last_became_active":"2023-10-08T15:41:12.654268+0000","last_became_peered":"2023-10-08T15:41:12.654268+0000","last_unstale":"2023-10-08T15:41:12.654508+0000","last_undegraded":"2023-10-08T15:41:12.654508+0000","last_fullsized":"2023-10-08T15:41:12.654508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:11.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.670568+0000","last_change":"2023-10-08T15:41:11.642441+0000","last_active":"2023-10-08T15:41:12.670568+0000","last_peered":"2023-10-08T15:41:12.670568+0000","last_clean":"2023-10-08T15:41:12.670568+0000","last_became_active":"2023-10-08T15:41:11.642213+0000","last_became_peered":"2023-10-08T15:41:11.642213+0000","last_unstale":"2023-10-08T15:41:12.670568+0000","last_undegraded":"2023-10-08T15:41:12.670568+0000","last_fullsized":"2023-10-08T15:41:12.670568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.174103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.650141+0000","last_change":"2023-10-08T15:41:12.650141+0000","last_active":"2023-10-08T15:41:12.650141+0000","last_peered":"2023-10-08T15:41:12.650141+0000","last_clean":"2023-10-08T15:41:12.650141+0000","last_became_active":"2023-10-08T15:41:12.649731+0000","last_became_peered":"2023-10-08T15:41:12.649731+0000","last_unstale":"2023-10-08T15:41:12.650141+0000","last_undegraded":"2023-10-08T15:41:12.650141+0000","last_fullsized":"2023-10-08T15:41:12.650141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:40.936790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.648866+0000","last_change":"2023-10-08T15:41:11.638519+0000","last_active":"2023-10-08T15:41:12.648866+0000","last_peered":"2023-10-08T15:41:12.648866+0000","last_clean":"2023-10-08T15:41:12.648866+0000","last_became_active":"2023-10-08T15:41:11.638158+0000","last_became_peered":"2023-10-08T15:41:11.638158+0000","last_unstale":"2023-10-08T15:41:12.648866+0000","last_undegraded":"2023-10-08T15:41:12.648866+0000","last_fullsized":"2023-10-08T15:41:12.648866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:48:41.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659552+0000","last_change":"2023-10-08T15:41:12.659552+0000","last_active":"2023-10-08T15:41:12.659552+0000","last_peered":"2023-10-08T15:41:12.659552+0000","last_clean":"2023-10-08T15:41:12.659552+0000","last_became_active":"2023-10-08T15:41:12.659368+0000","last_became_peered":"2023-10-08T15:41:12.659368+0000","last_unstale":"2023-10-08T15:41:12.659552+0000","last_undegraded":"2023-10-08T15:41:12.659552+0000","last_fullsized":"2023-10-08T15:41:12.659552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:51.993491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.641686+0000","last_change":"2023-10-08T15:41:11.641612+0000","last_active":"2023-10-08T15:41:11.641686+0000","last_peered":"2023-10-08T15:41:11.641686+0000","last_clean":"2023-10-08T15:41:11.641686+0000","last_became_active":"2023-10-08T15:41:11.641238+0000","last_became_peered":"2023-10-08T15:41:11.641238+0000","last_unstale":"2023-10-08T15:41:11.641686+0000","last_undegraded":"2023-10-08T15:41:11.641686+0000","last_fullsized":"2023-10-08T15:41:11.641686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:45.294450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.650856+0000","last_change":"2023-10-08T15:41:12.650856+0000","last_active":"2023-10-08T15:41:12.650856+0000","last_peered":"2023-10-08T15:41:12.650856+0000","last_clean":"2023-10-08T15:41:12.650856+0000","last_became_active":"2023-10-08T15:41:12.650618+0000","last_became_peered":"2023-10-08T15:41:12.650618+0000","last_unstale":"2023-10-08T15:41:12.650856+0000","last_undegraded":"2023-10-08T15:41:12.650856+0000","last_fullsized":"2023-10-08T15:41:12.650856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:10.141069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.671317+0000","last_change":"2023-10-08T15:41:11.643166+0000","last_active":"2023-10-08T15:41:12.671317+0000","last_peered":"2023-10-08T15:41:12.671317+0000","last_clean":"2023-10-08T15:41:12.671317+0000","last_became_active":"2023-10-08T15:41:11.642797+0000","last_became_peered":"2023-10-08T15:41:11.642797+0000","last_unstale":"2023-10-08T15:41:12.671317+0000","last_undegraded":"2023-10-08T15:41:12.671317+0000","last_fullsized":"2023-10-08T15:41:12.671317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:21.261112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.656958+0000","last_change":"2023-10-08T15:41:12.656958+0000","last_active":"2023-10-08T15:41:12.656958+0000","last_peered":"2023-10-08T15:41:12.656958+0000","last_clean":"2023-10-08T15:41:12.656958+0000","last_became_active":"2023-10-08T15:41:12.656720+0000","last_became_peered":"2023-10-08T15:41:12.656720+0000","last_unstale":"2023-10-08T15:41:12.656958+0000","last_undegraded":"2023-10-08T15:41:12.656958+0000","last_fullsized":"2023-10-08T15:41:12.656958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:41.907418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.646285+0000","last_change":"2023-10-08T15:41:11.646217+0000","last_active":"2023-10-08T15:41:11.646285+0000","last_peered":"2023-10-08T15:41:11.646285+0000","last_clean":"2023-10-08T15:41:11.646285+0000","last_became_active":"2023-10-08T15:41:11.645964+0000","last_became_peered":"2023-10-08T15:41:11.645964+0000","last_unstale":"2023-10-08T15:41:11.646285+0000","last_undegraded":"2023-10-08T15:41:11.646285+0000","last_fullsized":"2023-10-08T15:41:11.646285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:40.902826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658291+0000","last_change":"2023-10-08T15:41:12.658291+0000","last_active":"2023-10-08T15:41:12.658291+0000","last_peered":"2023-10-08T15:41:12.658291+0000","last_clean":"2023-10-08T15:41:12.658291+0000","last_became_active":"2023-10-08T15:41:12.657908+0000","last_became_peered":"2023-10-08T15:41:12.657908+0000","last_unstale":"2023-10-08T15:41:12.658291+0000","last_undegraded":"2023-10-08T15:41:12.658291+0000","last_fullsized":"2023-10-08T15:41:12.658291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:46.178694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.645631+0000","last_change":"2023-10-08T15:41:11.645537+0000","last_active":"2023-10-08T15:41:11.645631+0000","last_peered":"2023-10-08T15:41:11.645631+0000","last_clean":"2023-10-08T15:41:11.645631+0000","last_became_active":"2023-10-08T15:41:11.645317+0000","last_became_peered":"2023-10-08T15:41:11.645317+0000","last_unstale":"2023-10-08T15:41:11.645631+0000","last_undegraded":"2023-10-08T15:41:11.645631+0000","last_fullsized":"2023-10-08T15:41:11.645631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:09.136478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659615+0000","last_change":"2023-10-08T15:41:12.659615+0000","last_active":"2023-10-08T15:41:12.659615+0000","last_peered":"2023-10-08T15:41:12.659615+0000","last_clean":"2023-10-08T15:41:12.659615+0000","last_became_active":"2023-10-08T15:41:12.659098+0000","last_became_peered":"2023-10-08T15:41:12.659098+0000","last_unstale":"2023-10-08T15:41:12.659615+0000","last_undegraded":"2023-10-08T15:41:12.659615+0000","last_fullsized":"2023-10-08T15:41:12.659615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:31:08.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.646202+0000","last_change":"2023-10-08T15:41:11.646134+0000","last_active":"2023-10-08T15:41:11.646202+0000","last_peered":"2023-10-08T15:41:11.646202+0000","last_clean":"2023-10-08T15:41:11.646202+0000","last_became_active":"2023-10-08T15:41:11.645897+0000","last_became_peered":"2023-10-08T15:41:11.645897+0000","last_unstale":"2023-10-08T15:41:11.646202+0000","last_undegraded":"2023-10-08T15:41:11.646202+0000","last_fullsized":"2023-10-08T15:41:11.646202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:46.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658130+0000","last_change":"2023-10-08T15:41:12.658130+0000","last_active":"2023-10-08T15:41:12.658130+0000","last_peered":"2023-10-08T15:41:12.658130+0000","last_clean":"2023-10-08T15:41:12.658130+0000","last_became_active":"2023-10-08T15:41:12.657695+0000","last_became_peered":"2023-10-08T15:41:12.657695+0000","last_unstale":"2023-10-08T15:41:12.658130+0000","last_undegraded":"2023-10-08T15:41:12.658130+0000","last_fullsized":"2023-10-08T15:41:12.658130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:03.572229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.669633+0000","last_change":"2023-10-08T15:41:11.640870+0000","last_active":"2023-10-08T15:41:12.669633+0000","last_peered":"2023-10-08T15:41:12.669633+0000","last_clean":"2023-10-08T15:41:12.669633+0000","last_became_active":"2023-10-08T15:41:11.640604+0000","last_became_peered":"2023-10-08T15:41:11.640604+0000","last_unstale":"2023-10-08T15:41:12.669633+0000","last_undegraded":"2023-10-08T15:41:12.669633+0000","last_fullsized":"2023-10-08T15:41:12.669633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:48.720701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658757+0000","last_change":"2023-10-08T15:41:12.658757+0000","last_active":"2023-10-08T15:41:12.658757+0000","last_peered":"2023-10-08T15:41:12.658757+0000","last_clean":"2023-10-08T15:41:12.658757+0000","last_became_active":"2023-10-08T15:41:12.657526+0000","last_became_peered":"2023-10-08T15:41:12.657526+0000","last_unstale":"2023-10-08T15:41:12.658757+0000","last_undegraded":"2023-10-08T15:41:12.658757+0000","last_fullsized":"2023-10-08T15:41:12.658757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:04:45.812538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643287+0000","last_change":"2023-10-08T15:41:11.643032+0000","last_active":"2023-10-08T15:41:11.643287+0000","last_peered":"2023-10-08T15:41:11.643287+0000","last_clean":"2023-10-08T15:41:11.643287+0000","last_became_active":"2023-10-08T15:41:11.642510+0000","last_became_peered":"2023-10-08T15:41:11.642510+0000","last_unstale":"2023-10-08T15:41:11.643287+0000","last_undegraded":"2023-10-08T15:41:11.643287+0000","last_fullsized":"2023-10-08T15:41:11.643287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:40.902826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662754+0000","last_change":"2023-10-08T15:41:12.662754+0000","last_active":"2023-10-08T15:41:12.662754+0000","last_peered":"2023-10-08T15:41:12.662754+0000","last_clean":"2023-10-08T15:41:12.662754+0000","last_became_active":"2023-10-08T15:41:12.662539+0000","last_became_peered":"2023-10-08T15:41:12.662539+0000","last_unstale":"2023-10-08T15:41:12.662754+0000","last_undegraded":"2023-10-08T15:41:12.662754+0000","last_fullsized":"2023-10-08T15:41:12.662754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:31.957245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.644437+0000","last_change":"2023-10-08T15:41:11.644200+0000","last_active":"2023-10-08T15:41:11.644437+0000","last_peered":"2023-10-08T15:41:11.644437+0000","last_clean":"2023-10-08T15:41:11.644437+0000","last_became_active":"2023-10-08T15:41:11.643749+0000","last_became_peered":"2023-10-08T15:41:11.643749+0000","last_unstale":"2023-10-08T15:41:11.644437+0000","last_undegraded":"2023-10-08T15:41:11.644437+0000","last_fullsized":"2023-10-08T15:41:11.644437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.174103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657182+0000","last_change":"2023-10-08T15:41:12.657182+0000","last_active":"2023-10-08T15:41:12.657182+0000","last_peered":"2023-10-08T15:41:12.657182+0000","last_clean":"2023-10-08T15:41:12.657182+0000","last_became_active":"2023-10-08T15:41:12.656923+0000","last_became_peered":"2023-10-08T15:41:12.656923+0000","last_unstale":"2023-10-08T15:41:12.657182+0000","last_undegraded":"2023-10-08T15:41:12.657182+0000","last_fullsized":"2023-10-08T15:41:12.657182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:47.971290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643843+0000","last_change":"2023-10-08T15:41:11.643703+0000","last_active":"2023-10-08T15:41:11.643843+0000","last_peered":"2023-10-08T15:41:11.643843+0000","last_clean":"2023-10-08T15:41:11.643843+0000","last_became_active":"2023-10-08T15:41:11.643535+0000","last_became_peered":"2023-10-08T15:41:11.643535+0000","last_unstale":"2023-10-08T15:41:11.643843+0000","last_undegraded":"2023-10-08T15:41:11.643843+0000","last_fullsized":"2023-10-08T15:41:11.643843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655948+0000","last_change":"2023-10-08T15:41:12.655948+0000","last_active":"2023-10-08T15:41:12.655948+0000","last_peered":"2023-10-08T15:41:12.655948+0000","last_clean":"2023-10-08T15:41:12.655948+0000","last_became_active":"2023-10-08T15:41:12.655547+0000","last_became_peered":"2023-10-08T15:41:12.655547+0000","last_unstale":"2023-10-08T15:41:12.655948+0000","last_undegraded":"2023-10-08T15:41:12.655948+0000","last_fullsized":"2023-10-08T15:41:12.655948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:48.959442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643072+0000","last_change":"2023-10-08T15:41:11.643006+0000","last_active":"2023-10-08T15:41:11.643072+0000","last_peered":"2023-10-08T15:41:11.643072+0000","last_clean":"2023-10-08T15:41:11.643072+0000","last_became_active":"2023-10-08T15:41:11.642739+0000","last_became_peered":"2023-10-08T15:41:11.642739+0000","last_unstale":"2023-10-08T15:41:11.643072+0000","last_undegraded":"2023-10-08T15:41:11.643072+0000","last_fullsized":"2023-10-08T15:41:11.643072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:21.261112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659213+0000","last_change":"2023-10-08T15:41:12.659213+0000","last_active":"2023-10-08T15:41:12.659213+0000","last_peered":"2023-10-08T15:41:12.659213+0000","last_clean":"2023-10-08T15:41:12.659213+0000","last_became_active":"2023-10-08T15:41:12.658589+0000","last_became_peered":"2023-10-08T15:41:12.658589+0000","last_unstale":"2023-10-08T15:41:12.659213+0000","last_undegraded":"2023-10-08T15:41:12.659213+0000","last_fullsized":"2023-10-08T15:41:12.659213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:02.196851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.640656+0000","last_change":"2023-10-08T15:41:11.640578+0000","last_active":"2023-10-08T15:41:11.640656+0000","last_peered":"2023-10-08T15:41:11.640656+0000","last_clean":"2023-10-08T15:41:11.640656+0000","last_became_active":"2023-10-08T15:41:11.640166+0000","last_became_peered":"2023-10-08T15:41:11.640166+0000","last_unstale":"2023-10-08T15:41:11.640656+0000","last_undegraded":"2023-10-08T15:41:11.640656+0000","last_fullsized":"2023-10-08T15:41:11.640656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:55.448831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657211+0000","last_change":"2023-10-08T15:41:12.657211+0000","last_active":"2023-10-08T15:41:12.657211+0000","last_peered":"2023-10-08T15:41:12.657211+0000","last_clean":"2023-10-08T15:41:12.657211+0000","last_became_active":"2023-10-08T15:41:12.656452+0000","last_became_peered":"2023-10-08T15:41:12.656452+0000","last_unstale":"2023-10-08T15:41:12.657211+0000","last_undegraded":"2023-10-08T15:41:12.657211+0000","last_fullsized":"2023-10-08T15:41:12.657211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.429312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.647509+0000","last_change":"2023-10-08T15:41:11.647434+0000","last_active":"2023-10-08T15:41:11.647509+0000","last_peered":"2023-10-08T15:41:11.647509+0000","last_clean":"2023-10-08T15:41:11.647509+0000","last_became_active":"2023-10-08T15:41:11.647161+0000","last_became_peered":"2023-10-08T15:41:11.647161+0000","last_unstale":"2023-10-08T15:41:11.647509+0000","last_undegraded":"2023-10-08T15:41:11.647509+0000","last_fullsized":"2023-10-08T15:41:11.647509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:39.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658688+0000","last_change":"2023-10-08T15:41:12.658688+0000","last_active":"2023-10-08T15:41:12.658688+0000","last_peered":"2023-10-08T15:41:12.658688+0000","last_clean":"2023-10-08T15:41:12.658688+0000","last_became_active":"2023-10-08T15:41:12.658250+0000","last_became_peered":"2023-10-08T15:41:12.658250+0000","last_unstale":"2023-10-08T15:41:12.658688+0000","last_undegraded":"2023-10-08T15:41:12.658688+0000","last_fullsized":"2023-10-08T15:41:12.658688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:53.272096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.645476+0000","last_change":"2023-10-08T15:41:11.645425+0000","last_active":"2023-10-08T15:41:11.645476+0000","last_peered":"2023-10-08T15:41:11.645476+0000","last_clean":"2023-10-08T15:41:11.645476+0000","last_became_active":"2023-10-08T15:41:11.645166+0000","last_became_peered":"2023-10-08T15:41:11.645166+0000","last_unstale":"2023-10-08T15:41:11.645476+0000","last_undegraded":"2023-10-08T15:41:11.645476+0000","last_fullsized":"2023-10-08T15:41:11.645476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643499+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:41:11.643499+0000","last_peered":"2023-10-08T15:41:11.643499+0000","last_clean":"2023-10-08T15:41:11.643499+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:41:11.643499+0000","last_undegraded":"2023-10-08T15:41:11.643499+0000","last_fullsized":"2023-10-08T15:41:11.643499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":700,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194611,"statfs":{"total":200000000,"available":199282276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":125,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195186,"statfs":{"total":200000000,"available":199871176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194618,"statfs":{"total":200000000,"available":199289129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.24199999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.8260000000000001,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.317},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.432}]},{"osd":5,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.504}]},{"osd":6,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.49299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.376},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.254},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32800000000000001}]},{"osd":4,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.501},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52700000000000002}]},{"osd":6,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51100000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[]}} 2023-10-08T15:41:16.764 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:41:16.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.919+0000 7feddfa0b700 1 Processor -- start 2023-10-08T15:41:16.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.919+0000 7feddfa0b700 1 -- start start 2023-10-08T15:41:16.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7feddfa0b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd815a710 0x7fedd80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7feddfa0b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd8067800 con 0x7fedd8070700 2023-10-08T15:41:16.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7feddfa0b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd8067ae0 con 0x7fedd806f5c0 2023-10-08T15:41:16.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7feddfa0b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8067dc0 con 0x7fedd815a710 2023-10-08T15:41:16.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7fedddfa8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fedd8070700 0x7fedd80c9800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56072/0 (socket says 172.21.15.29:56072) 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7fedddfa8700 1 -- 172.21.15.29:0/364739272 learned_addr learned my addr 172.21.15.29:0/364739272 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7feddd7a7700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd815a710 0x7fedd80688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663710478 0 0) 0x7fedd8067800 con 0x7fedd8070700 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.920+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc0003570 con 0x7fedd8070700 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 364741717 0 0) 0x7fedc0003570 con 0x7fedd8070700 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd815a710 msgr2=0x7fedd80688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd815a710 0x7fedd80688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 >> v1:172.21.15.183:6789/0 conn(0x7fedd806f5c0 legacy=0x7fedd815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd80680a0 con 0x7fedd8070700 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fedc80017f0 con 0x7fedd8070700 2023-10-08T15:41:16.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 >> v1:172.21.15.29:6789/0 conn(0x7fedd8070700 legacy=0x7fedd80c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedc0003a90 0x7fedc0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd815a710 0x7fedc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc0004d50 0x7fedc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8067dc0 con 0x7fedc0004d50 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc000bb10 con 0x7fedc0003a90 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc000bcd0 con 0x7fedd815a710 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedddfa8700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc0004d50 0x7fedc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7feddd7a7700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedc0003a90 0x7fedc0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7feddcfa6700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd815a710 0x7fedc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedddfa8700 1 -- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd815a710 msgr2=0x7fedc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:16.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedddfa8700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd815a710 0x7fedc0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedddfa8700 1 -- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedc0003a90 msgr2=0x7fedc0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedddfa8700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedc0003a90 0x7fedc0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedddfa8700 1 -- 172.21.15.29:0/364739272 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0003570 con 0x7fedc0004d50 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedddfa8700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc0004d50 0x7fedc00051c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fedc800a950 tx=0x7fedc80021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbc3a7736551fae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc80070d0 con 0x7fedc0004d50 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc8007230 con 0x7fedc0004d50 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.921+0000 7fedd7fff700 1 -- 172.21.15.29:0/364739272 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc80075f0 con 0x7fedc0004d50 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.922+0000 7feddfa0b700 1 -- 172.21.15.29:0/364739272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc0004d50 msgr2=0x7fedc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.922+0000 7feddfa0b700 1 --2- 172.21.15.29:0/364739272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc0004d50 0x7fedc00051c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fedc800a950 tx=0x7fedc80021f0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.922+0000 7fedddfa8700 1 -- 172.21.15.29:0/364739272 reap_dead start 2023-10-08T15:41:16.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.922+0000 7feddfa0b700 1 -- 172.21.15.29:0/364739272 shutdown_connections 2023-10-08T15:41:16.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.922+0000 7feddfa0b700 1 -- 172.21.15.29:0/364739272 >> 172.21.15.29:0/364739272 conn(0x7fedd806a250 msgr2=0x7fedd806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:16.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.922+0000 7feddfa0b700 1 -- 172.21.15.29:0/364739272 shutdown_connections 2023-10-08T15:41:16.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.922+0000 7feddfa0b700 1 -- 172.21.15.29:0/364739272 wait complete. 2023-10-08T15:41:16.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.923+0000 7feddfa0b700 1 Processor -- start 2023-10-08T15:41:16.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.923+0000 7feddfa0b700 1 -- start start 2023-10-08T15:41:16.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7feddfa0b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd80ad630 0x7fedd80c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7feddfa0b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd80b1590 0x7fedd80ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7feddfa0b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815c540 0x7fedd815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7feddfa0b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80ae530 con 0x7fedd815c540 2023-10-08T15:41:16.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7feddfa0b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd815c0b0 con 0x7fedd80ad630 2023-10-08T15:41:16.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7feddfa0b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80c5060 con 0x7fedd80b1590 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7fedddfa8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815c540 0x7fedd815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7fedddfa8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815c540 0x7fedd815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57228/0 (socket says 172.21.15.29:57228) 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7fedddfa8700 1 -- 172.21.15.29:0/2991856364 learned_addr learned my addr 172.21.15.29:0/2991856364 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7feddcfa6700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd80b1590 0x7fedd80ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7feddd7a7700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd80ad630 0x7fedd80c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7fedddfa8700 1 -- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd80b1590 msgr2=0x7fedd80ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7fedddfa8700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd80b1590 0x7fedd80ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7fedddfa8700 1 -- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd80ad630 msgr2=0x7fedd80c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7fedddfa8700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd80ad630 0x7fedd80c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.924+0000 7fedddfa8700 1 -- 172.21.15.29:0/2991856364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd80adf40 con 0x7fedd815c540 2023-10-08T15:41:16.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.925+0000 7fedddfa8700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815c540 0x7fedd815c9b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fedc800a410 tx=0x7fedc8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.925+0000 7fedd57fa700 1 -- 172.21.15.29:0/2991856364 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc801e450 con 0x7fedd815c540 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.925+0000 7fedd57fa700 1 -- 172.21.15.29:0/2991856364 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc801e5d0 con 0x7fedd815c540 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.925+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd80b3270 con 0x7fedd815c540 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.925+0000 7fedd57fa700 1 -- 172.21.15.29:0/2991856364 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc801e990 con 0x7fedd815c540 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.925+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd815ba60 con 0x7fedd815c540 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.926+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd815c260 con 0x7fedd815c540 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.926+0000 7fedd57fa700 1 -- 172.21.15.29:0/2991856364 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fedc801ed40 con 0x7fedd815c540 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.927+0000 7fedd57fa700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedc4066f30 0x7fedc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.927+0000 7fedd57fa700 1 -- 172.21.15.29:0/2991856364 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedc8086a20 con 0x7fedd815c540 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.927+0000 7feddd7a7700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedc4066f30 0x7fedc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.927+0000 7feddd7a7700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedc4066f30 0x7fedc40693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006f00 tx=0x7fedd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:16.931+0000 7fedd57fa700 1 -- 172.21.15.29:0/2991856364 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedd815c260 con 0x7fedd815c540 2023-10-08T15:41:17.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.117+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fedd815c260 con 0x7fedc4066f30 2023-10-08T15:41:17.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.125+0000 7fedd57fa700 1 -- 172.21.15.29:0/2991856364 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266219 (secure 0 0 0) 0x7fedd815c260 con 0x7fedc4066f30 2023-10-08T15:41:17.128 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:17.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedc4066f30 msgr2=0x7fedc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedc4066f30 0x7fedc40693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006f00 tx=0x7fedd0008040 comp rx=0 tx=0).stop 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815c540 msgr2=0x7fedd815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815c540 0x7fedd815c9b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fedc800a410 tx=0x7fedc8015000 comp rx=0 tx=0).stop 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 shutdown_connections 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fedc4066f30 0x7fedc40693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedd815c540 0x7fedd815c9b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd80ad630 0x7fedd80c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 --2- 172.21.15.29:0/2991856364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd80b1590 0x7fedd80ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 >> 172.21.15.29:0/2991856364 conn(0x7fedd806a250 msgr2=0x7fedd806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 shutdown_connections 2023-10-08T15:41:17.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.128+0000 7feddfa0b700 1 -- 172.21.15.29:0/2991856364 wait complete. 2023-10-08T15:41:17.132 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:41:17.140 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-08T15:41:16.314307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2109,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560390,"statfs":{"total":1600000000,"available":1597840066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672263"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661021+0000","last_change":"2023-10-08T15:41:12.661021+0000","last_active":"2023-10-08T15:41:12.661021+0000","last_peered":"2023-10-08T15:41:12.661021+0000","last_clean":"2023-10-08T15:41:12.661021+0000","last_became_active":"2023-10-08T15:41:12.658721+0000","last_became_peered":"2023-10-08T15:41:12.658721+0000","last_unstale":"2023-10-08T15:41:12.661021+0000","last_undegraded":"2023-10-08T15:41:12.661021+0000","last_fullsized":"2023-10-08T15:41:12.661021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:40.936790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657015+0000","last_change":"2023-10-08T15:41:12.657015+0000","last_active":"2023-10-08T15:41:12.657015+0000","last_peered":"2023-10-08T15:41:12.657015+0000","last_clean":"2023-10-08T15:41:12.657015+0000","last_became_active":"2023-10-08T15:41:12.656639+0000","last_became_peered":"2023-10-08T15:41:12.656639+0000","last_unstale":"2023-10-08T15:41:12.657015+0000","last_undegraded":"2023-10-08T15:41:12.657015+0000","last_fullsized":"2023-10-08T15:41:12.657015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:54.689846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655673+0000","last_change":"2023-10-08T15:41:12.655673+0000","last_active":"2023-10-08T15:41:12.655673+0000","last_peered":"2023-10-08T15:41:12.655673+0000","last_clean":"2023-10-08T15:41:12.655673+0000","last_became_active":"2023-10-08T15:41:12.652247+0000","last_became_peered":"2023-10-08T15:41:12.652247+0000","last_unstale":"2023-10-08T15:41:12.655673+0000","last_undegraded":"2023-10-08T15:41:12.655673+0000","last_fullsized":"2023-10-08T15:41:12.655673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:03.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.652966+0000","last_change":"2023-10-08T15:41:12.652966+0000","last_active":"2023-10-08T15:41:12.652966+0000","last_peered":"2023-10-08T15:41:12.652966+0000","last_clean":"2023-10-08T15:41:12.652966+0000","last_became_active":"2023-10-08T15:41:12.652319+0000","last_became_peered":"2023-10-08T15:41:12.652319+0000","last_unstale":"2023-10-08T15:41:12.652966+0000","last_undegraded":"2023-10-08T15:41:12.652966+0000","last_fullsized":"2023-10-08T15:41:12.652966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:39.043594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657025+0000","last_change":"2023-10-08T15:41:12.657025+0000","last_active":"2023-10-08T15:41:12.657025+0000","last_peered":"2023-10-08T15:41:12.657025+0000","last_clean":"2023-10-08T15:41:12.657025+0000","last_became_active":"2023-10-08T15:41:12.656162+0000","last_became_peered":"2023-10-08T15:41:12.656162+0000","last_unstale":"2023-10-08T15:41:12.657025+0000","last_undegraded":"2023-10-08T15:41:12.657025+0000","last_fullsized":"2023-10-08T15:41:12.657025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:22.265704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.660195+0000","last_change":"2023-10-08T15:41:12.660195+0000","last_active":"2023-10-08T15:41:12.660195+0000","last_peered":"2023-10-08T15:41:12.660195+0000","last_clean":"2023-10-08T15:41:12.660195+0000","last_became_active":"2023-10-08T15:41:12.660036+0000","last_became_peered":"2023-10-08T15:41:12.660036+0000","last_unstale":"2023-10-08T15:41:12.660195+0000","last_undegraded":"2023-10-08T15:41:12.660195+0000","last_fullsized":"2023-10-08T15:41:12.660195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:51.561758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662025+0000","last_change":"2023-10-08T15:41:12.662025+0000","last_active":"2023-10-08T15:41:12.662025+0000","last_peered":"2023-10-08T15:41:12.662025+0000","last_clean":"2023-10-08T15:41:12.662025+0000","last_became_active":"2023-10-08T15:41:12.661284+0000","last_became_peered":"2023-10-08T15:41:12.661284+0000","last_unstale":"2023-10-08T15:41:12.662025+0000","last_undegraded":"2023-10-08T15:41:12.662025+0000","last_fullsized":"2023-10-08T15:41:12.662025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:19.303260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657804+0000","last_change":"2023-10-08T15:41:12.657804+0000","last_active":"2023-10-08T15:41:12.657804+0000","last_peered":"2023-10-08T15:41:12.657804+0000","last_clean":"2023-10-08T15:41:12.657804+0000","last_became_active":"2023-10-08T15:41:12.657512+0000","last_became_peered":"2023-10-08T15:41:12.657512+0000","last_unstale":"2023-10-08T15:41:12.657804+0000","last_undegraded":"2023-10-08T15:41:12.657804+0000","last_fullsized":"2023-10-08T15:41:12.657804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:33.532228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.654992+0000","last_change":"2023-10-08T15:41:12.654992+0000","last_active":"2023-10-08T15:41:12.654992+0000","last_peered":"2023-10-08T15:41:12.654992+0000","last_clean":"2023-10-08T15:41:12.654992+0000","last_became_active":"2023-10-08T15:41:12.654685+0000","last_became_peered":"2023-10-08T15:41:12.654685+0000","last_unstale":"2023-10-08T15:41:12.654992+0000","last_undegraded":"2023-10-08T15:41:12.654992+0000","last_fullsized":"2023-10-08T15:41:12.654992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:47.151660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657203+0000","last_change":"2023-10-08T15:41:12.657203+0000","last_active":"2023-10-08T15:41:12.657203+0000","last_peered":"2023-10-08T15:41:12.657203+0000","last_clean":"2023-10-08T15:41:12.657203+0000","last_became_active":"2023-10-08T15:41:12.656659+0000","last_became_peered":"2023-10-08T15:41:12.656659+0000","last_unstale":"2023-10-08T15:41:12.657203+0000","last_undegraded":"2023-10-08T15:41:12.657203+0000","last_fullsized":"2023-10-08T15:41:12.657203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:31:08.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659038+0000","last_change":"2023-10-08T15:41:12.659038+0000","last_active":"2023-10-08T15:41:12.659038+0000","last_peered":"2023-10-08T15:41:12.659038+0000","last_clean":"2023-10-08T15:41:12.659038+0000","last_became_active":"2023-10-08T15:41:12.655502+0000","last_became_peered":"2023-10-08T15:41:12.655502+0000","last_unstale":"2023-10-08T15:41:12.659038+0000","last_undegraded":"2023-10-08T15:41:12.659038+0000","last_fullsized":"2023-10-08T15:41:12.659038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:51.561758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657958+0000","last_change":"2023-10-08T15:41:12.657958+0000","last_active":"2023-10-08T15:41:12.657958+0000","last_peered":"2023-10-08T15:41:12.657958+0000","last_clean":"2023-10-08T15:41:12.657958+0000","last_became_active":"2023-10-08T15:41:12.656857+0000","last_became_peered":"2023-10-08T15:41:12.656857+0000","last_unstale":"2023-10-08T15:41:12.657958+0000","last_undegraded":"2023-10-08T15:41:12.657958+0000","last_fullsized":"2023-10-08T15:41:12.657958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:51.561758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.664453+0000","last_change":"2023-10-08T15:41:12.664453+0000","last_active":"2023-10-08T15:41:12.664453+0000","last_peered":"2023-10-08T15:41:12.664453+0000","last_clean":"2023-10-08T15:41:12.664453+0000","last_became_active":"2023-10-08T15:41:12.664207+0000","last_became_peered":"2023-10-08T15:41:12.664207+0000","last_unstale":"2023-10-08T15:41:12.664453+0000","last_undegraded":"2023-10-08T15:41:12.664453+0000","last_fullsized":"2023-10-08T15:41:12.664453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:48.506737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659060+0000","last_change":"2023-10-08T15:41:12.659060+0000","last_active":"2023-10-08T15:41:12.659060+0000","last_peered":"2023-10-08T15:41:12.659060+0000","last_clean":"2023-10-08T15:41:12.659060+0000","last_became_active":"2023-10-08T15:41:12.658232+0000","last_became_peered":"2023-10-08T15:41:12.658232+0000","last_unstale":"2023-10-08T15:41:12.659060+0000","last_undegraded":"2023-10-08T15:41:12.659060+0000","last_fullsized":"2023-10-08T15:41:12.659060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:54.138449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659562+0000","last_change":"2023-10-08T15:41:12.659562+0000","last_active":"2023-10-08T15:41:12.659562+0000","last_peered":"2023-10-08T15:41:12.659562+0000","last_clean":"2023-10-08T15:41:12.659562+0000","last_became_active":"2023-10-08T15:41:12.659329+0000","last_became_peered":"2023-10-08T15:41:12.659329+0000","last_unstale":"2023-10-08T15:41:12.659562+0000","last_undegraded":"2023-10-08T15:41:12.659562+0000","last_fullsized":"2023-10-08T15:41:12.659562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:42.275778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661200+0000","last_change":"2023-10-08T15:41:12.661200+0000","last_active":"2023-10-08T15:41:12.661200+0000","last_peered":"2023-10-08T15:41:12.661200+0000","last_clean":"2023-10-08T15:41:12.661200+0000","last_became_active":"2023-10-08T15:41:12.660982+0000","last_became_peered":"2023-10-08T15:41:12.660982+0000","last_unstale":"2023-10-08T15:41:12.661200+0000","last_undegraded":"2023-10-08T15:41:12.661200+0000","last_fullsized":"2023-10-08T15:41:12.661200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:04:45.812538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662316+0000","last_change":"2023-10-08T15:41:12.662316+0000","last_active":"2023-10-08T15:41:12.662316+0000","last_peered":"2023-10-08T15:41:12.662316+0000","last_clean":"2023-10-08T15:41:12.662316+0000","last_became_active":"2023-10-08T15:41:12.661793+0000","last_became_peered":"2023-10-08T15:41:12.661793+0000","last_unstale":"2023-10-08T15:41:12.662316+0000","last_undegraded":"2023-10-08T15:41:12.662316+0000","last_fullsized":"2023-10-08T15:41:12.662316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:42.275778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662765+0000","last_change":"2023-10-08T15:41:12.662765+0000","last_active":"2023-10-08T15:41:12.662765+0000","last_peered":"2023-10-08T15:41:12.662765+0000","last_clean":"2023-10-08T15:41:12.662765+0000","last_became_active":"2023-10-08T15:41:12.662570+0000","last_became_peered":"2023-10-08T15:41:12.662570+0000","last_unstale":"2023-10-08T15:41:12.662765+0000","last_undegraded":"2023-10-08T15:41:12.662765+0000","last_fullsized":"2023-10-08T15:41:12.662765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:17.813719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655392+0000","last_change":"2023-10-08T15:41:12.655392+0000","last_active":"2023-10-08T15:41:12.655392+0000","last_peered":"2023-10-08T15:41:12.655392+0000","last_clean":"2023-10-08T15:41:12.655392+0000","last_became_active":"2023-10-08T15:41:12.655146+0000","last_became_peered":"2023-10-08T15:41:12.655146+0000","last_unstale":"2023-10-08T15:41:12.655392+0000","last_undegraded":"2023-10-08T15:41:12.655392+0000","last_fullsized":"2023-10-08T15:41:12.655392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:35.052726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658150+0000","last_change":"2023-10-08T15:41:12.658150+0000","last_active":"2023-10-08T15:41:12.658150+0000","last_peered":"2023-10-08T15:41:12.658150+0000","last_clean":"2023-10-08T15:41:12.658150+0000","last_became_active":"2023-10-08T15:41:12.657747+0000","last_became_peered":"2023-10-08T15:41:12.657747+0000","last_unstale":"2023-10-08T15:41:12.658150+0000","last_undegraded":"2023-10-08T15:41:12.658150+0000","last_fullsized":"2023-10-08T15:41:12.658150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:49.725292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662345+0000","last_change":"2023-10-08T15:41:12.662345+0000","last_active":"2023-10-08T15:41:12.662345+0000","last_peered":"2023-10-08T15:41:12.662345+0000","last_clean":"2023-10-08T15:41:12.662345+0000","last_became_active":"2023-10-08T15:41:12.656818+0000","last_became_peered":"2023-10-08T15:41:12.656818+0000","last_unstale":"2023-10-08T15:41:12.662345+0000","last_undegraded":"2023-10-08T15:41:12.662345+0000","last_fullsized":"2023-10-08T15:41:12.662345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:02.369267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655831+0000","last_change":"2023-10-08T15:41:12.655831+0000","last_active":"2023-10-08T15:41:12.655831+0000","last_peered":"2023-10-08T15:41:12.655831+0000","last_clean":"2023-10-08T15:41:12.655831+0000","last_became_active":"2023-10-08T15:41:12.655451+0000","last_became_peered":"2023-10-08T15:41:12.655451+0000","last_unstale":"2023-10-08T15:41:12.655831+0000","last_undegraded":"2023-10-08T15:41:12.655831+0000","last_fullsized":"2023-10-08T15:41:12.655831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:54.721532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661934+0000","last_change":"2023-10-08T15:41:12.661934+0000","last_active":"2023-10-08T15:41:12.661934+0000","last_peered":"2023-10-08T15:41:12.661934+0000","last_clean":"2023-10-08T15:41:12.661934+0000","last_became_active":"2023-10-08T15:41:12.661706+0000","last_became_peered":"2023-10-08T15:41:12.661706+0000","last_unstale":"2023-10-08T15:41:12.661934+0000","last_undegraded":"2023-10-08T15:41:12.661934+0000","last_fullsized":"2023-10-08T15:41:12.661934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:02.369267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.656996+0000","last_change":"2023-10-08T15:41:12.656996+0000","last_active":"2023-10-08T15:41:12.656996+0000","last_peered":"2023-10-08T15:41:12.656996+0000","last_clean":"2023-10-08T15:41:12.656996+0000","last_became_active":"2023-10-08T15:41:12.656748+0000","last_became_peered":"2023-10-08T15:41:12.656748+0000","last_unstale":"2023-10-08T15:41:12.656996+0000","last_undegraded":"2023-10-08T15:41:12.656996+0000","last_fullsized":"2023-10-08T15:41:12.656996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:18:51.820488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657348+0000","last_change":"2023-10-08T15:41:12.657348+0000","last_active":"2023-10-08T15:41:12.657348+0000","last_peered":"2023-10-08T15:41:12.657348+0000","last_clean":"2023-10-08T15:41:12.657348+0000","last_became_active":"2023-10-08T15:41:12.656980+0000","last_became_peered":"2023-10-08T15:41:12.656980+0000","last_unstale":"2023-10-08T15:41:12.657348+0000","last_undegraded":"2023-10-08T15:41:12.657348+0000","last_fullsized":"2023-10-08T15:41:12.657348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:11.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661318+0000","last_change":"2023-10-08T15:41:12.661318+0000","last_active":"2023-10-08T15:41:12.661318+0000","last_peered":"2023-10-08T15:41:12.661318+0000","last_clean":"2023-10-08T15:41:12.661318+0000","last_became_active":"2023-10-08T15:41:12.661102+0000","last_became_peered":"2023-10-08T15:41:12.661102+0000","last_unstale":"2023-10-08T15:41:12.661318+0000","last_undegraded":"2023-10-08T15:41:12.661318+0000","last_fullsized":"2023-10-08T15:41:12.661318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:33.532228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.650219+0000","last_change":"2023-10-08T15:41:12.650219+0000","last_active":"2023-10-08T15:41:12.650219+0000","last_peered":"2023-10-08T15:41:12.650219+0000","last_clean":"2023-10-08T15:41:12.650219+0000","last_became_active":"2023-10-08T15:41:12.649994+0000","last_became_peered":"2023-10-08T15:41:12.649994+0000","last_unstale":"2023-10-08T15:41:12.650219+0000","last_undegraded":"2023-10-08T15:41:12.650219+0000","last_fullsized":"2023-10-08T15:41:12.650219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:02.369267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657764+0000","last_change":"2023-10-08T15:41:12.657764+0000","last_active":"2023-10-08T15:41:12.657764+0000","last_peered":"2023-10-08T15:41:12.657764+0000","last_clean":"2023-10-08T15:41:12.657764+0000","last_became_active":"2023-10-08T15:41:12.657583+0000","last_became_peered":"2023-10-08T15:41:12.657583+0000","last_unstale":"2023-10-08T15:41:12.657764+0000","last_undegraded":"2023-10-08T15:41:12.657764+0000","last_fullsized":"2023-10-08T15:41:12.657764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:17.813719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.654192+0000","last_change":"2023-10-08T15:41:12.654192+0000","last_active":"2023-10-08T15:41:12.654192+0000","last_peered":"2023-10-08T15:41:12.654192+0000","last_clean":"2023-10-08T15:41:12.654192+0000","last_became_active":"2023-10-08T15:41:12.653902+0000","last_became_peered":"2023-10-08T15:41:12.653902+0000","last_unstale":"2023-10-08T15:41:12.654192+0000","last_undegraded":"2023-10-08T15:41:12.654192+0000","last_fullsized":"2023-10-08T15:41:12.654192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:39.043594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659755+0000","last_change":"2023-10-08T15:41:12.659755+0000","last_active":"2023-10-08T15:41:12.659755+0000","last_peered":"2023-10-08T15:41:12.659755+0000","last_clean":"2023-10-08T15:41:12.659755+0000","last_became_active":"2023-10-08T15:41:12.659401+0000","last_became_peered":"2023-10-08T15:41:12.659401+0000","last_unstale":"2023-10-08T15:41:12.659755+0000","last_undegraded":"2023-10-08T15:41:12.659755+0000","last_fullsized":"2023-10-08T15:41:12.659755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:17.013674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.656384+0000","last_change":"2023-10-08T15:41:12.656384+0000","last_active":"2023-10-08T15:41:12.656384+0000","last_peered":"2023-10-08T15:41:12.656384+0000","last_clean":"2023-10-08T15:41:12.656384+0000","last_became_active":"2023-10-08T15:41:12.656027+0000","last_became_peered":"2023-10-08T15:41:12.656027+0000","last_unstale":"2023-10-08T15:41:12.656384+0000","last_undegraded":"2023-10-08T15:41:12.656384+0000","last_fullsized":"2023-10-08T15:41:12.656384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:31.957245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662168+0000","last_change":"2023-10-08T15:41:12.662168+0000","last_active":"2023-10-08T15:41:12.662168+0000","last_peered":"2023-10-08T15:41:12.662168+0000","last_clean":"2023-10-08T15:41:12.662168+0000","last_became_active":"2023-10-08T15:41:12.661516+0000","last_became_peered":"2023-10-08T15:41:12.661516+0000","last_unstale":"2023-10-08T15:41:12.662168+0000","last_undegraded":"2023-10-08T15:41:12.662168+0000","last_fullsized":"2023-10-08T15:41:12.662168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:11.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.663272+0000","last_change":"2023-10-08T15:41:12.663272+0000","last_active":"2023-10-08T15:41:12.663272+0000","last_peered":"2023-10-08T15:41:12.663272+0000","last_clean":"2023-10-08T15:41:12.663272+0000","last_became_active":"2023-10-08T15:41:12.663058+0000","last_became_peered":"2023-10-08T15:41:12.663058+0000","last_unstale":"2023-10-08T15:41:12.663272+0000","last_undegraded":"2023-10-08T15:41:12.663272+0000","last_fullsized":"2023-10-08T15:41:12.663272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:40.936790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.671542+0000","last_change":"2023-10-08T15:41:11.647552+0000","last_active":"2023-10-08T15:41:12.671542+0000","last_peered":"2023-10-08T15:41:12.671542+0000","last_clean":"2023-10-08T15:41:12.671542+0000","last_became_active":"2023-10-08T15:41:11.647319+0000","last_became_peered":"2023-10-08T15:41:11.647319+0000","last_unstale":"2023-10-08T15:41:12.671542+0000","last_undegraded":"2023-10-08T15:41:12.671542+0000","last_fullsized":"2023-10-08T15:41:12.671542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.174103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.660125+0000","last_change":"2023-10-08T15:41:12.660125+0000","last_active":"2023-10-08T15:41:12.660125+0000","last_peered":"2023-10-08T15:41:12.660125+0000","last_clean":"2023-10-08T15:41:12.660125+0000","last_became_active":"2023-10-08T15:41:12.659883+0000","last_became_peered":"2023-10-08T15:41:12.659883+0000","last_unstale":"2023-10-08T15:41:12.660125+0000","last_undegraded":"2023-10-08T15:41:12.660125+0000","last_fullsized":"2023-10-08T15:41:12.660125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:10.188055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661294+0000","last_change":"2023-10-08T15:41:11.646644+0000","last_active":"2023-10-08T15:41:12.661294+0000","last_peered":"2023-10-08T15:41:12.661294+0000","last_clean":"2023-10-08T15:41:12.661294+0000","last_became_active":"2023-10-08T15:41:11.646415+0000","last_became_peered":"2023-10-08T15:41:11.646415+0000","last_unstale":"2023-10-08T15:41:12.661294+0000","last_undegraded":"2023-10-08T15:41:12.661294+0000","last_fullsized":"2023-10-08T15:41:12.661294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:50.988899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.651344+0000","last_change":"2023-10-08T15:41:12.651344+0000","last_active":"2023-10-08T15:41:12.651344+0000","last_peered":"2023-10-08T15:41:12.651344+0000","last_clean":"2023-10-08T15:41:12.651344+0000","last_became_active":"2023-10-08T15:41:12.651124+0000","last_became_peered":"2023-10-08T15:41:12.651124+0000","last_unstale":"2023-10-08T15:41:12.651344+0000","last_undegraded":"2023-10-08T15:41:12.651344+0000","last_fullsized":"2023-10-08T15:41:12.651344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:40.936790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.675044+0000","last_change":"2023-10-08T15:41:11.644894+0000","last_active":"2023-10-08T15:41:12.675044+0000","last_peered":"2023-10-08T15:41:12.675044+0000","last_clean":"2023-10-08T15:41:12.675044+0000","last_became_active":"2023-10-08T15:41:11.644630+0000","last_became_peered":"2023-10-08T15:41:11.644630+0000","last_unstale":"2023-10-08T15:41:12.675044+0000","last_undegraded":"2023-10-08T15:41:12.675044+0000","last_fullsized":"2023-10-08T15:41:12.675044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:09.183464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.650892+0000","last_change":"2023-10-08T15:41:12.650892+0000","last_active":"2023-10-08T15:41:12.650892+0000","last_peered":"2023-10-08T15:41:12.650892+0000","last_clean":"2023-10-08T15:41:12.650892+0000","last_became_active":"2023-10-08T15:41:12.650651+0000","last_became_peered":"2023-10-08T15:41:12.650651+0000","last_unstale":"2023-10-08T15:41:12.650892+0000","last_undegraded":"2023-10-08T15:41:12.650892+0000","last_fullsized":"2023-10-08T15:41:12.650892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:47.151660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.669471+0000","last_change":"2023-10-08T15:41:11.639218+0000","last_active":"2023-10-08T15:41:12.669471+0000","last_peered":"2023-10-08T15:41:12.669471+0000","last_clean":"2023-10-08T15:41:12.669471+0000","last_became_active":"2023-10-08T15:41:11.638688+0000","last_became_peered":"2023-10-08T15:41:11.638688+0000","last_unstale":"2023-10-08T15:41:12.669471+0000","last_undegraded":"2023-10-08T15:41:12.669471+0000","last_fullsized":"2023-10-08T15:41:12.669471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:12.299068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659236+0000","last_change":"2023-10-08T15:41:12.659236+0000","last_active":"2023-10-08T15:41:12.659236+0000","last_peered":"2023-10-08T15:41:12.659236+0000","last_clean":"2023-10-08T15:41:12.659236+0000","last_became_active":"2023-10-08T15:41:12.658849+0000","last_became_peered":"2023-10-08T15:41:12.658849+0000","last_unstale":"2023-10-08T15:41:12.659236+0000","last_undegraded":"2023-10-08T15:41:12.659236+0000","last_fullsized":"2023-10-08T15:41:12.659236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:03.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.649108+0000","last_change":"2023-10-08T15:41:11.641471+0000","last_active":"2023-10-08T15:41:12.649108+0000","last_peered":"2023-10-08T15:41:12.649108+0000","last_clean":"2023-10-08T15:41:12.649108+0000","last_became_active":"2023-10-08T15:41:11.640227+0000","last_became_peered":"2023-10-08T15:41:11.640227+0000","last_unstale":"2023-10-08T15:41:12.649108+0000","last_undegraded":"2023-10-08T15:41:12.649108+0000","last_fullsized":"2023-10-08T15:41:12.649108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:21:31.605682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658575+0000","last_change":"2023-10-08T15:41:12.658575+0000","last_active":"2023-10-08T15:41:12.658575+0000","last_peered":"2023-10-08T15:41:12.658575+0000","last_clean":"2023-10-08T15:41:12.658575+0000","last_became_active":"2023-10-08T15:41:12.657149+0000","last_became_peered":"2023-10-08T15:41:12.657149+0000","last_unstale":"2023-10-08T15:41:12.658575+0000","last_undegraded":"2023-10-08T15:41:12.658575+0000","last_fullsized":"2023-10-08T15:41:12.658575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:53.272096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.648160+0000","last_change":"2023-10-08T15:41:11.640411+0000","last_active":"2023-10-08T15:41:12.648160+0000","last_peered":"2023-10-08T15:41:12.648160+0000","last_clean":"2023-10-08T15:41:12.648160+0000","last_became_active":"2023-10-08T15:41:11.639838+0000","last_became_peered":"2023-10-08T15:41:11.639838+0000","last_unstale":"2023-10-08T15:41:12.648160+0000","last_undegraded":"2023-10-08T15:41:12.648160+0000","last_fullsized":"2023-10-08T15:41:12.648160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:36.657183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661332+0000","last_change":"2023-10-08T15:41:12.661332+0000","last_active":"2023-10-08T15:41:12.661332+0000","last_peered":"2023-10-08T15:41:12.661332+0000","last_clean":"2023-10-08T15:41:12.661332+0000","last_became_active":"2023-10-08T15:41:12.661107+0000","last_became_peered":"2023-10-08T15:41:12.661107+0000","last_unstale":"2023-10-08T15:41:12.661332+0000","last_undegraded":"2023-10-08T15:41:12.661332+0000","last_fullsized":"2023-10-08T15:41:12.661332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:01:26.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643094+0000","last_change":"2023-10-08T15:41:11.643013+0000","last_active":"2023-10-08T15:41:11.643094+0000","last_peered":"2023-10-08T15:41:11.643094+0000","last_clean":"2023-10-08T15:41:11.643094+0000","last_became_active":"2023-10-08T15:41:11.642752+0000","last_became_peered":"2023-10-08T15:41:11.642752+0000","last_unstale":"2023-10-08T15:41:11.643094+0000","last_undegraded":"2023-10-08T15:41:11.643094+0000","last_fullsized":"2023-10-08T15:41:11.643094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:01.364676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.653172+0000","last_change":"2023-10-08T15:41:12.653172+0000","last_active":"2023-10-08T15:41:12.653172+0000","last_peered":"2023-10-08T15:41:12.653172+0000","last_clean":"2023-10-08T15:41:12.653172+0000","last_became_active":"2023-10-08T15:41:12.652711+0000","last_became_peered":"2023-10-08T15:41:12.652711+0000","last_unstale":"2023-10-08T15:41:12.653172+0000","last_undegraded":"2023-10-08T15:41:12.653172+0000","last_fullsized":"2023-10-08T15:41:12.653172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:53.102340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.645616+0000","last_change":"2023-10-08T15:41:11.645102+0000","last_active":"2023-10-08T15:41:11.645616+0000","last_peered":"2023-10-08T15:41:11.645616+0000","last_clean":"2023-10-08T15:41:11.645616+0000","last_became_active":"2023-10-08T15:41:11.644671+0000","last_became_peered":"2023-10-08T15:41:11.644671+0000","last_unstale":"2023-10-08T15:41:11.645616+0000","last_undegraded":"2023-10-08T15:41:11.645616+0000","last_fullsized":"2023-10-08T15:41:11.645616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657798+0000","last_change":"2023-10-08T15:41:12.657798+0000","last_active":"2023-10-08T15:41:12.657798+0000","last_peered":"2023-10-08T15:41:12.657798+0000","last_clean":"2023-10-08T15:41:12.657798+0000","last_became_active":"2023-10-08T15:41:12.656471+0000","last_became_peered":"2023-10-08T15:41:12.656471+0000","last_unstale":"2023-10-08T15:41:12.657798+0000","last_undegraded":"2023-10-08T15:41:12.657798+0000","last_fullsized":"2023-10-08T15:41:12.657798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:19.303260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.648215+0000","last_change":"2023-10-08T15:41:11.648143+0000","last_active":"2023-10-08T15:41:11.648215+0000","last_peered":"2023-10-08T15:41:11.648215+0000","last_clean":"2023-10-08T15:41:11.648215+0000","last_became_active":"2023-10-08T15:41:11.647663+0000","last_became_peered":"2023-10-08T15:41:11.647663+0000","last_unstale":"2023-10-08T15:41:11.648215+0000","last_undegraded":"2023-10-08T15:41:11.648215+0000","last_fullsized":"2023-10-08T15:41:11.648215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:53.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655287+0000","last_change":"2023-10-08T15:41:12.655287+0000","last_active":"2023-10-08T15:41:12.655287+0000","last_peered":"2023-10-08T15:41:12.655287+0000","last_clean":"2023-10-08T15:41:12.655287+0000","last_became_active":"2023-10-08T15:41:12.655053+0000","last_became_peered":"2023-10-08T15:41:12.655053+0000","last_unstale":"2023-10-08T15:41:12.655287+0000","last_undegraded":"2023-10-08T15:41:12.655287+0000","last_fullsized":"2023-10-08T15:41:12.655287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:54:03.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.646727+0000","last_change":"2023-10-08T15:41:11.646678+0000","last_active":"2023-10-08T15:41:11.646727+0000","last_peered":"2023-10-08T15:41:11.646727+0000","last_clean":"2023-10-08T15:41:11.646727+0000","last_became_active":"2023-10-08T15:41:11.646441+0000","last_became_peered":"2023-10-08T15:41:11.646441+0000","last_unstale":"2023-10-08T15:41:11.646727+0000","last_undegraded":"2023-10-08T15:41:11.646727+0000","last_fullsized":"2023-10-08T15:41:11.646727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:48.720701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.661243+0000","last_change":"2023-10-08T15:41:12.661243+0000","last_active":"2023-10-08T15:41:12.661243+0000","last_peered":"2023-10-08T15:41:12.661243+0000","last_clean":"2023-10-08T15:41:12.661243+0000","last_became_active":"2023-10-08T15:41:12.661022+0000","last_became_peered":"2023-10-08T15:41:12.661022+0000","last_unstale":"2023-10-08T15:41:12.661243+0000","last_undegraded":"2023-10-08T15:41:12.661243+0000","last_fullsized":"2023-10-08T15:41:12.661243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:11.626909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.671499+0000","last_change":"2023-10-08T15:41:11.647080+0000","last_active":"2023-10-08T15:41:12.671499+0000","last_peered":"2023-10-08T15:41:12.671499+0000","last_clean":"2023-10-08T15:41:12.671499+0000","last_became_active":"2023-10-08T15:41:11.646856+0000","last_became_peered":"2023-10-08T15:41:11.646856+0000","last_unstale":"2023-10-08T15:41:12.671499+0000","last_undegraded":"2023-10-08T15:41:12.671499+0000","last_fullsized":"2023-10-08T15:41:12.671499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:09.183464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662915+0000","last_change":"2023-10-08T15:41:12.662915+0000","last_active":"2023-10-08T15:41:12.662915+0000","last_peered":"2023-10-08T15:41:12.662915+0000","last_clean":"2023-10-08T15:41:12.662915+0000","last_became_active":"2023-10-08T15:41:12.662706+0000","last_became_peered":"2023-10-08T15:41:12.662706+0000","last_unstale":"2023-10-08T15:41:12.662915+0000","last_undegraded":"2023-10-08T15:41:12.662915+0000","last_fullsized":"2023-10-08T15:41:12.662915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:17.013674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.675811+0000","last_change":"2023-10-08T15:41:11.647297+0000","last_active":"2023-10-08T15:41:12.675811+0000","last_peered":"2023-10-08T15:41:12.675811+0000","last_clean":"2023-10-08T15:41:12.675811+0000","last_became_active":"2023-10-08T15:41:11.646360+0000","last_became_peered":"2023-10-08T15:41:11.646360+0000","last_unstale":"2023-10-08T15:41:12.675811+0000","last_undegraded":"2023-10-08T15:41:12.675811+0000","last_fullsized":"2023-10-08T15:41:12.675811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:46.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.654266+0000","last_change":"2023-10-08T15:41:12.654266+0000","last_active":"2023-10-08T15:41:12.654266+0000","last_peered":"2023-10-08T15:41:12.654266+0000","last_clean":"2023-10-08T15:41:12.654266+0000","last_became_active":"2023-10-08T15:41:12.653512+0000","last_became_peered":"2023-10-08T15:41:12.653512+0000","last_unstale":"2023-10-08T15:41:12.654266+0000","last_undegraded":"2023-10-08T15:41:12.654266+0000","last_fullsized":"2023-10-08T15:41:12.654266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:01:26.491432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.670818+0000","last_change":"2023-10-08T15:41:11.644927+0000","last_active":"2023-10-08T15:41:12.670818+0000","last_peered":"2023-10-08T15:41:12.670818+0000","last_clean":"2023-10-08T15:41:12.670818+0000","last_became_active":"2023-10-08T15:41:11.644349+0000","last_became_peered":"2023-10-08T15:41:11.644349+0000","last_unstale":"2023-10-08T15:41:12.670818+0000","last_undegraded":"2023-10-08T15:41:12.670818+0000","last_fullsized":"2023-10-08T15:41:12.670818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:40.902826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.656535+0000","last_change":"2023-10-08T15:41:12.656535+0000","last_active":"2023-10-08T15:41:12.656535+0000","last_peered":"2023-10-08T15:41:12.656535+0000","last_clean":"2023-10-08T15:41:12.656535+0000","last_became_active":"2023-10-08T15:41:12.656313+0000","last_became_peered":"2023-10-08T15:41:12.656313+0000","last_unstale":"2023-10-08T15:41:12.656535+0000","last_undegraded":"2023-10-08T15:41:12.656535+0000","last_fullsized":"2023-10-08T15:41:12.656535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:04:45.812538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.642211+0000","last_change":"2023-10-08T15:41:11.642140+0000","last_active":"2023-10-08T15:41:11.642211+0000","last_peered":"2023-10-08T15:41:11.642211+0000","last_clean":"2023-10-08T15:41:11.642211+0000","last_became_active":"2023-10-08T15:41:11.641900+0000","last_became_peered":"2023-10-08T15:41:11.641900+0000","last_unstale":"2023-10-08T15:41:11.642211+0000","last_undegraded":"2023-10-08T15:41:11.642211+0000","last_fullsized":"2023-10-08T15:41:11.642211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659086+0000","last_change":"2023-10-08T15:41:12.659086+0000","last_active":"2023-10-08T15:41:12.659086+0000","last_peered":"2023-10-08T15:41:12.659086+0000","last_clean":"2023-10-08T15:41:12.659086+0000","last_became_active":"2023-10-08T15:41:12.658507+0000","last_became_peered":"2023-10-08T15:41:12.658507+0000","last_unstale":"2023-10-08T15:41:12.659086+0000","last_undegraded":"2023-10-08T15:41:12.659086+0000","last_fullsized":"2023-10-08T15:41:12.659086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:17.813719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.646180+0000","last_change":"2023-10-08T15:41:11.646123+0000","last_active":"2023-10-08T15:41:11.646180+0000","last_peered":"2023-10-08T15:41:11.646180+0000","last_clean":"2023-10-08T15:41:11.646180+0000","last_became_active":"2023-10-08T15:41:11.645877+0000","last_became_peered":"2023-10-08T15:41:11.645877+0000","last_unstale":"2023-10-08T15:41:11.646180+0000","last_undegraded":"2023-10-08T15:41:11.646180+0000","last_fullsized":"2023-10-08T15:41:11.646180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:50.424720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.660329+0000","last_change":"2023-10-08T15:41:12.660329+0000","last_active":"2023-10-08T15:41:12.660329+0000","last_peered":"2023-10-08T15:41:12.660329+0000","last_clean":"2023-10-08T15:41:12.660329+0000","last_became_active":"2023-10-08T15:41:12.660068+0000","last_became_peered":"2023-10-08T15:41:12.660068+0000","last_unstale":"2023-10-08T15:41:12.660329+0000","last_undegraded":"2023-10-08T15:41:12.660329+0000","last_fullsized":"2023-10-08T15:41:12.660329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:48.959442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.675298+0000","last_change":"2023-10-08T15:41:11.645155+0000","last_active":"2023-10-08T15:41:12.675298+0000","last_peered":"2023-10-08T15:41:12.675298+0000","last_clean":"2023-10-08T15:41:12.675298+0000","last_became_active":"2023-10-08T15:41:11.644731+0000","last_became_peered":"2023-10-08T15:41:11.644731+0000","last_unstale":"2023-10-08T15:41:12.675298+0000","last_undegraded":"2023-10-08T15:41:12.675298+0000","last_fullsized":"2023-10-08T15:41:12.675298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:04:53.270699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657301+0000","last_change":"2023-10-08T15:41:12.657301+0000","last_active":"2023-10-08T15:41:12.657301+0000","last_peered":"2023-10-08T15:41:12.657301+0000","last_clean":"2023-10-08T15:41:12.657301+0000","last_became_active":"2023-10-08T15:41:12.657064+0000","last_became_peered":"2023-10-08T15:41:12.657064+0000","last_unstale":"2023-10-08T15:41:12.657301+0000","last_undegraded":"2023-10-08T15:41:12.657301+0000","last_fullsized":"2023-10-08T15:41:12.657301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:53.102340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.646859+0000","last_change":"2023-10-08T15:41:11.645030+0000","last_active":"2023-10-08T15:41:12.646859+0000","last_peered":"2023-10-08T15:41:12.646859+0000","last_clean":"2023-10-08T15:41:12.646859+0000","last_became_active":"2023-10-08T15:41:11.644808+0000","last_became_peered":"2023-10-08T15:41:11.644808+0000","last_unstale":"2023-10-08T15:41:12.646859+0000","last_undegraded":"2023-10-08T15:41:12.646859+0000","last_fullsized":"2023-10-08T15:41:12.646859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:40.902826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.654508+0000","last_change":"2023-10-08T15:41:12.654508+0000","last_active":"2023-10-08T15:41:12.654508+0000","last_peered":"2023-10-08T15:41:12.654508+0000","last_clean":"2023-10-08T15:41:12.654508+0000","last_became_active":"2023-10-08T15:41:12.654268+0000","last_became_peered":"2023-10-08T15:41:12.654268+0000","last_unstale":"2023-10-08T15:41:12.654508+0000","last_undegraded":"2023-10-08T15:41:12.654508+0000","last_fullsized":"2023-10-08T15:41:12.654508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:11.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.670568+0000","last_change":"2023-10-08T15:41:11.642441+0000","last_active":"2023-10-08T15:41:12.670568+0000","last_peered":"2023-10-08T15:41:12.670568+0000","last_clean":"2023-10-08T15:41:12.670568+0000","last_became_active":"2023-10-08T15:41:11.642213+0000","last_became_peered":"2023-10-08T15:41:11.642213+0000","last_unstale":"2023-10-08T15:41:12.670568+0000","last_undegraded":"2023-10-08T15:41:12.670568+0000","last_fullsized":"2023-10-08T15:41:12.670568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.174103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.650141+0000","last_change":"2023-10-08T15:41:12.650141+0000","last_active":"2023-10-08T15:41:12.650141+0000","last_peered":"2023-10-08T15:41:12.650141+0000","last_clean":"2023-10-08T15:41:12.650141+0000","last_became_active":"2023-10-08T15:41:12.649731+0000","last_became_peered":"2023-10-08T15:41:12.649731+0000","last_unstale":"2023-10-08T15:41:12.650141+0000","last_undegraded":"2023-10-08T15:41:12.650141+0000","last_fullsized":"2023-10-08T15:41:12.650141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:40.936790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.648866+0000","last_change":"2023-10-08T15:41:11.638519+0000","last_active":"2023-10-08T15:41:12.648866+0000","last_peered":"2023-10-08T15:41:12.648866+0000","last_clean":"2023-10-08T15:41:12.648866+0000","last_became_active":"2023-10-08T15:41:11.638158+0000","last_became_peered":"2023-10-08T15:41:11.638158+0000","last_unstale":"2023-10-08T15:41:12.648866+0000","last_undegraded":"2023-10-08T15:41:12.648866+0000","last_fullsized":"2023-10-08T15:41:12.648866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:48:41.827174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659552+0000","last_change":"2023-10-08T15:41:12.659552+0000","last_active":"2023-10-08T15:41:12.659552+0000","last_peered":"2023-10-08T15:41:12.659552+0000","last_clean":"2023-10-08T15:41:12.659552+0000","last_became_active":"2023-10-08T15:41:12.659368+0000","last_became_peered":"2023-10-08T15:41:12.659368+0000","last_unstale":"2023-10-08T15:41:12.659552+0000","last_undegraded":"2023-10-08T15:41:12.659552+0000","last_fullsized":"2023-10-08T15:41:12.659552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:51.993491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.641686+0000","last_change":"2023-10-08T15:41:11.641612+0000","last_active":"2023-10-08T15:41:11.641686+0000","last_peered":"2023-10-08T15:41:11.641686+0000","last_clean":"2023-10-08T15:41:11.641686+0000","last_became_active":"2023-10-08T15:41:11.641238+0000","last_became_peered":"2023-10-08T15:41:11.641238+0000","last_unstale":"2023-10-08T15:41:11.641686+0000","last_undegraded":"2023-10-08T15:41:11.641686+0000","last_fullsized":"2023-10-08T15:41:11.641686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:45.294450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.650856+0000","last_change":"2023-10-08T15:41:12.650856+0000","last_active":"2023-10-08T15:41:12.650856+0000","last_peered":"2023-10-08T15:41:12.650856+0000","last_clean":"2023-10-08T15:41:12.650856+0000","last_became_active":"2023-10-08T15:41:12.650618+0000","last_became_peered":"2023-10-08T15:41:12.650618+0000","last_unstale":"2023-10-08T15:41:12.650856+0000","last_undegraded":"2023-10-08T15:41:12.650856+0000","last_fullsized":"2023-10-08T15:41:12.650856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:10.141069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.671317+0000","last_change":"2023-10-08T15:41:11.643166+0000","last_active":"2023-10-08T15:41:12.671317+0000","last_peered":"2023-10-08T15:41:12.671317+0000","last_clean":"2023-10-08T15:41:12.671317+0000","last_became_active":"2023-10-08T15:41:11.642797+0000","last_became_peered":"2023-10-08T15:41:11.642797+0000","last_unstale":"2023-10-08T15:41:12.671317+0000","last_undegraded":"2023-10-08T15:41:12.671317+0000","last_fullsized":"2023-10-08T15:41:12.671317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:21.261112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.656958+0000","last_change":"2023-10-08T15:41:12.656958+0000","last_active":"2023-10-08T15:41:12.656958+0000","last_peered":"2023-10-08T15:41:12.656958+0000","last_clean":"2023-10-08T15:41:12.656958+0000","last_became_active":"2023-10-08T15:41:12.656720+0000","last_became_peered":"2023-10-08T15:41:12.656720+0000","last_unstale":"2023-10-08T15:41:12.656958+0000","last_undegraded":"2023-10-08T15:41:12.656958+0000","last_fullsized":"2023-10-08T15:41:12.656958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:41.907418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.646285+0000","last_change":"2023-10-08T15:41:11.646217+0000","last_active":"2023-10-08T15:41:11.646285+0000","last_peered":"2023-10-08T15:41:11.646285+0000","last_clean":"2023-10-08T15:41:11.646285+0000","last_became_active":"2023-10-08T15:41:11.645964+0000","last_became_peered":"2023-10-08T15:41:11.645964+0000","last_unstale":"2023-10-08T15:41:11.646285+0000","last_undegraded":"2023-10-08T15:41:11.646285+0000","last_fullsized":"2023-10-08T15:41:11.646285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:40.902826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658291+0000","last_change":"2023-10-08T15:41:12.658291+0000","last_active":"2023-10-08T15:41:12.658291+0000","last_peered":"2023-10-08T15:41:12.658291+0000","last_clean":"2023-10-08T15:41:12.658291+0000","last_became_active":"2023-10-08T15:41:12.657908+0000","last_became_peered":"2023-10-08T15:41:12.657908+0000","last_unstale":"2023-10-08T15:41:12.658291+0000","last_undegraded":"2023-10-08T15:41:12.658291+0000","last_fullsized":"2023-10-08T15:41:12.658291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:46.178694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.645631+0000","last_change":"2023-10-08T15:41:11.645537+0000","last_active":"2023-10-08T15:41:11.645631+0000","last_peered":"2023-10-08T15:41:11.645631+0000","last_clean":"2023-10-08T15:41:11.645631+0000","last_became_active":"2023-10-08T15:41:11.645317+0000","last_became_peered":"2023-10-08T15:41:11.645317+0000","last_unstale":"2023-10-08T15:41:11.645631+0000","last_undegraded":"2023-10-08T15:41:11.645631+0000","last_fullsized":"2023-10-08T15:41:11.645631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:09.136478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659615+0000","last_change":"2023-10-08T15:41:12.659615+0000","last_active":"2023-10-08T15:41:12.659615+0000","last_peered":"2023-10-08T15:41:12.659615+0000","last_clean":"2023-10-08T15:41:12.659615+0000","last_became_active":"2023-10-08T15:41:12.659098+0000","last_became_peered":"2023-10-08T15:41:12.659098+0000","last_unstale":"2023-10-08T15:41:12.659615+0000","last_undegraded":"2023-10-08T15:41:12.659615+0000","last_fullsized":"2023-10-08T15:41:12.659615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:31:08.449284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.646202+0000","last_change":"2023-10-08T15:41:11.646134+0000","last_active":"2023-10-08T15:41:11.646202+0000","last_peered":"2023-10-08T15:41:11.646202+0000","last_clean":"2023-10-08T15:41:11.646202+0000","last_became_active":"2023-10-08T15:41:11.645897+0000","last_became_peered":"2023-10-08T15:41:11.645897+0000","last_unstale":"2023-10-08T15:41:11.646202+0000","last_undegraded":"2023-10-08T15:41:11.646202+0000","last_fullsized":"2023-10-08T15:41:11.646202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:46.966699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658130+0000","last_change":"2023-10-08T15:41:12.658130+0000","last_active":"2023-10-08T15:41:12.658130+0000","last_peered":"2023-10-08T15:41:12.658130+0000","last_clean":"2023-10-08T15:41:12.658130+0000","last_became_active":"2023-10-08T15:41:12.657695+0000","last_became_peered":"2023-10-08T15:41:12.657695+0000","last_unstale":"2023-10-08T15:41:12.658130+0000","last_undegraded":"2023-10-08T15:41:12.658130+0000","last_fullsized":"2023-10-08T15:41:12.658130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:03.572229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.669633+0000","last_change":"2023-10-08T15:41:11.640870+0000","last_active":"2023-10-08T15:41:12.669633+0000","last_peered":"2023-10-08T15:41:12.669633+0000","last_clean":"2023-10-08T15:41:12.669633+0000","last_became_active":"2023-10-08T15:41:11.640604+0000","last_became_peered":"2023-10-08T15:41:11.640604+0000","last_unstale":"2023-10-08T15:41:12.669633+0000","last_undegraded":"2023-10-08T15:41:12.669633+0000","last_fullsized":"2023-10-08T15:41:12.669633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:48.720701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658757+0000","last_change":"2023-10-08T15:41:12.658757+0000","last_active":"2023-10-08T15:41:12.658757+0000","last_peered":"2023-10-08T15:41:12.658757+0000","last_clean":"2023-10-08T15:41:12.658757+0000","last_became_active":"2023-10-08T15:41:12.657526+0000","last_became_peered":"2023-10-08T15:41:12.657526+0000","last_unstale":"2023-10-08T15:41:12.658757+0000","last_undegraded":"2023-10-08T15:41:12.658757+0000","last_fullsized":"2023-10-08T15:41:12.658757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:04:45.812538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643287+0000","last_change":"2023-10-08T15:41:11.643032+0000","last_active":"2023-10-08T15:41:11.643287+0000","last_peered":"2023-10-08T15:41:11.643287+0000","last_clean":"2023-10-08T15:41:11.643287+0000","last_became_active":"2023-10-08T15:41:11.642510+0000","last_became_peered":"2023-10-08T15:41:11.642510+0000","last_unstale":"2023-10-08T15:41:11.643287+0000","last_undegraded":"2023-10-08T15:41:11.643287+0000","last_fullsized":"2023-10-08T15:41:11.643287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:40.902826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.662754+0000","last_change":"2023-10-08T15:41:12.662754+0000","last_active":"2023-10-08T15:41:12.662754+0000","last_peered":"2023-10-08T15:41:12.662754+0000","last_clean":"2023-10-08T15:41:12.662754+0000","last_became_active":"2023-10-08T15:41:12.662539+0000","last_became_peered":"2023-10-08T15:41:12.662539+0000","last_unstale":"2023-10-08T15:41:12.662754+0000","last_undegraded":"2023-10-08T15:41:12.662754+0000","last_fullsized":"2023-10-08T15:41:12.662754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:31.957245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.644437+0000","last_change":"2023-10-08T15:41:11.644200+0000","last_active":"2023-10-08T15:41:11.644437+0000","last_peered":"2023-10-08T15:41:11.644437+0000","last_clean":"2023-10-08T15:41:11.644437+0000","last_became_active":"2023-10-08T15:41:11.643749+0000","last_became_peered":"2023-10-08T15:41:11.643749+0000","last_unstale":"2023-10-08T15:41:11.644437+0000","last_undegraded":"2023-10-08T15:41:11.644437+0000","last_fullsized":"2023-10-08T15:41:11.644437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:45.174103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657182+0000","last_change":"2023-10-08T15:41:12.657182+0000","last_active":"2023-10-08T15:41:12.657182+0000","last_peered":"2023-10-08T15:41:12.657182+0000","last_clean":"2023-10-08T15:41:12.657182+0000","last_became_active":"2023-10-08T15:41:12.656923+0000","last_became_peered":"2023-10-08T15:41:12.656923+0000","last_unstale":"2023-10-08T15:41:12.657182+0000","last_undegraded":"2023-10-08T15:41:12.657182+0000","last_fullsized":"2023-10-08T15:41:12.657182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:47.971290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643843+0000","last_change":"2023-10-08T15:41:11.643703+0000","last_active":"2023-10-08T15:41:11.643843+0000","last_peered":"2023-10-08T15:41:11.643843+0000","last_clean":"2023-10-08T15:41:11.643843+0000","last_became_active":"2023-10-08T15:41:11.643535+0000","last_became_peered":"2023-10-08T15:41:11.643535+0000","last_unstale":"2023-10-08T15:41:11.643843+0000","last_undegraded":"2023-10-08T15:41:11.643843+0000","last_fullsized":"2023-10-08T15:41:11.643843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.655948+0000","last_change":"2023-10-08T15:41:12.655948+0000","last_active":"2023-10-08T15:41:12.655948+0000","last_peered":"2023-10-08T15:41:12.655948+0000","last_clean":"2023-10-08T15:41:12.655948+0000","last_became_active":"2023-10-08T15:41:12.655547+0000","last_became_peered":"2023-10-08T15:41:12.655547+0000","last_unstale":"2023-10-08T15:41:12.655948+0000","last_undegraded":"2023-10-08T15:41:12.655948+0000","last_fullsized":"2023-10-08T15:41:12.655948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:48.959442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643072+0000","last_change":"2023-10-08T15:41:11.643006+0000","last_active":"2023-10-08T15:41:11.643072+0000","last_peered":"2023-10-08T15:41:11.643072+0000","last_clean":"2023-10-08T15:41:11.643072+0000","last_became_active":"2023-10-08T15:41:11.642739+0000","last_became_peered":"2023-10-08T15:41:11.642739+0000","last_unstale":"2023-10-08T15:41:11.643072+0000","last_undegraded":"2023-10-08T15:41:11.643072+0000","last_fullsized":"2023-10-08T15:41:11.643072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:29:21.261112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.659213+0000","last_change":"2023-10-08T15:41:12.659213+0000","last_active":"2023-10-08T15:41:12.659213+0000","last_peered":"2023-10-08T15:41:12.659213+0000","last_clean":"2023-10-08T15:41:12.659213+0000","last_became_active":"2023-10-08T15:41:12.658589+0000","last_became_peered":"2023-10-08T15:41:12.658589+0000","last_unstale":"2023-10-08T15:41:12.659213+0000","last_undegraded":"2023-10-08T15:41:12.659213+0000","last_fullsized":"2023-10-08T15:41:12.659213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:20:02.196851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.640656+0000","last_change":"2023-10-08T15:41:11.640578+0000","last_active":"2023-10-08T15:41:11.640656+0000","last_peered":"2023-10-08T15:41:11.640656+0000","last_clean":"2023-10-08T15:41:11.640656+0000","last_became_active":"2023-10-08T15:41:11.640166+0000","last_became_peered":"2023-10-08T15:41:11.640166+0000","last_unstale":"2023-10-08T15:41:11.640656+0000","last_undegraded":"2023-10-08T15:41:11.640656+0000","last_fullsized":"2023-10-08T15:41:11.640656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:53:55.448831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.657211+0000","last_change":"2023-10-08T15:41:12.657211+0000","last_active":"2023-10-08T15:41:12.657211+0000","last_peered":"2023-10-08T15:41:12.657211+0000","last_clean":"2023-10-08T15:41:12.657211+0000","last_became_active":"2023-10-08T15:41:12.656452+0000","last_became_peered":"2023-10-08T15:41:12.656452+0000","last_unstale":"2023-10-08T15:41:12.657211+0000","last_undegraded":"2023-10-08T15:41:12.657211+0000","last_fullsized":"2023-10-08T15:41:12.657211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.429312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.647509+0000","last_change":"2023-10-08T15:41:11.647434+0000","last_active":"2023-10-08T15:41:11.647509+0000","last_peered":"2023-10-08T15:41:11.647509+0000","last_clean":"2023-10-08T15:41:11.647509+0000","last_became_active":"2023-10-08T15:41:11.647161+0000","last_became_peered":"2023-10-08T15:41:11.647161+0000","last_unstale":"2023-10-08T15:41:11.647509+0000","last_undegraded":"2023-10-08T15:41:11.647509+0000","last_fullsized":"2023-10-08T15:41:11.647509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:39.932199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T15:41:12.658688+0000","last_change":"2023-10-08T15:41:12.658688+0000","last_active":"2023-10-08T15:41:12.658688+0000","last_peered":"2023-10-08T15:41:12.658688+0000","last_clean":"2023-10-08T15:41:12.658688+0000","last_became_active":"2023-10-08T15:41:12.658250+0000","last_became_peered":"2023-10-08T15:41:12.658250+0000","last_unstale":"2023-10-08T15:41:12.658688+0000","last_undegraded":"2023-10-08T15:41:12.658688+0000","last_fullsized":"2023-10-08T15:41:12.658688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:11.630610+0000","last_clean_scrub_stamp":"2023-10-08T15:41:11.630610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:53.272096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.645476+0000","last_change":"2023-10-08T15:41:11.645425+0000","last_active":"2023-10-08T15:41:11.645476+0000","last_peered":"2023-10-08T15:41:11.645476+0000","last_clean":"2023-10-08T15:41:11.645476+0000","last_became_active":"2023-10-08T15:41:11.645166+0000","last_became_peered":"2023-10-08T15:41:11.645166+0000","last_unstale":"2023-10-08T15:41:11.645476+0000","last_undegraded":"2023-10-08T15:41:11.645476+0000","last_fullsized":"2023-10-08T15:41:11.645476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:10.626019+0000","last_clean_scrub_stamp":"2023-10-08T15:41:10.626019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-08T15:41:11.643499+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:41:11.643499+0000","last_peered":"2023-10-08T15:41:11.643499+0000","last_clean":"2023-10-08T15:41:11.643499+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:41:11.643499+0000","last_undegraded":"2023-10-08T15:41:11.643499+0000","last_fullsized":"2023-10-08T15:41:11.643499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":700,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194611,"statfs":{"total":200000000,"available":199282276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":125,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195186,"statfs":{"total":200000000,"available":199871176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194618,"statfs":{"total":200000000,"available":199289129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.24199999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.8260000000000001,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.317},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.432}]},{"osd":5,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.504}]},{"osd":6,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.49299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.376},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.254},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32800000000000001}]},{"osd":4,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.501},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52700000000000002}]},{"osd":6,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51100000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]}],"pool_statfs":[]}} 2023-10-08T15:41:17.145 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T15:41:17.146 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T15:41:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.308+0000 7fd00a0f5700 1 Processor -- start 2023-10-08T15:41:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.308+0000 7fd00a0f5700 1 -- start start 2023-10-08T15:41:17.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.308+0000 7fd00a0f5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd0040697c0 0x7fd00415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.308+0000 7fd00a0f5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd00415a230 0x7fd0040af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd00a0f5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00415ea90 con 0x7fd004159e60 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd00a0f5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0040d1cf0 con 0x7fd00415a230 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd00a0f5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0040b3100 con 0x7fd0040697c0 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd003fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd00415a230 0x7fd0040af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd0037fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd004159e60 0x7fd0040690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56088/0 (socket says 172.21.15.29:56088) 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd0037fe700 1 -- 172.21.15.29:0/562729906 learned_addr learned my addr 172.21.15.29:0/562729906 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd002ffd700 1 --2- 172.21.15.29:0/562729906 >> v2:172.21.15.183:3300/0 conn(0x7fd0040697c0 0x7fd00415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd0027fc700 1 -- 172.21.15.29:0/562729906 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542818458 0 0) 0x7fd00415ea90 con 0x7fd004159e60 2023-10-08T15:41:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd0027fc700 1 -- 172.21.15.29:0/562729906 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff0003570 con 0x7fd004159e60 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd003fff700 1 -- 172.21.15.29:0/562729906 >> v2:172.21.15.183:3300/0 conn(0x7fd0040697c0 msgr2=0x7fd00415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd003fff700 1 --2- 172.21.15.29:0/562729906 >> v2:172.21.15.183:3300/0 conn(0x7fd0040697c0 0x7fd00415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd003fff700 1 -- 172.21.15.29:0/562729906 >> v1:172.21.15.29:6789/0 conn(0x7fd004159e60 legacy=0x7fd0040690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd003fff700 1 -- 172.21.15.29:0/562729906 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0040d10e0 con 0x7fd00415a230 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd002ffd700 1 --2- 172.21.15.29:0/562729906 >> v2:172.21.15.183:3300/0 conn(0x7fd0040697c0 0x7fd00415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd003fff700 1 --2- 172.21.15.29:0/562729906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd00415a230 0x7fd0040af730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0040b3860 tx=0x7fcff40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702d7a4fb2c0d8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd0027fc700 1 -- 172.21.15.29:0/562729906 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4011630 con 0x7fd00415a230 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd0027fc700 1 -- 172.21.15.29:0/562729906 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff4011790 con 0x7fd00415a230 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.309+0000 7fd0027fc700 1 -- 172.21.15.29:0/562729906 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4011b30 con 0x7fd00415a230 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.310+0000 7fd00a0f5700 1 -- 172.21.15.29:0/562729906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd00415a230 msgr2=0x7fd0040af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.310+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/562729906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd00415a230 0x7fd0040af730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0040b3860 tx=0x7fcff40091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.310+0000 7fd00a0f5700 1 -- 172.21.15.29:0/562729906 shutdown_connections 2023-10-08T15:41:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.310+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/562729906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd00415a230 0x7fd0040af730 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.310+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/562729906 >> v2:172.21.15.183:3300/0 conn(0x7fd0040697c0 0x7fd00415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.310+0000 7fd00a0f5700 1 -- 172.21.15.29:0/562729906 >> 172.21.15.29:0/562729906 conn(0x7fd004070700 msgr2=0x7fd004070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.310+0000 7fd00a0f5700 1 -- 172.21.15.29:0/562729906 shutdown_connections 2023-10-08T15:41:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.310+0000 7fd00a0f5700 1 -- 172.21.15.29:0/562729906 wait complete. 2023-10-08T15:41:17.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.311+0000 7fd00a0f5700 1 Processor -- start 2023-10-08T15:41:17.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.311+0000 7fd00a0f5700 1 -- start start 2023-10-08T15:41:17.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd00a0f5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0040697c0 0x7fd004153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd00a0f5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd004159e60 0x7fd0040c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd00a0f5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd00415a230 0x7fd0040cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd00a0f5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00415a630 con 0x7fd004159e60 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd00a0f5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040c8780 con 0x7fd0040697c0 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd00a0f5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040c8a60 con 0x7fd00415a230 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd002ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd004159e60 0x7fd0040c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd002ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd004159e60 0x7fd0040c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57256/0 (socket says 172.21.15.29:57256) 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd002ffd700 1 -- 172.21.15.29:0/758998579 learned_addr learned my addr 172.21.15.29:0/758998579 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd003fff700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd00415a230 0x7fd0040cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd0037fe700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0040697c0 0x7fd004153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd002ffd700 1 -- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd00415a230 msgr2=0x7fd0040cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd002ffd700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd00415a230 0x7fd0040cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd002ffd700 1 -- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0040697c0 msgr2=0x7fd004153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd002ffd700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0040697c0 0x7fd004153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.312+0000 7fd002ffd700 1 -- 172.21.15.29:0/758998579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff4009420 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.313+0000 7fd002ffd700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd004159e60 0x7fd0040c7da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00c830 tx=0x7fcfec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.313+0000 7fcffb7fe700 1 -- 172.21.15.29:0/758998579 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec011600 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.313+0000 7fcffb7fe700 1 -- 172.21.15.29:0/758998579 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec011760 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.313+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0040c8d40 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.313+0000 7fcffb7fe700 1 -- 172.21.15.29:0/758998579 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec011b20 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.313+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd004153b50 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.314+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0040b3380 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.314+0000 7fcffb7fe700 1 -- 172.21.15.29:0/758998579 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfec0193b0 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.315+0000 7fcffb7fe700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcfe4066f30 0x7fcfe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.315+0000 7fcffb7fe700 1 -- 172.21.15.29:0/758998579 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcfec0845c0 con 0x7fd004159e60 2023-10-08T15:41:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.315+0000 7fd0037fe700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcfe4066f30 0x7fcfe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.315+0000 7fd0037fe700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcfe4066f30 0x7fcfe40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcffc005c50 tx=0x7fcffc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:17.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.319+0000 7fcffb7fe700 1 -- 172.21.15.29:0/758998579 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfec051790 con 0x7fd004159e60 2023-10-08T15:41:17.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.592+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd00404c3c0 con 0x7fd004159e60 2023-10-08T15:41:17.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.596+0000 7fcffb7fe700 1 -- 172.21.15.29:0/758998579 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcfec082e60 con 0x7fd004159e60 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcfe4066f30 msgr2=0x7fcfe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcfe4066f30 0x7fcfe40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcffc005c50 tx=0x7fcffc009040 comp rx=0 tx=0).stop 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd004159e60 msgr2=0x7fd0040c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd004159e60 0x7fd0040c7da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00c830 tx=0x7fcfec008040 comp rx=0 tx=0).stop 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 shutdown_connections 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcfe4066f30 0x7fcfe40693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd00415a230 0x7fd0040cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0040697c0 0x7fd004153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 --2- 172.21.15.29:0/758998579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd004159e60 0x7fd0040c7da0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 >> 172.21.15.29:0/758998579 conn(0x7fd004070700 msgr2=0x7fd0040d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 shutdown_connections 2023-10-08T15:41:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.598+0000 7fd00a0f5700 1 -- 172.21.15.29:0/758998579 wait complete. 2023-10-08T15:41:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2023-10-08T15:41:17.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:17.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.729+0000 7f4885ebf700 1 Processor -- start 2023-10-08T15:41:17.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.729+0000 7f4885ebf700 1 -- start start 2023-10-08T15:41:17.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f4885ebf700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48800d1c30 0x7f48800ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f4885ebf700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 0x7f48800cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f4885ebf700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48800c5d80 con 0x7f488015a2b0 2023-10-08T15:41:17.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f4885ebf700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4880068470 con 0x7f48800d1c30 2023-10-08T15:41:17.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f4885ebf700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48800c6060 con 0x7f488015a680 2023-10-08T15:41:17.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48800d1c30 0x7f48800ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f488015a2b0 0x7f48800b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56102/0 (socket says 172.21.15.29:56102) 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487f7fe700 1 -- 172.21.15.29:0/3019076699 learned_addr learned my addr 172.21.15.29:0/3019076699 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487ffff700 1 --2- 172.21.15.29:0/3019076699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 0x7f48800cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487e7fc700 1 -- 172.21.15.29:0/3019076699 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258606391 0 0) 0x7f48800c5d80 con 0x7f488015a2b0 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487e7fc700 1 -- 172.21.15.29:0/3019076699 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4868003570 con 0x7f488015a2b0 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487effd700 1 -- 172.21.15.29:0/3019076699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 msgr2=0x7f48800cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487effd700 1 --2- 172.21.15.29:0/3019076699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 0x7f48800cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487effd700 1 -- 172.21.15.29:0/3019076699 >> v1:172.21.15.29:6789/0 conn(0x7f488015a2b0 legacy=0x7f48800b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487effd700 1 -- 172.21.15.29:0/3019076699 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800c6340 con 0x7f48800d1c30 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487ffff700 1 --2- 172.21.15.29:0/3019076699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 0x7f48800cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.730+0000 7f487effd700 1 --2- 172.21.15.29:0/3019076699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48800d1c30 0x7f48800ccdd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f48740098e0 tx=0x7f48740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a312be3d3ac6e918 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:17.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f487e7fc700 1 -- 172.21.15.29:0/3019076699 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400b640 con 0x7f48800d1c30 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f487e7fc700 1 -- 172.21.15.29:0/3019076699 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487400b7a0 con 0x7f48800d1c30 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f487e7fc700 1 -- 172.21.15.29:0/3019076699 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487400bb40 con 0x7f48800d1c30 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f4885ebf700 1 -- 172.21.15.29:0/3019076699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48800d1c30 msgr2=0x7f48800ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f4885ebf700 1 --2- 172.21.15.29:0/3019076699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48800d1c30 0x7f48800ccdd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f48740098e0 tx=0x7f48740091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f4885ebf700 1 -- 172.21.15.29:0/3019076699 shutdown_connections 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f4885ebf700 1 --2- 172.21.15.29:0/3019076699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 0x7f48800cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f4885ebf700 1 --2- 172.21.15.29:0/3019076699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48800d1c30 0x7f48800ccdd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f4885ebf700 1 -- 172.21.15.29:0/3019076699 >> 172.21.15.29:0/3019076699 conn(0x7f4880067e40 msgr2=0x7f48800d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f4885ebf700 1 -- 172.21.15.29:0/3019076699 shutdown_connections 2023-10-08T15:41:17.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.731+0000 7f4885ebf700 1 -- 172.21.15.29:0/3019076699 wait complete. 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.732+0000 7f4885ebf700 1 Processor -- start 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.732+0000 7f4885ebf700 1 -- start start 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f4885ebf700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48800d1c30 0x7f488016af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f4885ebf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f488015a2b0 0x7f4880155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f4885ebf700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 0x7f48800b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f4885ebf700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488015e020 con 0x7f488015a2b0 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f4885ebf700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488016b660 con 0x7f48800d1c30 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f4885ebf700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488016b440 con 0x7f488015a680 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f487effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f488015a2b0 0x7f4880155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f487effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f488015a2b0 0x7f4880155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57270/0 (socket says 172.21.15.29:57270) 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f487effd700 1 -- 172.21.15.29:0/1171092676 learned_addr learned my addr 172.21.15.29:0/1171092676 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f487effd700 1 -- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 msgr2=0x7f48800b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f487effd700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 0x7f48800b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f487effd700 1 -- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48800d1c30 msgr2=0x7f488016af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f487effd700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48800d1c30 0x7f488016af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.733+0000 7f487effd700 1 -- 172.21.15.29:0/1171092676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009420 con 0x7f488015a2b0 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.734+0000 7f487effd700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f488015a2b0 0x7f4880155330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4874013000 tx=0x7f4874017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.734+0000 7f48677fe700 1 -- 172.21.15.29:0/1171092676 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487401bda0 con 0x7f488015a2b0 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.734+0000 7f48677fe700 1 -- 172.21.15.29:0/1171092676 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4874011420 con 0x7f488015a2b0 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.734+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48800c9dc0 con 0x7f488015a2b0 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.734+0000 7f48677fe700 1 -- 172.21.15.29:0/1171092676 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740117e0 con 0x7f488015a2b0 2023-10-08T15:41:17.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.734+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488015e270 con 0x7f488015a2b0 2023-10-08T15:41:17.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.735+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488004c3c0 con 0x7f488015a2b0 2023-10-08T15:41:17.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.735+0000 7f48677fe700 1 -- 172.21.15.29:0/1171092676 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4874011b50 con 0x7f488015a2b0 2023-10-08T15:41:17.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.735+0000 7f48677fe700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f486c066f30 0x7f486c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:17.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.736+0000 7f48677fe700 1 -- 172.21.15.29:0/1171092676 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4874085b10 con 0x7f488015a2b0 2023-10-08T15:41:17.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.736+0000 7f487f7fe700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f486c066f30 0x7f486c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:17.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.736+0000 7f487f7fe700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f486c066f30 0x7f486c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4870001360 tx=0x7f48700078a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:17.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.740+0000 7f48677fe700 1 -- 172.21.15.29:0/1171092676 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4874052d80 con 0x7f488015a2b0 2023-10-08T15:41:17.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.973+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4880064a00 con 0x7f488015a2b0 2023-10-08T15:41:17.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.974+0000 7f48677fe700 1 -- 172.21.15.29:0/1171092676 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f48740563a0 con 0x7f488015a2b0 2023-10-08T15:41:17.974 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:17.975 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:12.039331+0000","modified":"2023-10-08T15:41:15.672568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/470731948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":470731948},{"type":"v1","addr":"172.21.15.29:6835","nonce":470731948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:41:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f486c066f30 msgr2=0x7f486c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f486c066f30 0x7f486c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4870001360 tx=0x7f48700078a0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f488015a2b0 msgr2=0x7f4880155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f488015a2b0 0x7f4880155330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4874013000 tx=0x7f4874017000 comp rx=0 tx=0).stop 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 shutdown_connections 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f486c066f30 0x7f486c0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f488015a680 0x7f48800b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48800d1c30 0x7f488016af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 --2- 172.21.15.29:0/1171092676 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f488015a2b0 0x7f4880155330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 >> 172.21.15.29:0/1171092676 conn(0x7f4880067e40 msgr2=0x7f48801587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 shutdown_connections 2023-10-08T15:41:17.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:17.976+0000 7f4885ebf700 1 -- 172.21.15.29:0/1171092676 wait complete. 2023-10-08T15:41:17.978 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-08T15:41:18.391 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T15:41:12.039331+0000', 'modified': '2023-10-08T15:41:15.672568+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4917}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4917': {'gid': 4917, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/470731948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6833', 'nonce': 470731948}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 470731948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T15:41:18.391 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T15:41:18.391 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T15:41:18.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.512+0000 7f5b5ffff700 1 Processor -- start 2023-10-08T15:41:18.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.512+0000 7f5b5ffff700 1 -- start start 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.513+0000 7f5b5ffff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5b60070e10 0x7f5b6015d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.513+0000 7f5b5ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b60068310 con 0x7f5b600afc90 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.513+0000 7f5b5ffff700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b60067700 con 0x7f5b6006ec90 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.513+0000 7f5b5ffff700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b600679e0 con 0x7f5b60070e10 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.513+0000 7f5b5effd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5b600afc90 0x7f5b600688e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36692/0 (socket says 172.21.15.29:36692) 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.513+0000 7f5b5effd700 1 -- 172.21.15.29:0/1589281019 learned_addr learned my addr 172.21.15.29:0/1589281019 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70197266 0 0) 0x7f5b60068310 con 0x7f5b600afc90 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/1589281019 >> v2:172.21.15.183:3300/0 conn(0x7f5b60070e10 0x7f5b6015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b4c003570 con 0x7f5b600afc90 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4267368393 0 0) 0x7f5b4c003570 con 0x7f5b600afc90 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 >> v2:172.21.15.183:3300/0 conn(0x7f5b60070e10 msgr2=0x7f5b6015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 --2- 172.21.15.29:0/1589281019 >> v2:172.21.15.183:3300/0 conn(0x7f5b60070e10 0x7f5b6015d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 >> v1:172.21.15.183:6789/0 conn(0x7f5b6006ec90 legacy=0x7f5b60070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60067cc0 con 0x7f5b600afc90 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f5b580017f0 con 0x7f5b600afc90 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 >> v1:172.21.15.29:6789/0 conn(0x7f5b600afc90 legacy=0x7f5b600688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4c003a60 0x7f5b4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b4c004810 0x7f5b4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c0051c0 0x7f5b4c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600679e0 con 0x7f5b4c003a60 2023-10-08T15:41:18.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c00c0d0 con 0x7f5b4c0051c0 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c00c290 con 0x7f5b4c004810 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5effd700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4c003a60 0x7f5b4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c0051c0 0x7f5b4c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b4c004810 0x7f5b4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5effd700 1 -- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b4c004810 msgr2=0x7f5b4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5effd700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b4c004810 0x7f5b4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5effd700 1 -- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c0051c0 msgr2=0x7f5b4c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5effd700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c0051c0 0x7f5b4c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/1589281019 reap_dead start 2023-10-08T15:41:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5effd700 1 -- 172.21.15.29:0/1589281019 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c003570 con 0x7f5b4c003a60 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b4c004810 0x7f5b4c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.514+0000 7f5b5effd700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4c003a60 0x7f5b4c003e70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b58014210 tx=0x7f5b60068280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269c5f152ddbe5f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58017070 con 0x7f5b4c003a60 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58014a60 con 0x7f5b4c003a60 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5dffb700 1 -- 172.21.15.29:0/1589281019 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58014e20 con 0x7f5b4c003a60 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5ffff700 1 -- 172.21.15.29:0/1589281019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4c003a60 msgr2=0x7f5b4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5ffff700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4c003a60 0x7f5b4c003e70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b58014210 tx=0x7f5b60068280 comp rx=0 tx=0).stop 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5ffff700 1 -- 172.21.15.29:0/1589281019 shutdown_connections 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5ffff700 1 --2- 172.21.15.29:0/1589281019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b4c003a60 0x7f5b4c003e70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5ffff700 1 -- 172.21.15.29:0/1589281019 >> 172.21.15.29:0/1589281019 conn(0x7f5b600cd890 msgr2=0x7f5b600cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5ffff700 1 -- 172.21.15.29:0/1589281019 shutdown_connections 2023-10-08T15:41:18.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.515+0000 7f5b5ffff700 1 -- 172.21.15.29:0/1589281019 wait complete. 2023-10-08T15:41:18.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.516+0000 7f5b5ffff700 1 Processor -- start 2023-10-08T15:41:18.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.516+0000 7f5b5ffff700 1 -- start start 2023-10-08T15:41:18.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5ffff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c003a60 0x7f5b600c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b600b3140 0x7f5b60165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b601664d0 0x7f5b60166940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6014e790 con 0x7f5b601664d0 2023-10-08T15:41:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5ffff700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600c7a60 con 0x7f5b4c003a60 2023-10-08T15:41:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5ffff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60166e80 con 0x7f5b600b3140 2023-10-08T15:41:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b601664d0 0x7f5b60166940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b601664d0 0x7f5b60166940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54314/0 (socket says 172.21.15.29:54314) 2023-10-08T15:41:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/3574143798 learned_addr learned my addr 172.21.15.29:0/3574143798 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:18.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b600b3140 0x7f5b60165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.517+0000 7f5b5effd700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c003a60 0x7f5b600c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b600b3140 msgr2=0x7f5b60165f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b600b3140 0x7f5b60165f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c003a60 msgr2=0x7f5b600c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c003a60 0x7f5b600c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/3574143798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600c4fc0 con 0x7f5b601664d0 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b601664d0 0x7f5b60166940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5b50011970 tx=0x7f5b500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b56ffd700 1 -- 172.21.15.29:0/3574143798 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000f7d0 con 0x7f5b601664d0 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b56ffd700 1 -- 172.21.15.29:0/3574143798 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5000f930 con 0x7f5b601664d0 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b5ffff700 1 -- 172.21.15.29:0/3574143798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b600c7410 con 0x7f5b601664d0 2023-10-08T15:41:18.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b56ffd700 1 -- 172.21.15.29:0/3574143798 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000fcd0 con 0x7f5b601664d0 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.518+0000 7f5b5ffff700 1 -- 172.21.15.29:0/3574143798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b600b35b0 con 0x7f5b601664d0 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.519+0000 7f5b56ffd700 1 -- 172.21.15.29:0/3574143798 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b50014650 con 0x7f5b601664d0 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.520+0000 7f5b56ffd700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5b40066f30 0x7f5b400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.520+0000 7f5b56ffd700 1 -- 172.21.15.29:0/3574143798 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b50084b10 con 0x7f5b601664d0 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.520+0000 7f5b5effd700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5b40066f30 0x7f5b400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.521+0000 7f5b5effd700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5b40066f30 0x7f5b400693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b58012c90 tx=0x7f5b5801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.521+0000 7f5b6ec8eb80 1 Processor -- start 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.522+0000 7f5b6ec8eb80 1 -- start start 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.522+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476ef480 0x5575476ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.522+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476ef850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.522+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a4b80 0x5575476a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.522+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575475fba70 con 0x5575476a4b80 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.522+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575475f9270 con 0x5575476a25f0 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.522+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575475f5060 con 0x5575476ef480 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a4b80 0x5575476a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a4b80 0x5575476a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54324/0 (socket says 172.21.15.29:54324) 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/3627555215 learned_addr learned my addr 172.21.15.29:0/3627555215 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5effd700 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476ef480 0x5575476ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476ef480 msgr2=0x5575476ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476ef480 0x5575476ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 msgr2=0x5575476ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476ef850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/3627555215 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55754748f270 con 0x5575476a4b80 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a4b80 0x5575476a4ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5b50051f20 tx=0x7f5b50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f203f127f99146d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b3ffff700 1 -- 172.21.15.29:0/3627555215 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50055560 con 0x5575476a4b80 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b3ffff700 1 -- 172.21.15.29:0/3627555215 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b50058c70 con 0x5575476a4b80 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.523+0000 7f5b3ffff700 1 -- 172.21.15.29:0/3627555215 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5005c9c0 con 0x5575476a4b80 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3627555215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a4b80 msgr2=0x5575476a4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a4b80 0x5575476a4ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5b50051f20 tx=0x7f5b50008040 comp rx=0 tx=0).stop 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3627555215 shutdown_connections 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a4b80 0x5575476a4ff0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476ef480 0x5575476ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3627555215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3627555215 >> 172.21.15.29:0/3627555215 conn(0x5575476a60c0 msgr2=0x5575476a68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3627555215 shutdown_connections 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3627555215 wait complete. 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 -- start start 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.524+0000 7f5b6ec8eb80 1 Processor -- start 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.525+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a25f0 0x5575476cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.525+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 0x5575476fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.525+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476ef480 0x5575476ebf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.525+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575475a0890 con 0x5575476a25f0 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.525+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575475bbea0 con 0x5575476ef480 2023-10-08T15:41:18.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.525+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557547477e30 con 0x5575476a4b80 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.525+0000 7f5b6ec8eb80 10 client.0 _ll_register_callbacks cb 0x5575476682c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a25f0 0x5575476cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a25f0 0x5575476cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54330/0 (socket says 172.21.15.29:54330) 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 -- 172.21.15.29:0/3696057255 learned_addr learned my addr 172.21.15.29:0/3696057255 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476ef480 0x5575476ebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 0x5575476fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 -- 172.21.15.29:0/3696057255 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 msgr2=0x5575476fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 0x5575476fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 -- 172.21.15.29:0/3696057255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476ef480 msgr2=0x5575476ebf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476ef480 0x5575476ebf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 -- 172.21.15.29:0/3696057255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b600b35b0 con 0x5575476a25f0 2023-10-08T15:41:18.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b5effd700 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a25f0 0x5575476cf150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00c0a0 tx=0x7f5b58029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92017ca3f73854b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b3d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/3696057255 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58010a60 con 0x5575476a25f0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/3696057255 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b58010bc0 con 0x5575476a25f0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3696057255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557547699cd0 con 0x5575476a25f0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/3696057255 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b58029470 con 0x5575476a25f0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b6ec8eb80 10 client.5097 fetch_fsmap learned FSMap version 17 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3696057255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557547431fe0 con 0x5575476a25f0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.526+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/3696057255 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557547699cd0 con 0x5575476a25f0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/3696057255 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5b58036070 con 0x5575476a25f0 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b6ec8eb80 10 client.5097 fetch_fsmap finished waiting for FSMap version 17 2023-10-08T15:41:18.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b6ec8eb80 10 client.5097 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b6ec8eb80 20 client.5097 populate_metadata read hostname 'smithi029' 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] conn(0x5575476a5460 0x557547708c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b6ec8eb80 4 client.5097 mds_command: new command op to 4917 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3696057255 --> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557547676aa0 con 0x5575476a5460 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] conn(0x5575476a5460 0x557547708c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] conn(0x5575476a5460 0x557547708c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d3b1214ed9662 server_cookie=6b87bb2e0a065bd7 in_seq=0 out_seq=0 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.527+0000 7f5b3d7fa700 10 client.5097 ms_handle_connect on v2:172.21.15.29:6833/470731948 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/3696057255 <== mds.0 v2:172.21.15.29:6833/470731948 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557547676aa0 con 0x5575476a5460 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b3d7fa700 10 client.5097 handle_command_reply: tid=0 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 client.5097 shutdown 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3696057255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a25f0 msgr2=0x5575476cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a25f0 0x5575476cf150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00c0a0 tx=0x7f5b58029000 comp rx=0 tx=0).stop 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3696057255 shutdown_connections 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] conn(0x5575476a5460 0x557547708c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476ef480 0x5575476ebf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476a25f0 0x5575476cf150 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b3d7fa700 0 client.5097 ms_handle_reset on v2:172.21.15.29:6833/470731948 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/3696057255 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 0x5575476fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3696057255 >> 172.21.15.29:0/3696057255 conn(0x5575476a60c0 msgr2=0x5575476a8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3696057255 shutdown_connections 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/3696057255 wait complete. 2023-10-08T15:41:18.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.528+0000 7f5b6ec8eb80 20 client.5097 trim_cache size 0 max 16384 2023-10-08T15:41:18.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.545+0000 7f5b6ec8eb80 1 Processor -- start 2023-10-08T15:41:18.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.545+0000 7f5b6ec8eb80 1 -- start start 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476d49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 0x5575476a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x557547684510 con 0x5575476ef480 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575476a49f0 con 0x5575476a25f0 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575476a4200 con 0x5575476a4b80 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476a1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54332/0 (socket says 172.21.15.29:54332) 2023-10-08T15:41:18.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/2583671649 learned_addr learned my addr 172.21.15.29:0/2583671649 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 0x5575476a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5effd700 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476d49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/2583671649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 msgr2=0x5575476a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 0x5575476a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/2583671649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 msgr2=0x5575476d49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476d49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/2583671649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575475c3780 con 0x5575476ef480 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476a1fb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5b50080040 tx=0x7f5b50069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e732cc08d31b133e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b54ff9700 1 -- 172.21.15.29:0/2583671649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50061070 con 0x5575476ef480 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b54ff9700 1 -- 172.21.15.29:0/2583671649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5005c9c0 con 0x5575476ef480 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.546+0000 7f5b54ff9700 1 -- 172.21.15.29:0/2583671649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50006c50 con 0x5575476ef480 2023-10-08T15:41:18.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/2583671649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 msgr2=0x5575476a1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476a1fb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5b50080040 tx=0x7f5b50069000 comp rx=0 tx=0).stop 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/2583671649 shutdown_connections 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476a1fb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a25f0 0x5575476d49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/2583671649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a4b80 0x5575476a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/2583671649 >> 172.21.15.29:0/2583671649 conn(0x5575476a60c0 msgr2=0x5575476a6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/2583671649 shutdown_connections 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/2583671649 wait complete. 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 -- start start 2023-10-08T15:41:18.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.547+0000 7f5b6ec8eb80 1 Processor -- start 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a25f0 0x5575476ebf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a4b80 0x557547708e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b6ec8eb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575476d2630 con 0x5575476ef480 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575476fbef0 con 0x5575476a4b80 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b6ec8eb80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557547709890 con 0x5575476a25f0 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b6ec8eb80 10 client.0 _ll_register_callbacks cb 0x5575476682c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b5effd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a25f0 0x5575476ebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54338/0 (socket says 172.21.15.29:54338) 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.548+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/1192696396 learned_addr learned my addr 172.21.15.29:0/1192696396 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b5e7fc700 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a4b80 0x557547708e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/1192696396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a25f0 msgr2=0x5575476ebf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a25f0 0x5575476ebf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/1192696396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a4b80 msgr2=0x557547708e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a4b80 0x557547708e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b5f7fe700 1 -- 172.21.15.29:0/1192696396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55754748f270 con 0x5575476ef480 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b5f7fe700 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476c8690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5b50054010 tx=0x7f5b50061000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870cc7e793ff957d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b3d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/1192696396 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50006c50 con 0x5575476ef480 2023-10-08T15:41:18.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/1192696396 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b500830a0 con 0x5575476ef480 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/1192696396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b50058c70 con 0x5575476ef480 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/1192696396 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b5005c740 con 0x5575476ef480 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b6ec8eb80 10 client.5103 fetch_fsmap learned FSMap version 17 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/1192696396 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5575475aa470 con 0x5575476ef480 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/1192696396 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b50058c70 con 0x5575476ef480 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/1192696396 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5b50051810 con 0x5575476ef480 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b6ec8eb80 10 client.5103 fetch_fsmap finished waiting for FSMap version 17 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b6ec8eb80 10 client.5103 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.549+0000 7f5b6ec8eb80 20 client.5103 populate_metadata read hostname 'smithi029' 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] conn(0x5575476d3490 0x5575476d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 4 client.5103 mds_command: new command op to 4917 tid=0[{"prefix": "status"}] 2023-10-08T15:41:18.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/1192696396 --> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557547597e00 con 0x5575476d3490 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b5effd700 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] conn(0x5575476d3490 0x5575476d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b3d7fa700 10 client.5103 ms_handle_connect on v2:172.21.15.29:6833/470731948 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b5effd700 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] conn(0x5575476d3490 0x5575476d3860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3352abc023f535b server_cookie=28bddbc26e56bad0 in_seq=0 out_seq=0 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b3d7fa700 1 -- 172.21.15.29:0/1192696396 <== mds.0 v2:172.21.15.29:6833/470731948 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557547597e00 con 0x5575476d3490 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b3d7fa700 10 client.5103 handle_command_reply: tid=0 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 client.5103 shutdown 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/1192696396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 msgr2=0x5575476c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476c8690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5b50054010 tx=0x7f5b50061000 comp rx=0 tx=0).stop 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/1192696396 shutdown_connections 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.29:6833/470731948,v1:172.21.15.29:6835/470731948] conn(0x5575476d3490 0x5575476d3860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5575476ef480 0x5575476c8690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5575476a25f0 0x5575476ebf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 --2- 172.21.15.29:0/1192696396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5575476a4b80 0x557547708e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b3d7fa700 0 client.5103 ms_handle_reset on v2:172.21.15.29:6833/470731948 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.550+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/1192696396 >> 172.21.15.29:0/1192696396 conn(0x5575476a60c0 msgr2=0x5575476a1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/1192696396 shutdown_connections 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b6ec8eb80 1 -- 172.21.15.29:0/1192696396 wait complete. 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b6ec8eb80 20 client.5103 trim_cache size 0 max 16384 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:41:18.558 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4917, 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 5.8901309189999997, 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 17, 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 31, 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 31, 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 13.785354353000001 2023-10-08T15:41:18.559 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:41:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 -- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5b40066f30 msgr2=0x7f5b400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5b40066f30 0x7f5b400693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b58012c90 tx=0x7f5b5801f000 comp rx=0 tx=0).stop 2023-10-08T15:41:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 -- 172.21.15.29:0/3574143798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b601664d0 msgr2=0x7f5b60166940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b601664d0 0x7f5b60166940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5b50011970 tx=0x7f5b500091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 -- 172.21.15.29:0/3574143798 shutdown_connections 2023-10-08T15:41:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5b40066f30 0x7f5b400693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b601664d0 0x7f5b60166940 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b4c003a60 0x7f5b600c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 --2- 172.21.15.29:0/3574143798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b600b3140 0x7f5b60165f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 -- 172.21.15.29:0/3574143798 >> 172.21.15.29:0/3574143798 conn(0x7f5b600cd890 msgr2=0x7f5b6014fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 -- 172.21.15.29:0/3574143798 shutdown_connections 2023-10-08T15:41:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.551+0000 7f5b5ffff700 1 -- 172.21.15.29:0/3574143798 wait complete. 2023-10-08T15:41:18.563 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:41:18.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.682+0000 7fcea36ed700 1 Processor -- start 2023-10-08T15:41:18.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.682+0000 7fcea36ed700 1 -- start start 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea36ed700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fce9c159dd0 0x7fce9c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea36ed700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea36ed700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0cc590 con 0x7fce9c15db70 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea36ed700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c0cc870 con 0x7fce9c159dd0 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea36ed700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0ccb50 con 0x7fce9c0cbfd0 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea0c88700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fce9c15db70 0x7fce9c0c9000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36706/0 (socket says 172.21.15.29:36706) 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea0c88700 1 -- 172.21.15.29:0/1010851750 learned_addr learned my addr 172.21.15.29:0/1010851750 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea1489700 1 --2- 172.21.15.29:0/1010851750 >> v2:172.21.15.183:3300/0 conn(0x7fce9c159dd0 0x7fce9c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.683+0000 7fcea1c8a700 1 --2- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fce93fff700 1 -- 172.21.15.29:0/1010851750 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045437348 0 0) 0x7fce9c0cc590 con 0x7fce9c15db70 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fce93fff700 1 -- 172.21.15.29:0/1010851750 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce88003570 con 0x7fce9c15db70 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fcea1489700 1 -- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 msgr2=0x7fce9c0c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fcea1489700 1 --2- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c0c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fcea1489700 1 -- 172.21.15.29:0/1010851750 >> v1:172.21.15.29:6789/0 conn(0x7fce9c15db70 legacy=0x7fce9c0c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fcea1489700 1 -- 172.21.15.29:0/1010851750 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0cce30 con 0x7fce9c159dd0 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fcea1c8a700 1 --2- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c0c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fcea1489700 1 --2- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c159dd0 0x7fce9c15a1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fce980098e0 tx=0x7fce980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0ba9e99151dec4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fce93fff700 1 -- 172.21.15.29:0/1010851750 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98011630 con 0x7fce9c159dd0 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fce93fff700 1 -- 172.21.15.29:0/1010851750 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce98011790 con 0x7fce9c159dd0 2023-10-08T15:41:18.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.684+0000 7fce93fff700 1 -- 172.21.15.29:0/1010851750 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98011b30 con 0x7fce9c159dd0 2023-10-08T15:41:18.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.685+0000 7fcea36ed700 1 -- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c159dd0 msgr2=0x7fce9c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.685+0000 7fcea36ed700 1 --2- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c159dd0 0x7fce9c15a1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fce980098e0 tx=0x7fce980091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.685+0000 7fcea36ed700 1 -- 172.21.15.29:0/1010851750 shutdown_connections 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.685+0000 7fcea36ed700 1 --2- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c0c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.685+0000 7fcea36ed700 1 --2- 172.21.15.29:0/1010851750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c159dd0 0x7fce9c15a1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.685+0000 7fcea36ed700 1 -- 172.21.15.29:0/1010851750 >> 172.21.15.29:0/1010851750 conn(0x7fce9c0cd1e0 msgr2=0x7fce9c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.685+0000 7fcea36ed700 1 -- 172.21.15.29:0/1010851750 shutdown_connections 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.685+0000 7fcea36ed700 1 -- 172.21.15.29:0/1010851750 wait complete. 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.686+0000 7fcea36ed700 1 Processor -- start 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.686+0000 7fcea36ed700 1 -- start start 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea36ed700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea36ed700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce9c159dd0 0x7fce9c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea36ed700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c15db70 0x7fce9c06de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea36ed700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0b2d70 con 0x7fce9c159dd0 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea36ed700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c099a90 con 0x7fce9c15db70 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea36ed700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c099d70 con 0x7fce9c0cbfd0 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea0c88700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce9c159dd0 0x7fce9c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea0c88700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce9c159dd0 0x7fce9c06d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54354/0 (socket says 172.21.15.29:54354) 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea0c88700 1 -- 172.21.15.29:0/2063572710 learned_addr learned my addr 172.21.15.29:0/2063572710 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea1489700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea1c8a700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c15db70 0x7fce9c06de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea0c88700 1 -- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 msgr2=0x7fce9c14af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea0c88700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c14af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea0c88700 1 -- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c15db70 msgr2=0x7fce9c06de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea0c88700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c15db70 0x7fce9c06de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea0c88700 1 -- 172.21.15.29:0/2063572710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009a20 con 0x7fce9c159dd0 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea1489700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.687+0000 7fcea1c8a700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c15db70 0x7fce9c06de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.688+0000 7fcea0c88700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce9c159dd0 0x7fce9c06d8c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c7c0 tx=0x7fce8c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.688+0000 7fce917fa700 1 -- 172.21.15.29:0/2063572710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c005b30 con 0x7fce9c159dd0 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.688+0000 7fce917fa700 1 -- 172.21.15.29:0/2063572710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c005c90 con 0x7fce9c159dd0 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.688+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce98009420 con 0x7fce9c159dd0 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.688+0000 7fce917fa700 1 -- 172.21.15.29:0/2063572710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c007340 con 0x7fce9c159dd0 2023-10-08T15:41:18.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.688+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c09a330 con 0x7fce9c159dd0 2023-10-08T15:41:18.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.689+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c04c3c0 con 0x7fce9c159dd0 2023-10-08T15:41:18.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.689+0000 7fce917fa700 1 -- 172.21.15.29:0/2063572710 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce8c01b400 con 0x7fce9c159dd0 2023-10-08T15:41:18.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.690+0000 7fce917fa700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce80066f30 0x7fce800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:18.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.690+0000 7fce917fa700 1 -- 172.21.15.29:0/2063572710 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce8c084040 con 0x7fce9c159dd0 2023-10-08T15:41:18.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.690+0000 7fcea1489700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce80066f30 0x7fce800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:18.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.691+0000 7fcea1489700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce80066f30 0x7fce800693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fce98003080 tx=0x7fce98017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:18.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.694+0000 7fce917fa700 1 -- 172.21.15.29:0/2063572710 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce8c051330 con 0x7fce9c159dd0 2023-10-08T15:41:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.933+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce9c09ae90 con 0x7fce9c159dd0 2023-10-08T15:41:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.934+0000 7fce917fa700 1 -- 172.21.15.29:0/2063572710 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce8c054950 con 0x7fce9c159dd0 2023-10-08T15:41:18.934 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.935+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce80066f30 msgr2=0x7fce800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.935+0000 7fcea36ed700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce80066f30 0x7fce800693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fce98003080 tx=0x7fce98017000 comp rx=0 tx=0).stop 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.935+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce9c159dd0 msgr2=0x7fce9c06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.935+0000 7fcea36ed700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce9c159dd0 0x7fce9c06d8c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c7c0 tx=0x7fce8c007e00 comp rx=0 tx=0).stop 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.936+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 shutdown_connections 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.936+0000 7fcea36ed700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce80066f30 0x7fce800693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.936+0000 7fcea36ed700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce9c15db70 0x7fce9c06de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.936+0000 7fcea36ed700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce9c0cbfd0 0x7fce9c14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.936+0000 7fcea36ed700 1 --2- 172.21.15.29:0/2063572710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce9c159dd0 0x7fce9c06d8c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.936+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 >> 172.21.15.29:0/2063572710 conn(0x7fce9c0cd1e0 msgr2=0x7fce9c06e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.936+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 shutdown_connections 2023-10-08T15:41:18.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:18.936+0000 7fcea36ed700 1 -- 172.21.15.29:0/2063572710 wait complete. 2023-10-08T15:41:18.948 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T15:41:18.948 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:41:18.948 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-08T15:41:18.949 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T15:41:18.949 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:18.949 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T15:41:18.949 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T15:41:18.949 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:41:18.949 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:18.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:18.949 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2023-10-08T15:41:18.965 INFO:teuthology.orchestra.run.smithi029.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42432sec preferred_lft 42432sec 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:18.966 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 3e:15:f1:4d:13:04 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a0a1:d2ff:feb5:830d/64 scope link 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 3e:15:f1:4d:13:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::3c15:f1ff:fe4d:1304/64 scope link 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:18.967 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:18.968 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 86:7d:80:d6:2b:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T15:41:18.968 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::847d:80ff:fed6:2b39/64 scope link 2023-10-08T15:41:18.968 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:18.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:18.968 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:41:19.029 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-08T15:41:19.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:19.030 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-08T15:41:19.086 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-08T15:41:19.086 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:41:19.086 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T15:41:19.087 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T15:41:19.087 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:41:19.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:19.087 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:41:19.087 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:41:19.087 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T15:41:19.087 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T15:41:19.087 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T15:41:19.088 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:41:19.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:19.189 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T15:41:19.204 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T15:41:19.204 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T15:41:19.205 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:19.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:19.205 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-08T15:41:19.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:19.269 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:19.324 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:19.324 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:19.324 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:19.379 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T15:41:19.379 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:41:19.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:19.460 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:19.460 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:19.479 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:19.479 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:19.479 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:41:19.479 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:41:19.479 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:41:19.480 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:41:19.480 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:41:19.480 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-10-08T15:41:19.501 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-10-08T15:41:19.502 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=aa16b01f-3858-4fc7-9751-d7cb76fff138" will pass to kernel 2023-10-08T15:41:19.503 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T15:41:19.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:19.503 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:19.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:41:19.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.728+0000 7f1ea5548700 1 Processor -- start 2023-10-08T15:41:19.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.728+0000 7f1ea5548700 1 -- start start 2023-10-08T15:41:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1ea5548700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1ea015d5d0 0x7f1ea00b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1ea5548700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ea00b1610 0x7f1ea00b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1ea5548700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea009acf0 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1ea5548700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea00b2420 con 0x7f1ea00b1610 2023-10-08T15:41:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1ea5548700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea015d9a0 con 0x7f1ea015d5d0 2023-10-08T15:41:19.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ea00b1610 0x7f1ea00b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1ea00b1fc0 0x7f1ea00b3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36710/0 (socket says 172.21.15.29:36710) 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9f7fe700 1 -- 172.21.15.29:0/3259780737 learned_addr learned my addr 172.21.15.29:0/3259780737 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ea00b1610 0x7f1ea00b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54356/0 (socket says 172.21.15.29:54356) 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9effd700 1 --2- 172.21.15.29:0/3259780737 >> v2:172.21.15.183:3300/0 conn(0x7f1ea015d5d0 0x7f1ea00b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9e7fc700 1 -- 172.21.15.29:0/3259780737 >> v2:172.21.15.183:3300/0 conn(0x7f1ea015d5d0 msgr2=0x7f1ea00b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9e7fc700 1 --2- 172.21.15.29:0/3259780737 >> v2:172.21.15.183:3300/0 conn(0x7f1ea015d5d0 0x7f1ea00b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9e7fc700 1 -- 172.21.15.29:0/3259780737 >> v1:172.21.15.29:6789/0 conn(0x7f1ea00b1fc0 legacy=0x7f1ea00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9dffb700 1 -- 172.21.15.29:0/3259780737 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043075362 0 0) 0x7f1ea009acf0 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9e7fc700 1 -- 172.21.15.29:0/3259780737 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea00b4b20 con 0x7f1ea00b1610 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.729+0000 7f1e9effd700 1 --2- 172.21.15.29:0/3259780737 >> v2:172.21.15.183:3300/0 conn(0x7f1ea015d5d0 0x7f1ea00b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1e9e7fc700 1 --2- 172.21.15.29:0/3259780737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1610 0x7f1ea00b1a80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00b6d10 tx=0x7f1e880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee8d2be3326e586 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1e9dffb700 1 -- 172.21.15.29:0/3259780737 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800b740 con 0x7f1ea00b1610 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1e9dffb700 1 -- 172.21.15.29:0/3259780737 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800b8a0 con 0x7f1ea00b1610 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1e9dffb700 1 -- 172.21.15.29:0/3259780737 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800bc40 con 0x7f1ea00b1610 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1ea5548700 1 -- 172.21.15.29:0/3259780737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1610 msgr2=0x7f1ea00b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3259780737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1610 0x7f1ea00b1a80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00b6d10 tx=0x7f1e880091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1ea5548700 1 -- 172.21.15.29:0/3259780737 shutdown_connections 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3259780737 >> v2:172.21.15.183:3300/0 conn(0x7f1ea015d5d0 0x7f1ea00b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3259780737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1610 0x7f1ea00b1a80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1ea5548700 1 -- 172.21.15.29:0/3259780737 >> 172.21.15.29:0/3259780737 conn(0x7f1ea0067e40 msgr2=0x7f1ea00d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1ea5548700 1 -- 172.21.15.29:0/3259780737 shutdown_connections 2023-10-08T15:41:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.730+0000 7f1ea5548700 1 -- 172.21.15.29:0/3259780737 wait complete. 2023-10-08T15:41:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.731+0000 7f1ea5548700 1 Processor -- start 2023-10-08T15:41:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1ea5548700 1 -- start start 2023-10-08T15:41:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1ea5548700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea00b1610 0x7f1ea009d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:19.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1ea5548700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1fc0 0x7f1ea0148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1ea5548700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea015d5d0 0x7f1ea00ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1ea5548700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea009cc90 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1ea5548700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea009e7c0 con 0x7f1ea00b1610 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1ea5548700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea009c360 con 0x7f1ea015d5d0 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1e9e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1fc0 0x7f1ea0148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1e9e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1fc0 0x7f1ea0148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54372/0 (socket says 172.21.15.29:54372) 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.732+0000 7f1e9e7fc700 1 -- 172.21.15.29:0/3290838182 learned_addr learned my addr 172.21.15.29:0/3290838182 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9effd700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea00b1610 0x7f1ea009d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:19.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9f7fe700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea015d5d0 0x7f1ea00ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9e7fc700 1 -- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea015d5d0 msgr2=0x7f1ea00ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9e7fc700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea015d5d0 0x7f1ea00ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9e7fc700 1 -- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea00b1610 msgr2=0x7f1ea009d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9e7fc700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea00b1610 0x7f1ea009d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9e7fc700 1 -- 172.21.15.29:0/3290838182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009420 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9effd700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea00b1610 0x7f1ea009d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9f7fe700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea015d5d0 0x7f1ea00ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e9e7fc700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1fc0 0x7f1ea0148ff0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ea006b9c0 tx=0x7f1e88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e96ffd700 1 -- 172.21.15.29:0/3290838182 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8801f070 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e96ffd700 1 -- 172.21.15.29:0/3290838182 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800ba10 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1e96ffd700 1 -- 172.21.15.29:0/3290838182 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88025420 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea009c640 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.733+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea009d660 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.734+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea009ce00 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.734+0000 7f1e96ffd700 1 -- 172.21.15.29:0/3290838182 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e88023070 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.735+0000 7f1e96ffd700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e80066f30 0x7f1e800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.735+0000 7f1e96ffd700 1 -- 172.21.15.29:0/3290838182 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e88085bb0 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.735+0000 7f1e9effd700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e80066f30 0x7f1e800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:19.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.735+0000 7f1e9effd700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e80066f30 0x7f1e800693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800d4a0 tx=0x7f1e980075d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:19.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.739+0000 7f1e96ffd700 1 -- 172.21.15.29:0/3290838182 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e88052e20 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.978+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ea00b4e00 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.978+0000 7f1e96ffd700 1 -- 172.21.15.29:0/3290838182 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e88056440 con 0x7f1ea00b1fc0 2023-10-08T15:41:19.979 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:41:19.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e80066f30 msgr2=0x7f1e800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:19.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e80066f30 0x7f1e800693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800d4a0 tx=0x7f1e980075d0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1fc0 msgr2=0x7f1ea0148ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1fc0 0x7f1ea0148ff0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ea006b9c0 tx=0x7f1e88017000 comp rx=0 tx=0).stop 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 shutdown_connections 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e80066f30 0x7f1e800693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea015d5d0 0x7f1ea00ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea00b1610 0x7f1ea009d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 --2- 172.21.15.29:0/3290838182 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ea00b1fc0 0x7f1ea0148ff0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 >> 172.21.15.29:0/3290838182 conn(0x7f1ea0067e40 msgr2=0x7f1ea015b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 shutdown_connections 2023-10-08T15:41:19.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:19.980+0000 7f1ea5548700 1 -- 172.21.15.29:0/3290838182 wait complete. 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:41:19.993 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:41:19.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:19.994 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-10-08T15:41:20.013 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:41:20.013 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:41:20.013 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:41:20.013 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:20.013 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-10-08T15:41:20.013 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:20.013 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:20.013 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42421sec preferred_lft 42421sec 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-10-08T15:41:20.014 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:2f:27:f5:c4:ba brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::f8f9:ecff:fe70:2278/64 scope link 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:2f:27:f5:c4:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::2f:27ff:fef5:c4ba/64 scope link 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:20.015 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether ea:2a:e0:41:f8:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T15:41:20.016 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::e82a:e0ff:fe41:f881/64 scope link 2023-10-08T15:41:20.016 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:20.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:20.016 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:41:20.082 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-10-08T15:41:20.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:20.084 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-10-08T15:41:20.143 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-10-08T15:41:20.143 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:41:20.143 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:41:20.143 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T15:41:20.143 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:41:20.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:20.144 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:41:20.144 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:41:20.144 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:41:20.144 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:41:20.144 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:41:20.144 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:41:20.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:20.250 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-10-08T15:41:20.266 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T15:41:20.266 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T15:41:20.266 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:41:20.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:20.266 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-10-08T15:41:20.332 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:20.332 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:20.388 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:41:20.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:20.388 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:20.443 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T15:41:20.443 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:41:20.443 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:20.523 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:20.523 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:20.542 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:20.542 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:20.543 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:41:20.543 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with new device syntax: 1@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:41:20.543 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:41:20.543 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:41:20.543 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:41:20.543 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:41:20.565 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:20.565 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:20.565 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:41:20.566 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with new device syntax: 1@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:41:20.566 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:41:20.566 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:41:20.566 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:41:20.566 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:41:20.566 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-10-08T15:41:20.566 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-10-08T15:41:20.566 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=aa16b01f-3858-4fc7-9751-d7cb76fff138" will pass to kernel 2023-10-08T15:41:20.570 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T15:41:20.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:20.570 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:20.635 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.763+0000 7f3a220dd700 1 Processor -- start 2023-10-08T15:41:20.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.763+0000 7f3a220dd700 1 -- start start 2023-10-08T15:41:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a220dd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a1c15a2b0 0x7f3a1c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a220dd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c0cfe20 0x7f3a1c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a220dd700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c0c5d80 con 0x7f3a1c0d1c30 2023-10-08T15:41:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a220dd700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c068470 con 0x7f3a1c15a2b0 2023-10-08T15:41:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a220dd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0c6060 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a1b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3a1c15a2b0 0x7f3a1c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:20.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a1affd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3a1c0d1c30 0x7f3a1c0cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36720/0 (socket says 172.21.15.29:36720) 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a1affd700 1 -- 172.21.15.29:0/1206467601 learned_addr learned my addr 172.21.15.29:0/1206467601 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.764+0000 7f3a1bfff700 1 --2- 172.21.15.29:0/1206467601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c0cfe20 0x7f3a1c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1b7fe700 1 -- 172.21.15.29:0/1206467601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c0cfe20 msgr2=0x7f3a1c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1b7fe700 1 --2- 172.21.15.29:0/1206467601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c0cfe20 0x7f3a1c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1b7fe700 1 -- 172.21.15.29:0/1206467601 >> v1:172.21.15.29:6789/0 conn(0x7f3a1c0d1c30 legacy=0x7f3a1c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1b7fe700 1 -- 172.21.15.29:0/1206467601 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0c6340 con 0x7f3a1c15a2b0 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1a7fc700 1 -- 172.21.15.29:0/1206467601 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398646061 0 0) 0x7f3a1c0c5d80 con 0x7f3a1c0d1c30 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1b7fe700 1 --2- 172.21.15.29:0/1206467601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c15a2b0 0x7f3a1c0b3da0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0098d0 tx=0x7f3a0c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8e8cf0d155dbc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1a7fc700 1 -- 172.21.15.29:0/1206467601 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c005c10 con 0x7f3a1c15a2b0 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1a7fc700 1 -- 172.21.15.29:0/1206467601 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c005d70 con 0x7f3a1c15a2b0 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a1a7fc700 1 -- 172.21.15.29:0/1206467601 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c006280 con 0x7f3a1c15a2b0 2023-10-08T15:41:20.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a220dd700 1 -- 172.21.15.29:0/1206467601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c15a2b0 msgr2=0x7f3a1c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a220dd700 1 --2- 172.21.15.29:0/1206467601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c15a2b0 0x7f3a1c0b3da0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0098d0 tx=0x7f3a0c009120 comp rx=0 tx=0).stop 2023-10-08T15:41:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a220dd700 1 -- 172.21.15.29:0/1206467601 shutdown_connections 2023-10-08T15:41:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a220dd700 1 --2- 172.21.15.29:0/1206467601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c0cfe20 0x7f3a1c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a220dd700 1 --2- 172.21.15.29:0/1206467601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c15a2b0 0x7f3a1c0b3da0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.765+0000 7f3a220dd700 1 -- 172.21.15.29:0/1206467601 >> 172.21.15.29:0/1206467601 conn(0x7f3a1c067e40 msgr2=0x7f3a1c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.766+0000 7f3a220dd700 1 -- 172.21.15.29:0/1206467601 shutdown_connections 2023-10-08T15:41:20.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.766+0000 7f3a220dd700 1 -- 172.21.15.29:0/1206467601 wait complete. 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.767+0000 7f3a220dd700 1 Processor -- start 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.767+0000 7f3a220dd700 1 -- start start 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.767+0000 7f3a220dd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c0cfe20 0x7f3a1c0c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a220dd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a1c0d1c30 0x7f3a1c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a220dd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c15a2b0 0x7f3a1c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a220dd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c09ae30 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a220dd700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0c96f0 con 0x7f3a1c0d1c30 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a220dd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0c99d0 con 0x7f3a1c15a2b0 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c0cfe20 0x7f3a1c0c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:20.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c0cfe20 0x7f3a1c0c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54384/0 (socket says 172.21.15.29:54384) 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 -- 172.21.15.29:0/3946735349 learned_addr learned my addr 172.21.15.29:0/3946735349 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1bfff700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c15a2b0 0x7f3a1c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1affd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a1c0d1c30 0x7f3a1c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 -- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c15a2b0 msgr2=0x7f3a1c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c15a2b0 0x7f3a1c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 -- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a1c0d1c30 msgr2=0x7f3a1c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a1c0d1c30 0x7f3a1c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 -- 172.21.15.29:0/3946735349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0093c0 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1affd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a1c0d1c30 0x7f3a1c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a1b7fe700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c0cfe20 0x7f3a1c0c9060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009f70 tx=0x7f3a0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:20.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a037fe700 1 -- 172.21.15.29:0/3946735349 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c01d780 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a037fe700 1 -- 172.21.15.29:0/3946735349 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c01d900 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c0c9cb0 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a037fe700 1 -- 172.21.15.29:0/3946735349 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c01dcc0 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.768+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c0ca270 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.769+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c0ca460 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.770+0000 7f3a037fe700 1 -- 172.21.15.29:0/3946735349 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a0c01b690 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.770+0000 7f3a037fe700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a08066f30 0x7f3a080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.770+0000 7f3a037fe700 1 -- 172.21.15.29:0/3946735349 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a0c086220 con 0x7f3a1c0cfe20 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.770+0000 7f3a1affd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a08066f30 0x7f3a080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:20.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.771+0000 7f3a1affd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a08066f30 0x7f3a080693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0d2000 tx=0x7f3a10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:20.775+0000 7f3a037fe700 1 -- 172.21.15.29:0/3946735349 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a0c053490 con 0x7f3a1c0cfe20 2023-10-08T15:41:21.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.009+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a1c04c3c0 con 0x7f3a1c0cfe20 2023-10-08T15:41:21.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.010+0000 7f3a037fe700 1 -- 172.21.15.29:0/3946735349 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f3a0c056ab0 con 0x7f3a1c0cfe20 2023-10-08T15:41:21.011 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:21.011 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:12.039331+0000","modified":"2023-10-08T15:41:15.672568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/470731948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":470731948},{"type":"v1","addr":"172.21.15.29:6835","nonce":470731948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:41:21.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a08066f30 msgr2=0x7f3a080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:21.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a08066f30 0x7f3a080693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0d2000 tx=0x7f3a10009040 comp rx=0 tx=0).stop 2023-10-08T15:41:21.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c0cfe20 msgr2=0x7f3a1c0c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:21.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c0cfe20 0x7f3a1c0c9060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009f70 tx=0x7f3a0c016000 comp rx=0 tx=0).stop 2023-10-08T15:41:21.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 shutdown_connections 2023-10-08T15:41:21.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3a08066f30 0x7f3a080693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a1c15a2b0 0x7f3a1c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a1c0cfe20 0x7f3a1c0c9060 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 --2- 172.21.15.29:0/3946735349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a1c0d1c30 0x7f3a1c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 >> 172.21.15.29:0/3946735349 conn(0x7f3a1c067e40 msgr2=0x7f3a1c0d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 shutdown_connections 2023-10-08T15:41:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.012+0000 7f3a220dd700 1 -- 172.21.15.29:0/3946735349 wait complete. 2023-10-08T15:41:21.014 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-08T15:41:21.025 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-08T15:41:21.164 INFO:teuthology.orchestra.run.smithi029.stdout:{"cluster_fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","whoami":0,"id":4917,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.4933325760000002,"mdsmap_epoch":17,"osdmap_epoch":31,"osdmap_epoch_barrier":31,"uptime":16.388558549999999} 2023-10-08T15:41:21.164 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", "fs_name": "cephfs", "id": 4917, "mdsmap_epoch": 17, "osdmap_epoch": 31, "osdmap_epoch_barrier": 31, "rank_uptime": 8.493332576, "state": "up:active", "uptime": 16.38855855, "want_state": "up:active", "whoami": 0 } 2023-10-08T15:41:21.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-10-08T15:41:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.282+0000 7f1df567a700 1 Processor -- start 2023-10-08T15:41:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.282+0000 7f1df567a700 1 -- start start 2023-10-08T15:41:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1df567a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1df0159eb0 0x7f1df00ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:21.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1df567a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0069a90 0x7f1df0069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1df567a700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df006a410 con 0x7f1df0159ae0 2023-10-08T15:41:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1df567a700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df00c9140 con 0x7f1df0159eb0 2023-10-08T15:41:21.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1df567a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df015dcb0 con 0x7f1df0069a90 2023-10-08T15:41:21.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1dee7fc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1df0159eb0 0x7f1df00ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:21.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1def7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0069a90 0x7f1df0069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1deeffd700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f1df0159ae0 0x7f1df0068ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:36128/0 (socket says 172.21.15.29:36128) 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.283+0000 7f1deeffd700 1 -- 172.21.15.29:0/2627064095 learned_addr learned my addr 172.21.15.29:0/2627064095 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1dedffb700 1 -- 172.21.15.29:0/2627064095 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201631736 0 0) 0x7f1df006a410 con 0x7f1df0159ae0 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1dedffb700 1 -- 172.21.15.29:0/2627064095 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ddc003570 con 0x7f1df0159ae0 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1def7fe700 1 -- 172.21.15.29:0/2627064095 >> v2:172.21.15.183:3300/0 conn(0x7f1df0159eb0 msgr2=0x7f1df00ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1def7fe700 1 --2- 172.21.15.29:0/2627064095 >> v2:172.21.15.183:3300/0 conn(0x7f1df0159eb0 0x7f1df00ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1def7fe700 1 -- 172.21.15.29:0/2627064095 >> v1:172.21.15.183:6789/0 conn(0x7f1df0159ae0 legacy=0x7f1df0068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1def7fe700 1 -- 172.21.15.29:0/2627064095 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df015df90 con 0x7f1df0069a90 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1dee7fc700 1 --2- 172.21.15.29:0/2627064095 >> v2:172.21.15.183:3300/0 conn(0x7f1df0159eb0 0x7f1df00ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:21.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1def7fe700 1 --2- 172.21.15.29:0/2627064095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0069a90 0x7f1df0069ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1de80098e0 tx=0x7f1de80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=583b83a5f5936116 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1dedffb700 1 -- 172.21.15.29:0/2627064095 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8011630 con 0x7f1df0069a90 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1dedffb700 1 -- 172.21.15.29:0/2627064095 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de8011790 con 0x7f1df0069a90 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.284+0000 7f1dedffb700 1 -- 172.21.15.29:0/2627064095 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8011b10 con 0x7f1df0069a90 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.285+0000 7f1df567a700 1 -- 172.21.15.29:0/2627064095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0069a90 msgr2=0x7f1df0069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.285+0000 7f1df567a700 1 --2- 172.21.15.29:0/2627064095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0069a90 0x7f1df0069ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1de80098e0 tx=0x7f1de80091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.285+0000 7f1df567a700 1 -- 172.21.15.29:0/2627064095 shutdown_connections 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.285+0000 7f1df567a700 1 --2- 172.21.15.29:0/2627064095 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0069a90 0x7f1df0069ed0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.285+0000 7f1df567a700 1 --2- 172.21.15.29:0/2627064095 >> v2:172.21.15.183:3300/0 conn(0x7f1df0159eb0 0x7f1df00ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.285+0000 7f1df567a700 1 -- 172.21.15.29:0/2627064095 >> 172.21.15.29:0/2627064095 conn(0x7f1df0070700 msgr2=0x7f1df0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.285+0000 7f1df567a700 1 -- 172.21.15.29:0/2627064095 shutdown_connections 2023-10-08T15:41:21.287 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.285+0000 7f1df567a700 1 -- 172.21.15.29:0/2627064095 wait complete. 2023-10-08T15:41:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.286+0000 7f1df567a700 1 Processor -- start 2023-10-08T15:41:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.286+0000 7f1df567a700 1 -- start start 2023-10-08T15:41:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1df567a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df0069a90 0x7f1df00c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:21.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1df567a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0159ae0 0x7f1df00c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1df567a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1df0159eb0 0x7f1df00af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1df567a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00b3fb0 con 0x7f1df0069a90 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1df567a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00c78d0 con 0x7f1df0159eb0 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1df567a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df00b3330 con 0x7f1df0159ae0 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df0069a90 0x7f1df00c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df0069a90 0x7f1df00c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54398/0 (socket says 172.21.15.29:54398) 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 -- 172.21.15.29:0/3474241648 learned_addr learned my addr 172.21.15.29:0/3474241648 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1dee7fc700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0159ae0 0x7f1df00c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1def7fe700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1df0159eb0 0x7f1df00af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:21.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 -- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0159ae0 msgr2=0x7f1df00c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0159ae0 0x7f1df00c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 -- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1df0159eb0 msgr2=0x7f1df00af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1df0159eb0 0x7f1df00af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 -- 172.21.15.29:0/3474241648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8009420 con 0x7f1df0069a90 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1deeffd700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df0069a90 0x7f1df00c7390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1de000cd00 tx=0x7f1de0001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1de6ffd700 1 -- 172.21.15.29:0/3474241648 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000ce60 con 0x7f1df0069a90 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.287+0000 7f1de6ffd700 1 -- 172.21.15.29:0/3474241648 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000ab10 con 0x7f1df0069a90 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.288+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de8009420 con 0x7f1df0069a90 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.288+0000 7f1de6ffd700 1 -- 172.21.15.29:0/3474241648 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de00070f0 con 0x7f1df0069a90 2023-10-08T15:41:21.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.288+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df00b38f0 con 0x7f1df0069a90 2023-10-08T15:41:21.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.288+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df00ce530 con 0x7f1df0069a90 2023-10-08T15:41:21.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.289+0000 7f1de6ffd700 1 -- 172.21.15.29:0/3474241648 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1de0007460 con 0x7f1df0069a90 2023-10-08T15:41:21.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.289+0000 7f1de6ffd700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1dd0066f30 0x7f1dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:21.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.289+0000 7f1de6ffd700 1 -- 172.21.15.29:0/3474241648 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1de00849c0 con 0x7f1df0069a90 2023-10-08T15:41:21.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.289+0000 7f1dee7fc700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1dd0066f30 0x7f1dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:21.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.290+0000 7f1dee7fc700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1dd0066f30 0x7f1dd00693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1df00ce390 tx=0x7f1dd80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:21.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.294+0000 7f1de6ffd700 1 -- 172.21.15.29:0/3474241648 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1de0051cb0 con 0x7f1df0069a90 2023-10-08T15:41:21.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.567+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f1df015e270 con 0x7f1df0069a90 2023-10-08T15:41:21.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.567+0000 7f1de6ffd700 1 -- 172.21.15.29:0/3474241648 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7f1de00552d0 con 0x7f1df0069a90 2023-10-08T15:41:21.569 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:21.569 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:41:21.569 INFO:teuthology.orchestra.run.smithi029.stdout: "stats": { 2023-10-08T15:41:21.569 INFO:teuthology.orchestra.run.smithi029.stdout: "total_bytes": 1600000000, 2023-10-08T15:41:21.569 INFO:teuthology.orchestra.run.smithi029.stdout: "total_avail_bytes": 1597746220, 2023-10-08T15:41:21.569 INFO:teuthology.orchestra.run.smithi029.stdout: "total_used_bytes": 2253780, 2023-10-08T15:41:21.570 INFO:teuthology.orchestra.run.smithi029.stdout: "total_used_raw_bytes": 2253780, 2023-10-08T15:41:21.570 INFO:teuthology.orchestra.run.smithi029.stdout: "total_used_raw_ratio": 0.0014086124720051885, 2023-10-08T15:41:21.570 INFO:teuthology.orchestra.run.smithi029.stdout: "num_osds": 8, 2023-10-08T15:41:21.570 INFO:teuthology.orchestra.run.smithi029.stdout: "num_per_pool_osds": 0, 2023-10-08T15:41:21.570 INFO:teuthology.orchestra.run.smithi029.stdout: "num_per_pool_omap_osds": 0 2023-10-08T15:41:21.571 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:21.571 INFO:teuthology.orchestra.run.smithi029.stdout: "stats_by_class": { 2023-10-08T15:41:21.571 INFO:teuthology.orchestra.run.smithi029.stdout: "hdd": { 2023-10-08T15:41:21.571 INFO:teuthology.orchestra.run.smithi029.stdout: "total_bytes": 1600000000, 2023-10-08T15:41:21.571 INFO:teuthology.orchestra.run.smithi029.stdout: "total_avail_bytes": 1597746220, 2023-10-08T15:41:21.571 INFO:teuthology.orchestra.run.smithi029.stdout: "total_used_bytes": 2253780, 2023-10-08T15:41:21.572 INFO:teuthology.orchestra.run.smithi029.stdout: "total_used_raw_bytes": 2253780, 2023-10-08T15:41:21.572 INFO:teuthology.orchestra.run.smithi029.stdout: "total_used_raw_ratio": 0.0014086124720051885 2023-10-08T15:41:21.572 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:21.572 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:21.572 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2023-10-08T15:41:21.572 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:21.572 INFO:teuthology.orchestra.run.smithi029.stdout: "name": ".mgr", 2023-10-08T15:41:21.573 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 1, 2023-10-08T15:41:21.573 INFO:teuthology.orchestra.run.smithi029.stdout: "stats": { 2023-10-08T15:41:21.573 INFO:teuthology.orchestra.run.smithi029.stdout: "stored": 590368, 2023-10-08T15:41:21.573 INFO:teuthology.orchestra.run.smithi029.stdout: "objects": 2, 2023-10-08T15:41:21.573 INFO:teuthology.orchestra.run.smithi029.stdout: "kb_used": 577, 2023-10-08T15:41:21.573 INFO:teuthology.orchestra.run.smithi029.stdout: "bytes_used": 590368, 2023-10-08T15:41:21.573 INFO:teuthology.orchestra.run.smithi029.stdout: "percent_used": 0.00052957510342821479, 2023-10-08T15:41:21.574 INFO:teuthology.orchestra.run.smithi029.stdout: "max_avail": 557102656 2023-10-08T15:41:21.574 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:21.574 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:21.574 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:21.574 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephfs_metadata", 2023-10-08T15:41:21.574 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4, 2023-10-08T15:41:21.574 INFO:teuthology.orchestra.run.smithi029.stdout: "stats": { 2023-10-08T15:41:21.574 INFO:teuthology.orchestra.run.smithi029.stdout: "stored": 2306, 2023-10-08T15:41:21.575 INFO:teuthology.orchestra.run.smithi029.stdout: "objects": 22, 2023-10-08T15:41:21.575 INFO:teuthology.orchestra.run.smithi029.stdout: "kb_used": 3, 2023-10-08T15:41:21.575 INFO:teuthology.orchestra.run.smithi029.stdout: "bytes_used": 2306, 2023-10-08T15:41:21.575 INFO:teuthology.orchestra.run.smithi029.stdout: "percent_used": 2.0696322735602735e-06, 2023-10-08T15:41:21.575 INFO:teuthology.orchestra.run.smithi029.stdout: "max_avail": 557102656 2023-10-08T15:41:21.576 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:21.576 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:21.576 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:21.576 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephfs_data", 2023-10-08T15:41:21.576 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5, 2023-10-08T15:41:21.577 INFO:teuthology.orchestra.run.smithi029.stdout: "stats": { 2023-10-08T15:41:21.577 INFO:teuthology.orchestra.run.smithi029.stdout: "stored": 0, 2023-10-08T15:41:21.577 INFO:teuthology.orchestra.run.smithi029.stdout: "objects": 0, 2023-10-08T15:41:21.577 INFO:teuthology.orchestra.run.smithi029.stdout: "kb_used": 0, 2023-10-08T15:41:21.577 INFO:teuthology.orchestra.run.smithi029.stdout: "bytes_used": 0, 2023-10-08T15:41:21.578 INFO:teuthology.orchestra.run.smithi029.stdout: "percent_used": 0, 2023-10-08T15:41:21.578 INFO:teuthology.orchestra.run.smithi029.stdout: "max_avail": 557102656 2023-10-08T15:41:21.578 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:21.578 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:21.578 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:21.579 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:41:21.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1dd0066f30 msgr2=0x7f1dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:21.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1dd0066f30 0x7f1dd00693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1df00ce390 tx=0x7f1dd80091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df0069a90 msgr2=0x7f1df00c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:21.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df0069a90 0x7f1df00c7390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1de000cd00 tx=0x7f1de0001b00 comp rx=0 tx=0).stop 2023-10-08T15:41:21.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 shutdown_connections 2023-10-08T15:41:21.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1dd0066f30 0x7f1dd00693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1df0159eb0 0x7f1df00af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1df0069a90 0x7f1df00c7390 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 --2- 172.21.15.29:0/3474241648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1df0159ae0 0x7f1df00c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:21.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 >> 172.21.15.29:0/3474241648 conn(0x7f1df0070700 msgr2=0x7f1df00ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 shutdown_connections 2023-10-08T15:41:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:21.570+0000 7f1df567a700 1 -- 172.21.15.29:0/3474241648 wait complete. 2023-10-08T15:41:21.585 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:41:21.585 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-08T15:41:21.585 DEBUG:teuthology.orchestra.run.smithi029:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T15:41:21.585 DEBUG:teuthology.orchestra.run.smithi029:> os.fchmod(fd, 0O666) 2023-10-08T15:41:21.586 DEBUG:teuthology.orchestra.run.smithi029:> os.fsync(fd) 2023-10-08T15:41:21.586 DEBUG:teuthology.orchestra.run.smithi029:> os.close(fd) 2023-10-08T15:41:21.586 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-08T15:41:21.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:21.841 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T15:41:21.911 INFO:teuthology.orchestra.run.smithi029.stdout:client5032 2023-10-08T15:41:21.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:21.912 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa16b01f-3858-4fc7-9751-d7cb76fff138.client5032/osdmap') 2023-10-08T15:41:21.990 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 31 barrier 31 flags 0x588000 2023-10-08T15:41:21.990 INFO:teuthology.orchestra.run.smithi029.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:21.990 INFO:teuthology.orchestra.run.smithi029.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:osd0 (1)172.21.15.29:6801 100% (exists, up) 100% -1 2023-10-08T15:41:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:osd1 (1)172.21.15.29:6809 100% (exists, up) 100% -1 2023-10-08T15:41:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:osd2 (1)172.21.15.29:6817 100% (exists, up) 100% -1 2023-10-08T15:41:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:osd3 (1)172.21.15.29:6824 100% (exists, up) 100% -1 2023-10-08T15:41:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:osd4 (1)172.21.15.183:6821 100% (exists, up) 100% -1 2023-10-08T15:41:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:osd5 (1)172.21.15.183:6817 100% (exists, up) 100% -1 2023-10-08T15:41:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:osd6 (1)172.21.15.183:6801 100% (exists, up) 100% -1 2023-10-08T15:41:21.992 INFO:teuthology.orchestra.run.smithi029.stdout:osd7 (1)172.21.15.183:6809 100% (exists, up) 100% -1 2023-10-08T15:41:21.992 INFO:teuthology.orchestra.run.smithi029.stderr:1+1 records in 2023-10-08T15:41:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:1+1 records out 2023-10-08T15:41:21.993 INFO:teuthology.orchestra.run.smithi029.stderr:795 bytes copied, 4.2021e-05 s, 18.9 MB/s 2023-10-08T15:41:21.993 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-08T15:41:22.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.152+0000 7f93669f7700 1 Processor -- start 2023-10-08T15:41:22.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.153+0000 7f93669f7700 1 -- start start 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.153+0000 7f93669f7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f93600cfe20 0x7f93600ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.153+0000 7f93669f7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93600c5d80 con 0x7f936015a2b0 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.153+0000 7f93669f7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93600c6060 con 0x7f93600d1c30 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.153+0000 7f93669f7700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9360068470 con 0x7f93600cfe20 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.153+0000 7f935ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f936015a2b0 0x7f93600b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36724/0 (socket says 172.21.15.29:36724) 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f935ffff700 1 -- 172.21.15.29:0/1917410023 learned_addr learned my addr 172.21.15.29:0/1917410023 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f9364f94700 1 --2- 172.21.15.29:0/1917410023 >> v2:172.21.15.183:3300/0 conn(0x7f93600cfe20 0x7f93600ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f935effd700 1 -- 172.21.15.29:0/1917410023 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982009512 0 0) 0x7f93600c5d80 con 0x7f936015a2b0 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f935effd700 1 -- 172.21.15.29:0/1917410023 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9348003570 con 0x7f936015a2b0 2023-10-08T15:41:22.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f9364f94700 1 -- 172.21.15.29:0/1917410023 >> v1:172.21.15.183:6789/0 conn(0x7f93600d1c30 legacy=0x7f93600cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f9364f94700 1 -- 172.21.15.29:0/1917410023 >> v1:172.21.15.29:6789/0 conn(0x7f936015a2b0 legacy=0x7f93600b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f9364f94700 1 -- 172.21.15.29:0/1917410023 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93600c6340 con 0x7f93600cfe20 2023-10-08T15:41:22.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f9364f94700 1 --2- 172.21.15.29:0/1917410023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 0x7f93600ccdd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e60 tx=0x7f9358009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=394a4663117dbfae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:22.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f935effd700 1 -- 172.21.15.29:0/1917410023 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800e070 con 0x7f93600cfe20 2023-10-08T15:41:22.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f935effd700 1 -- 172.21.15.29:0/1917410023 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935800bb60 con 0x7f93600cfe20 2023-10-08T15:41:22.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.154+0000 7f935effd700 1 -- 172.21.15.29:0/1917410023 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358012430 con 0x7f93600cfe20 2023-10-08T15:41:22.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.155+0000 7f93669f7700 1 -- 172.21.15.29:0/1917410023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 msgr2=0x7f93600ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.155+0000 7f93669f7700 1 --2- 172.21.15.29:0/1917410023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 0x7f93600ccdd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e60 tx=0x7f9358009780 comp rx=0 tx=0).stop 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.155+0000 7f93669f7700 1 -- 172.21.15.29:0/1917410023 shutdown_connections 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.155+0000 7f93669f7700 1 --2- 172.21.15.29:0/1917410023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 0x7f93600ccdd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.155+0000 7f93669f7700 1 -- 172.21.15.29:0/1917410023 >> 172.21.15.29:0/1917410023 conn(0x7f9360067e40 msgr2=0x7f93600d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.155+0000 7f93669f7700 1 -- 172.21.15.29:0/1917410023 shutdown_connections 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.155+0000 7f93669f7700 1 -- 172.21.15.29:0/1917410023 wait complete. 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.156+0000 7f93669f7700 1 Processor -- start 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.156+0000 7f93669f7700 1 -- start start 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f93669f7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 0x7f936015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f93669f7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93600d1c30 0x7f936016d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f93669f7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f936015a2b0 0x7f936016de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f93669f7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93600c9f00 con 0x7f93600d1c30 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f93669f7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93600ca1e0 con 0x7f93600cfe20 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f93669f7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93600ca4c0 con 0x7f936015a2b0 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93600d1c30 0x7f936016d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93600d1c30 0x7f936016d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54414/0 (socket says 172.21.15.29:54414) 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935f7fe700 1 -- 172.21.15.29:0/2318582769 learned_addr learned my addr 172.21.15.29:0/2318582769 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f9364f94700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f936015a2b0 0x7f936016de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935ffff700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 0x7f936015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935f7fe700 1 -- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f936015a2b0 msgr2=0x7f936016de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935f7fe700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f936015a2b0 0x7f936016de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935f7fe700 1 -- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 msgr2=0x7f936015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935f7fe700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 0x7f936015d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.157+0000 7f935f7fe700 1 -- 172.21.15.29:0/2318582769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9358009a20 con 0x7f93600d1c30 2023-10-08T15:41:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.158+0000 7f935f7fe700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93600d1c30 0x7f936016d8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f935400c4e0 tx=0x7f9354007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.158+0000 7f9347fff700 1 -- 172.21.15.29:0/2318582769 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354011590 con 0x7f93600d1c30 2023-10-08T15:41:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.158+0000 7f9347fff700 1 -- 172.21.15.29:0/2318582769 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93540116f0 con 0x7f93600d1c30 2023-10-08T15:41:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.158+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93600ca7a0 con 0x7f93600d1c30 2023-10-08T15:41:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.158+0000 7f9347fff700 1 -- 172.21.15.29:0/2318582769 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354011ab0 con 0x7f93600d1c30 2023-10-08T15:41:22.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.158+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936015ddd0 con 0x7f93600d1c30 2023-10-08T15:41:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.159+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93600caaf0 con 0x7f93600d1c30 2023-10-08T15:41:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.159+0000 7f9347fff700 1 -- 172.21.15.29:0/2318582769 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f935401b3b0 con 0x7f93600d1c30 2023-10-08T15:41:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.160+0000 7f9347fff700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f934c066f30 0x7f934c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.160+0000 7f9347fff700 1 -- 172.21.15.29:0/2318582769 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93540838d0 con 0x7f93600d1c30 2023-10-08T15:41:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.160+0000 7f935ffff700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f934c066f30 0x7f934c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.160+0000 7f935ffff700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f934c066f30 0x7f934c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9350001360 tx=0x7f9350009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:22.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.164+0000 7f9347fff700 1 -- 172.21.15.29:0/2318582769 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9354050aa0 con 0x7f93600d1c30 2023-10-08T15:41:22.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.368+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f936015ddd0 con 0x7f93600d1c30 2023-10-08T15:41:22.693 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.693+0000 7f9347fff700 1 -- 172.21.15.29:0/2318582769 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v32) v1 ==== 93+0+0 (secure 0 0 0) 0x7f936015ddd0 con 0x7f93600d1c30 2023-10-08T15:41:22.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f934c066f30 msgr2=0x7f934c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f934c066f30 0x7f934c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9350001360 tx=0x7f9350009040 comp rx=0 tx=0).stop 2023-10-08T15:41:22.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93600d1c30 msgr2=0x7f936016d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93600d1c30 0x7f936016d8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f935400c4e0 tx=0x7f9354007f00 comp rx=0 tx=0).stop 2023-10-08T15:41:22.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 shutdown_connections 2023-10-08T15:41:22.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f934c066f30 0x7f934c0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f936015a2b0 0x7f936016de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93600cfe20 0x7f936015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 --2- 172.21.15.29:0/2318582769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93600d1c30 0x7f936016d8d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 >> 172.21.15.29:0/2318582769 conn(0x7f9360067e40 msgr2=0x7f93600cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:22.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 shutdown_connections 2023-10-08T15:41:22.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.695+0000 7f93669f7700 1 -- 172.21.15.29:0/2318582769 wait complete. 2023-10-08T15:41:22.699 INFO:teuthology.orchestra.run.smithi029.stderr:pauserd,pausewr is set 2023-10-08T15:41:22.708 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-08T15:41:22.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.829+0000 7f6f7a5b9700 1 Processor -- start 2023-10-08T15:41:22.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.829+0000 7f6f7a5b9700 1 -- start start 2023-10-08T15:41:22.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.830+0000 7f6f7a5b9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f7415a6e0 0x7f6f74068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.830+0000 7f6f7a5b9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6f7406f630 0x7f6f7415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.830+0000 7f6f7a5b9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f74067660 con 0x7f6f7415aff0 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.830+0000 7f6f7a5b9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7415b470 con 0x7f6f7415a6e0 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.830+0000 7f6f7a5b9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740684c0 con 0x7f6f7406f630 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.830+0000 7f6f73fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6f7415a6e0 0x7f6f74068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.830+0000 7f6f78b56700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6f7415aff0 0x7f6f74070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36734/0 (socket says 172.21.15.29:36734) 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.830+0000 7f6f78b56700 1 -- 172.21.15.29:0/3362584807 learned_addr learned my addr 172.21.15.29:0/3362584807 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f737fe700 1 --2- 172.21.15.29:0/3362584807 >> v2:172.21.15.183:3300/0 conn(0x7f6f7406f630 0x7f6f7415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f73fff700 1 -- 172.21.15.29:0/3362584807 >> v2:172.21.15.183:3300/0 conn(0x7f6f7406f630 msgr2=0x7f6f7415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f73fff700 1 --2- 172.21.15.29:0/3362584807 >> v2:172.21.15.183:3300/0 conn(0x7f6f7406f630 0x7f6f7415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f73fff700 1 -- 172.21.15.29:0/3362584807 >> v1:172.21.15.29:6789/0 conn(0x7f6f7415aff0 legacy=0x7f6f74070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f73fff700 1 -- 172.21.15.29:0/3362584807 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740678b0 con 0x7f6f7415a6e0 2023-10-08T15:41:22.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f72ffd700 1 -- 172.21.15.29:0/3362584807 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403350797 0 0) 0x7f6f74067660 con 0x7f6f7415aff0 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f737fe700 1 --2- 172.21.15.29:0/3362584807 >> v2:172.21.15.183:3300/0 conn(0x7f6f7406f630 0x7f6f7415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f73fff700 1 --2- 172.21.15.29:0/3362584807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415a6e0 0x7f6f74068950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f740b3bd0 tx=0x7f6f640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d58bfbaa5c5e5e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f72ffd700 1 -- 172.21.15.29:0/3362584807 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400b6b0 con 0x7f6f7415a6e0 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f72ffd700 1 -- 172.21.15.29:0/3362584807 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400b810 con 0x7f6f7415a6e0 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.831+0000 7f6f72ffd700 1 -- 172.21.15.29:0/3362584807 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400bbb0 con 0x7f6f7415a6e0 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.832+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/3362584807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415a6e0 msgr2=0x7f6f74068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.832+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/3362584807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415a6e0 0x7f6f74068950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f740b3bd0 tx=0x7f6f640091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.832+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/3362584807 shutdown_connections 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.832+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/3362584807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415a6e0 0x7f6f74068950 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.832+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/3362584807 >> v2:172.21.15.183:3300/0 conn(0x7f6f7406f630 0x7f6f7415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.832+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/3362584807 >> 172.21.15.29:0/3362584807 conn(0x7f6f7406a250 msgr2=0x7f6f7406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.832+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/3362584807 shutdown_connections 2023-10-08T15:41:22.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.832+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/3362584807 wait complete. 2023-10-08T15:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.833+0000 7f6f7a5b9700 1 Processor -- start 2023-10-08T15:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.833+0000 7f6f7a5b9700 1 -- start start 2023-10-08T15:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f7a5b9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7406f630 0x7f6f74154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f7a5b9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7415a6e0 0x7f6f740b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f7a5b9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415aff0 0x7f6f740ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f7a5b9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74154590 con 0x7f6f7415aff0 2023-10-08T15:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f7a5b9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740b0e50 con 0x7f6f7415a6e0 2023-10-08T15:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f7a5b9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740b1130 con 0x7f6f7406f630 2023-10-08T15:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415aff0 0x7f6f740ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415aff0 0x7f6f740ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54418/0 (socket says 172.21.15.29:54418) 2023-10-08T15:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 -- 172.21.15.29:0/425231092 learned_addr learned my addr 172.21.15.29:0/425231092 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f73fff700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7406f630 0x7f6f74154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.839 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f737fe700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7415a6e0 0x7f6f740b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 -- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7406f630 msgr2=0x7f6f74154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7406f630 0x7f6f74154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 -- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7415a6e0 msgr2=0x7f6f740b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7415a6e0 0x7f6f740b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 -- 172.21.15.29:0/425231092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f64009420 con 0x7f6f7415aff0 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f78b56700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415aff0 0x7f6f740ca790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00cc90 tx=0x7f6f6c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.834+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00cea0 con 0x7f6f7415aff0 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.835+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00ab70 con 0x7f6f7415aff0 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.835+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f740b1410 con 0x7f6f7415aff0 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.835+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0070f0 con 0x7f6f7415aff0 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.835+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f74169f80 con 0x7f6f7415aff0 2023-10-08T15:41:22.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.836+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7404c3c0 con 0x7f6f7415aff0 2023-10-08T15:41:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.836+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f6c0074a0 con 0x7f6f7415aff0 2023-10-08T15:41:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.836+0000 7f6f5bfff700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6f60066f30 0x7f6f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.837+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f6c0849b0 con 0x7f6f7415aff0 2023-10-08T15:41:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.837+0000 7f6f73fff700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6f60066f30 0x7f6f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.837+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=33+}) v3 -- 0x7f6f6006ea50 con 0x7f6f7415aff0 2023-10-08T15:41:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.837+0000 7f6f73fff700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6f60066f30 0x7f6f600693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6f640093f0 tx=0x7f6f64017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:22.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:22.841+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f6c051ca0 con 0x7f6f7415aff0 2023-10-08T15:41:23.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.044+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f6f7406e800 con 0x7f6f7415aff0 2023-10-08T15:41:23.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.694+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 <== mon.0 v2:172.21.15.29:3300/0 7 ==== osd_map(33..33 src has 1..33) v4 ==== 280+0+0 (secure 0 0 0) 0x7f6f6c056060 con 0x7f6f7415aff0 2023-10-08T15:41:23.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.694+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=34}) v3 -- 0x7f6f6006f340 con 0x7f6f7415aff0 2023-10-08T15:41:23.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.696+0000 7f6f5bfff700 1 -- 172.21.15.29:0/425231092 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6f6c0552c0 con 0x7f6f7415aff0 2023-10-08T15:41:23.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6f60066f30 msgr2=0x7f6f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:23.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6f60066f30 0x7f6f600693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6f640093f0 tx=0x7f6f64017000 comp rx=0 tx=0).stop 2023-10-08T15:41:23.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415aff0 msgr2=0x7f6f740ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:23.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415aff0 0x7f6f740ca790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00cc90 tx=0x7f6f6c001a80 comp rx=0 tx=0).stop 2023-10-08T15:41:23.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 shutdown_connections 2023-10-08T15:41:23.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6f60066f30 0x7f6f600693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:23.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f7415aff0 0x7f6f740ca790 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f7406f630 0x7f6f74154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 --2- 172.21.15.29:0/425231092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f7415a6e0 0x7f6f740b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 >> 172.21.15.29:0/425231092 conn(0x7f6f7406a250 msgr2=0x7f6f740ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.699+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 shutdown_connections 2023-10-08T15:41:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.700+0000 7f6f7a5b9700 1 -- 172.21.15.29:0/425231092 wait complete. 2023-10-08T15:41:23.701 INFO:teuthology.orchestra.run.smithi029.stderr:pauserd,pausewr is unset 2023-10-08T15:41:23.715 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:23.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.840+0000 7f51cd426700 1 Processor -- start 2023-10-08T15:41:23.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.840+0000 7f51cd426700 1 -- start start 2023-10-08T15:41:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51cd426700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51c815a2b0 0x7f51c80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51cd426700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80c5d80 con 0x7f51c80cfe20 2023-10-08T15:41:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51cd426700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80c6060 con 0x7f51c80d1c30 2023-10-08T15:41:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51cd426700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c8068470 con 0x7f51c815a2b0 2023-10-08T15:41:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51c6ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f51c815a2b0 0x7f51c80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51c77fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f51c80cfe20 0x7f51c80c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36746/0 (socket says 172.21.15.29:36746) 2023-10-08T15:41:23.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51c77fe700 1 -- 172.21.15.29:0/4219926100 learned_addr learned my addr 172.21.15.29:0/4219926100 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:23.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51c6ffd700 1 -- 172.21.15.29:0/4219926100 >> v1:172.21.15.183:6789/0 conn(0x7f51c80d1c30 legacy=0x7f51c80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:23.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51c6ffd700 1 -- 172.21.15.29:0/4219926100 >> v1:172.21.15.29:6789/0 conn(0x7f51c80cfe20 legacy=0x7f51c80c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:23.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51c6ffd700 1 -- 172.21.15.29:0/4219926100 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80c6340 con 0x7f51c815a2b0 2023-10-08T15:41:23.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.841+0000 7f51c6ffd700 1 --2- 172.21.15.29:0/4219926100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b3da0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009eb0 tx=0x7f51c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cf4923ce5ba506 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:23.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51c5ffb700 1 -- 172.21.15.29:0/4219926100 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c000e070 con 0x7f51c815a2b0 2023-10-08T15:41:23.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51c5ffb700 1 -- 172.21.15.29:0/4219926100 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c000bbf0 con 0x7f51c815a2b0 2023-10-08T15:41:23.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51c5ffb700 1 -- 172.21.15.29:0/4219926100 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0012430 con 0x7f51c815a2b0 2023-10-08T15:41:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51cd426700 1 -- 172.21.15.29:0/4219926100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 msgr2=0x7f51c80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:23.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51cd426700 1 --2- 172.21.15.29:0/4219926100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b3da0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009eb0 tx=0x7f51c0009780 comp rx=0 tx=0).stop 2023-10-08T15:41:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51cd426700 1 -- 172.21.15.29:0/4219926100 shutdown_connections 2023-10-08T15:41:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51cd426700 1 --2- 172.21.15.29:0/4219926100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b3da0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51cd426700 1 -- 172.21.15.29:0/4219926100 >> 172.21.15.29:0/4219926100 conn(0x7f51c8067e40 msgr2=0x7f51c80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51cd426700 1 -- 172.21.15.29:0/4219926100 shutdown_connections 2023-10-08T15:41:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.842+0000 7f51cd426700 1 -- 172.21.15.29:0/4219926100 wait complete. 2023-10-08T15:41:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.843+0000 7f51cd426700 1 Processor -- start 2023-10-08T15:41:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51cd426700 1 -- start start 2023-10-08T15:41:23.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51cd426700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c80cfe20 0x7f51c80c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51cd426700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c80d1c30 0x7f51c80ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51cd426700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51cd426700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c815bbd0 con 0x7f51c815a2b0 2023-10-08T15:41:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51cd426700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c815b030 con 0x7f51c80d1c30 2023-10-08T15:41:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51cd426700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c815b2a0 con 0x7f51c80cfe20 2023-10-08T15:41:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:23.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54430/0 (socket says 172.21.15.29:54430) 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.844+0000 7f51c77fe700 1 -- 172.21.15.29:0/730240770 learned_addr learned my addr 172.21.15.29:0/730240770 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51c6ffd700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c80cfe20 0x7f51c80c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51c67fc700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c80d1c30 0x7f51c80ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51c77fe700 1 -- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c80cfe20 msgr2=0x7f51c80c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51c77fe700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c80cfe20 0x7f51c80c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51c77fe700 1 -- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c80d1c30 msgr2=0x7f51c80ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51c77fe700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c80d1c30 0x7f51c80ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51c77fe700 1 -- 172.21.15.29:0/730240770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0009a20 con 0x7f51c815a2b0 2023-10-08T15:41:23.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51c77fe700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b51e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c4f0 tx=0x7f51b8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51beffd700 1 -- 172.21.15.29:0/730240770 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8005b30 con 0x7f51c815a2b0 2023-10-08T15:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51beffd700 1 -- 172.21.15.29:0/730240770 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8005c90 con 0x7f51c815a2b0 2023-10-08T15:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c815b580 con 0x7f51c815a2b0 2023-10-08T15:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51beffd700 1 -- 172.21.15.29:0/730240770 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8007320 con 0x7f51c815a2b0 2023-10-08T15:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.845+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c80b5720 con 0x7f51c815a2b0 2023-10-08T15:41:23.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.846+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c80b5940 con 0x7f51c815a2b0 2023-10-08T15:41:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.846+0000 7f51beffd700 1 -- 172.21.15.29:0/730240770 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51b8007690 con 0x7f51c815a2b0 2023-10-08T15:41:23.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.847+0000 7f51beffd700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.847+0000 7f51beffd700 1 -- 172.21.15.29:0/730240770 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51b80839e0 con 0x7f51c815a2b0 2023-10-08T15:41:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.847+0000 7f51c6ffd700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.847+0000 7f51c6ffd700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51a8066f30 0x7f51a80693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f51c00097c0 tx=0x7f51c0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:23.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:23.851+0000 7f51beffd700 1 -- 172.21.15.29:0/730240770 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51b8050bc0 con 0x7f51c815a2b0 2023-10-08T15:41:24.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.044+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51c804c3c0 con 0x7f51c815a2b0 2023-10-08T15:41:24.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.045+0000 7f51beffd700 1 -- 172.21.15.29:0/730240770 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f51b8017020 con 0x7f51c815a2b0 2023-10-08T15:41:24.046 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:24.046 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":33,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:23.693155+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:10.133425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:11.014819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51a8066f30 msgr2=0x7f51a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51a8066f30 0x7f51a80693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f51c00097c0 tx=0x7f51c0016000 comp rx=0 tx=0).stop 2023-10-08T15:41:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 msgr2=0x7f51c80b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b51e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c4f0 tx=0x7f51b8007f30 comp rx=0 tx=0).stop 2023-10-08T15:41:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 shutdown_connections 2023-10-08T15:41:24.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c815a2b0 0x7f51c80b51e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51c80cfe20 0x7f51c80c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 --2- 172.21.15.29:0/730240770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51c80d1c30 0x7f51c80ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 >> 172.21.15.29:0/730240770 conn(0x7f51c8067e40 msgr2=0x7f51c80cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 shutdown_connections 2023-10-08T15:41:24.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.047+0000 7f51cd426700 1 -- 172.21.15.29:0/730240770 wait complete. 2023-10-08T15:41:24.060 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:41:24.060 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-08T15:41:24.060 DEBUG:teuthology.orchestra.run.smithi029:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T15:41:24.060 DEBUG:teuthology.orchestra.run.smithi029:> os.fchmod(fd, 0O666) 2023-10-08T15:41:24.061 DEBUG:teuthology.orchestra.run.smithi029:> os.fsync(fd) 2023-10-08T15:41:24.061 DEBUG:teuthology.orchestra.run.smithi029:> os.close(fd) 2023-10-08T15:41:24.061 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-08T15:41:24.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:24.316 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T15:41:24.385 INFO:teuthology.orchestra.run.smithi029.stdout:client5032 2023-10-08T15:41:24.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:24.386 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa16b01f-3858-4fc7-9751-d7cb76fff138.client5032/osdmap') 2023-10-08T15:41:24.463 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 31 barrier 31 flags 0x588000 2023-10-08T15:41:24.463 INFO:teuthology.orchestra.run.smithi029.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:24.463 INFO:teuthology.orchestra.run.smithi029.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:24.463 INFO:teuthology.orchestra.run.smithi029.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:24.463 INFO:teuthology.orchestra.run.smithi029.stdout:osd0 (1)172.21.15.29:6801 100% (exists, up) 100% -1 2023-10-08T15:41:24.464 INFO:teuthology.orchestra.run.smithi029.stdout:osd1 (1)172.21.15.29:6809 100% (exists, up) 100% -1 2023-10-08T15:41:24.464 INFO:teuthology.orchestra.run.smithi029.stdout:osd2 (1)172.21.15.29:6817 100% (exists, up) 100% -1 2023-10-08T15:41:24.464 INFO:teuthology.orchestra.run.smithi029.stdout:osd3 (1)172.21.15.29:6824 100% (exists, up) 100% -1 2023-10-08T15:41:24.464 INFO:teuthology.orchestra.run.smithi029.stdout:osd4 (1)172.21.15.183:6821 100% (exists, up) 100% -1 2023-10-08T15:41:24.464 INFO:teuthology.orchestra.run.smithi029.stdout:osd5 (1)172.21.15.183:6817 100% (exists, up) 100% -1 2023-10-08T15:41:24.464 INFO:teuthology.orchestra.run.smithi029.stdout:osd6 (1)172.21.15.183:6801 100% (exists, up) 100% -1 2023-10-08T15:41:24.464 INFO:teuthology.orchestra.run.smithi029.stdout:osd7 (1)172.21.15.183:6809 100% (exists, up) 100% -1 2023-10-08T15:41:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:1+1 records in 2023-10-08T15:41:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:1+1 records out 2023-10-08T15:41:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:795 bytes copied, 3.6846e-05 s, 21.6 MB/s 2023-10-08T15:41:24.466 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.623+0000 7f35a3f3e700 1 Processor -- start 2023-10-08T15:41:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.623+0000 7f35a3f3e700 1 -- start start 2023-10-08T15:41:24.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a3f3e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f359c15a620 0x7f359c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:24.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a3f3e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15d580 0x7f359c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:24.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a3f3e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c15cbb0 con 0x7f359c157870 2023-10-08T15:41:24.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a3f3e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c15bdb0 con 0x7f359c15a620 2023-10-08T15:41:24.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a3f3e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c15bfa0 con 0x7f359c15d580 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a14d9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f359c15a620 0x7f359c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a14d9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f359c15a620 0x7f359c15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54432/0 (socket says 172.21.15.29:54432) 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a14d9700 1 -- 172.21.15.29:0/1148805431 learned_addr learned my addr 172.21.15.29:0/1148805431 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.624+0000 7f35a24db700 1 --2- 172.21.15.29:0/1148805431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15d580 0x7f359c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a14d9700 1 -- 172.21.15.29:0/1148805431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15d580 msgr2=0x7f359c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a14d9700 1 --2- 172.21.15.29:0/1148805431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15d580 0x7f359c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a14d9700 1 -- 172.21.15.29:0/1148805431 >> v1:172.21.15.183:6789/0 conn(0x7f359c157870 legacy=0x7f359c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a14d9700 1 -- 172.21.15.29:0/1148805431 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c15c280 con 0x7f359c15a620 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a14d9700 1 --2- 172.21.15.29:0/1148805431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15a620 0x7f359c15d040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f35900099b0 tx=0x7f3590009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6e771b14e3fbd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a0cd8700 1 -- 172.21.15.29:0/1148805431 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359000b820 con 0x7f359c15a620 2023-10-08T15:41:24.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a0cd8700 1 -- 172.21.15.29:0/1148805431 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359000b980 con 0x7f359c15a620 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a0cd8700 1 -- 172.21.15.29:0/1148805431 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359000bd20 con 0x7f359c15a620 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a3f3e700 1 -- 172.21.15.29:0/1148805431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15a620 msgr2=0x7f359c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/1148805431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15a620 0x7f359c15d040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f35900099b0 tx=0x7f3590009250 comp rx=0 tx=0).stop 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a3f3e700 1 -- 172.21.15.29:0/1148805431 shutdown_connections 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/1148805431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15d580 0x7f359c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/1148805431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15a620 0x7f359c15d040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.625+0000 7f35a3f3e700 1 -- 172.21.15.29:0/1148805431 >> 172.21.15.29:0/1148805431 conn(0x7f359c068ce0 msgr2=0x7f359c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.626+0000 7f35a3f3e700 1 -- 172.21.15.29:0/1148805431 shutdown_connections 2023-10-08T15:41:24.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.626+0000 7f35a3f3e700 1 -- 172.21.15.29:0/1148805431 wait complete. 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a3f3e700 1 Processor -- start 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a3f3e700 1 -- start start 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a3f3e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f359c157870 0x7f359c154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a3f3e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15a620 0x7f359c0a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a3f3e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15d580 0x7f359c0a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a3f3e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0a9080 con 0x7f359c15d580 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a3f3e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0ad6d0 con 0x7f359c157870 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a3f3e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0aa860 con 0x7f359c15a620 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a24db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15d580 0x7f359c0a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a24db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15d580 0x7f359c0a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54436/0 (socket says 172.21.15.29:54436) 2023-10-08T15:41:24.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a24db700 1 -- 172.21.15.29:0/15654788 learned_addr learned my addr 172.21.15.29:0/15654788 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.627+0000 7f35a14d9700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15a620 0x7f359c0a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a1cda700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f359c157870 0x7f359c154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a24db700 1 -- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15a620 msgr2=0x7f359c0a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a24db700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15a620 0x7f359c0a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a24db700 1 -- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f359c157870 msgr2=0x7f359c154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a24db700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f359c157870 0x7f359c154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a24db700 1 -- 172.21.15.29:0/15654788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35900094f0 con 0x7f359c15d580 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a1cda700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f359c157870 0x7f359c154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a24db700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15d580 0x7f359c0a9c00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f358c007ef0 tx=0x7f358c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f3599ffb700 1 -- 172.21.15.29:0/15654788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00ebe0 con 0x7f359c15d580 2023-10-08T15:41:24.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f3599ffb700 1 -- 172.21.15.29:0/15654788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00ed40 con 0x7f359c15d580 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c0adc70 con 0x7f359c15d580 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f3599ffb700 1 -- 172.21.15.29:0/15654788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c014670 con 0x7f359c15d580 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.628+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c0aa350 con 0x7f359c15d580 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.629+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c04c3c0 con 0x7f359c15d580 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.630+0000 7f3599ffb700 1 -- 172.21.15.29:0/15654788 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f358c014a60 con 0x7f359c15d580 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.630+0000 7f3599ffb700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3588066f30 0x7f35880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.630+0000 7f3599ffb700 1 -- 172.21.15.29:0/15654788 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f358c084ba0 con 0x7f359c15d580 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.630+0000 7f35a1cda700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3588066f30 0x7f35880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:24.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.631+0000 7f35a1cda700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3588066f30 0x7f35880693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3594007fd0 tx=0x7f3594009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:24.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.634+0000 7f3599ffb700 1 -- 172.21.15.29:0/15654788 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f358c051e10 con 0x7f359c15d580 2023-10-08T15:41:24.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:24.746 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:24.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.872+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f359c15c560 con 0x7f359c15d580 2023-10-08T15:41:24.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.872+0000 7f3599ffb700 1 -- 172.21.15.29:0/15654788 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f358c009980 con 0x7f359c15d580 2023-10-08T15:41:24.873 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:24.873 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:12.039331+0000","modified":"2023-10-08T15:41:15.672568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/470731948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":470731948},{"type":"v1","addr":"172.21.15.29:6835","nonce":470731948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:41:24.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3588066f30 msgr2=0x7f35880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:24.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3588066f30 0x7f35880693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3594007fd0 tx=0x7f3594009040 comp rx=0 tx=0).stop 2023-10-08T15:41:24.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15d580 msgr2=0x7f359c0a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:24.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15d580 0x7f359c0a9c00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f358c007ef0 tx=0x7f358c009840 comp rx=0 tx=0).stop 2023-10-08T15:41:24.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 shutdown_connections 2023-10-08T15:41:24.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3588066f30 0x7f35880693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f359c15d580 0x7f359c0a9c00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f359c157870 0x7f359c154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 --2- 172.21.15.29:0/15654788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f359c15a620 0x7f359c0a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:24.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 >> 172.21.15.29:0/15654788 conn(0x7f359c068ce0 msgr2=0x7f359c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:24.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 shutdown_connections 2023-10-08T15:41:24.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:24.875+0000 7f35a3f3e700 1 -- 172.21.15.29:0/15654788 wait complete. 2023-10-08T15:41:24.877 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-08T15:41:24.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 33 2023-10-08T15:41:25.023 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-08T15:41:25.024 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-08T15:41:25.024 DEBUG:teuthology.orchestra.run.smithi029:> import os 2023-10-08T15:41:25.025 DEBUG:teuthology.orchestra.run.smithi029:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-08T15:41:25.025 DEBUG:teuthology.orchestra.run.smithi029:> os.fchmod(fd, 0O666) 2023-10-08T15:41:25.025 DEBUG:teuthology.orchestra.run.smithi029:> os.fsync(fd) 2023-10-08T15:41:25.025 DEBUG:teuthology.orchestra.run.smithi029:> os.close(fd) 2023-10-08T15:41:25.025 DEBUG:teuthology.orchestra.run.smithi029:> ' 2023-10-08T15:41:25.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:25.280 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T15:41:25.350 INFO:teuthology.orchestra.run.smithi029.stdout:client5032 2023-10-08T15:41:25.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:25.351 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa16b01f-3858-4fc7-9751-d7cb76fff138.client5032/osdmap') 2023-10-08T15:41:25.428 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 33 barrier 33 flags 0x588000 2023-10-08T15:41:25.428 INFO:teuthology.orchestra.run.smithi029.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:25.428 INFO:teuthology.orchestra.run.smithi029.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:25.428 INFO:teuthology.orchestra.run.smithi029.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:25.428 INFO:teuthology.orchestra.run.smithi029.stdout:osd0 (1)172.21.15.29:6801 100% (exists, up) 100% -1 2023-10-08T15:41:25.428 INFO:teuthology.orchestra.run.smithi029.stdout:osd1 (1)172.21.15.29:6809 100% (exists, up) 100% -1 2023-10-08T15:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:osd2 (1)172.21.15.29:6817 100% (exists, up) 100% -1 2023-10-08T15:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:osd3 (1)172.21.15.29:6824 100% (exists, up) 100% -1 2023-10-08T15:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:osd4 (1)172.21.15.183:6821 100% (exists, up) 100% -1 2023-10-08T15:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:osd5 (1)172.21.15.183:6817 100% (exists, up) 100% -1 2023-10-08T15:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:osd6 (1)172.21.15.183:6801 100% (exists, up) 100% -1 2023-10-08T15:41:25.429 INFO:teuthology.orchestra.run.smithi029.stdout:osd7 (1)172.21.15.183:6809 100% (exists, up) 100% -1 2023-10-08T15:41:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:1+1 records in 2023-10-08T15:41:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:1+1 records out 2023-10-08T15:41:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:795 bytes copied, 3.7194e-05 s, 21.4 MB/s 2023-10-08T15:41:25.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:25.431 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T15:41:25.499 INFO:teuthology.orchestra.run.smithi029.stdout:client5032 2023-10-08T15:41:25.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:25.500 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/aa16b01f-3858-4fc7-9751-d7cb76fff138.client5032/osdmap') 2023-10-08T15:41:25.576 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 33 barrier 33 flags 0x588000 2023-10-08T15:41:25.576 INFO:teuthology.orchestra.run.smithi029.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-08T15:41:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:osd0 (1)172.21.15.29:6801 100% (exists, up) 100% -1 2023-10-08T15:41:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:osd1 (1)172.21.15.29:6809 100% (exists, up) 100% -1 2023-10-08T15:41:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:osd2 (1)172.21.15.29:6817 100% (exists, up) 100% -1 2023-10-08T15:41:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:osd3 (1)172.21.15.29:6824 100% (exists, up) 100% -1 2023-10-08T15:41:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:osd4 (1)172.21.15.183:6821 100% (exists, up) 100% -1 2023-10-08T15:41:25.577 INFO:teuthology.orchestra.run.smithi029.stdout:osd5 (1)172.21.15.183:6817 100% (exists, up) 100% -1 2023-10-08T15:41:25.578 INFO:teuthology.orchestra.run.smithi029.stdout:osd6 (1)172.21.15.183:6801 100% (exists, up) 100% -1 2023-10-08T15:41:25.578 INFO:teuthology.orchestra.run.smithi029.stdout:osd7 (1)172.21.15.183:6809 100% (exists, up) 100% -1 2023-10-08T15:41:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:1+1 records in 2023-10-08T15:41:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:1+1 records out 2023-10-08T15:41:25.579 INFO:teuthology.orchestra.run.smithi029.stderr:795 bytes copied, 3.7041e-05 s, 21.5 MB/s 2023-10-08T15:41:25.579 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T15:41:25.579 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:41:25.579 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:25.659 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:25.704 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:41:25.704 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T15:41:25.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:25.704 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:25.771 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:41:25.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:25.771 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T15:41:25.793 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T15:41:25.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:25.793 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:25.839 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:41:25.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:25.840 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T15:41:25.855 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.973+0000 7f9525457700 1 Processor -- start 2023-10-08T15:41:25.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.974+0000 7f9525457700 1 -- start start 2023-10-08T15:41:25.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.974+0000 7f9525457700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f952015a0c0 0x7f952015e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.974+0000 7f9525457700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95200cca20 con 0x7f95200cf1c0 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.974+0000 7f9525457700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952015ea40 con 0x7f9520159cf0 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.974+0000 7f9525457700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9520067660 con 0x7f952015a0c0 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.974+0000 7f951f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f952015a0c0 0x7f952015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951e7fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f95200cf1c0 0x7f9520068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36758/0 (socket says 172.21.15.29:36758) 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951e7fc700 1 -- 172.21.15.29:0/2210234059 learned_addr learned my addr 172.21.15.29:0/2210234059 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951f7fe700 1 -- 172.21.15.29:0/2210234059 >> v1:172.21.15.183:6789/0 conn(0x7f9520159cf0 legacy=0x7f95200ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951f7fe700 1 -- 172.21.15.29:0/2210234059 >> v1:172.21.15.29:6789/0 conn(0x7f95200cf1c0 legacy=0x7f9520068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951f7fe700 1 -- 172.21.15.29:0/2210234059 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520067f00 con 0x7f952015a0c0 2023-10-08T15:41:25.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951dffb700 1 -- 172.21.15.29:0/2210234059 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438376806 0 0) 0x7f95200cca20 con 0x7f95200cf1c0 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951f7fe700 1 --2- 172.21.15.29:0/2210234059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f952015a0c0 0x7f952015e500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95100098e0 tx=0x7f95100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb999709d2da95b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951dffb700 1 -- 172.21.15.29:0/2210234059 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510009e80 con 0x7f952015a0c0 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951dffb700 1 -- 172.21.15.29:0/2210234059 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000b860 con 0x7f952015a0c0 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.975+0000 7f951dffb700 1 -- 172.21.15.29:0/2210234059 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000bbe0 con 0x7f952015a0c0 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.976+0000 7f9525457700 1 -- 172.21.15.29:0/2210234059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f952015a0c0 msgr2=0x7f952015e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.976+0000 7f9525457700 1 --2- 172.21.15.29:0/2210234059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f952015a0c0 0x7f952015e500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95100098e0 tx=0x7f95100091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.976+0000 7f9525457700 1 -- 172.21.15.29:0/2210234059 shutdown_connections 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.976+0000 7f9525457700 1 --2- 172.21.15.29:0/2210234059 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f952015a0c0 0x7f952015e500 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.976+0000 7f9525457700 1 -- 172.21.15.29:0/2210234059 >> 172.21.15.29:0/2210234059 conn(0x7f952006c6e0 msgr2=0x7f9520069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:25.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.976+0000 7f9525457700 1 -- 172.21.15.29:0/2210234059 shutdown_connections 2023-10-08T15:41:25.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.976+0000 7f9525457700 1 -- 172.21.15.29:0/2210234059 wait complete. 2023-10-08T15:41:25.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.977+0000 7f9525457700 1 Processor -- start 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.977+0000 7f9525457700 1 -- start start 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f9525457700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95200cf1c0 0x7f95200ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f9525457700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9520159cf0 0x7f95201697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f9525457700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f952015a0c0 0x7f952016af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f9525457700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95200ad530 con 0x7f9520159cf0 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f9525457700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95200acbd0 con 0x7f952015a0c0 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f9525457700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95200aac70 con 0x7f95200cf1c0 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9520159cf0 0x7f95201697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9520159cf0 0x7f95201697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54442/0 (socket says 172.21.15.29:54442) 2023-10-08T15:41:25.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 -- 172.21.15.29:0/405818817 learned_addr learned my addr 172.21.15.29:0/405818817 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951effd700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95200cf1c0 0x7f95200ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951f7fe700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f952015a0c0 0x7f952016af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 -- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95200cf1c0 msgr2=0x7f95200ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95200cf1c0 0x7f95200ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 -- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f952015a0c0 msgr2=0x7f952016af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f952015a0c0 0x7f952016af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 -- 172.21.15.29:0/405818817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009420 con 0x7f9520159cf0 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f951e7fc700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9520159cf0 0x7f95201697a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f950800c810 tx=0x7f9508007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.978+0000 7f9516ffd700 1 -- 172.21.15.29:0/405818817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508005c00 con 0x7f9520159cf0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.979+0000 7f9516ffd700 1 -- 172.21.15.29:0/405818817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508005d60 con 0x7f9520159cf0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.979+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95200aaf50 con 0x7f9520159cf0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.979+0000 7f9516ffd700 1 -- 172.21.15.29:0/405818817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508007320 con 0x7f9520159cf0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.979+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95200ab510 con 0x7f9520159cf0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.980+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952004c3c0 con 0x7f9520159cf0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.980+0000 7f9516ffd700 1 -- 172.21.15.29:0/405818817 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f950801b3b0 con 0x7f9520159cf0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.981+0000 7f9516ffd700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9500066f30 0x7f95000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.981+0000 7f9516ffd700 1 -- 172.21.15.29:0/405818817 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9508083a40 con 0x7f9520159cf0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.981+0000 7f951effd700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9500066f30 0x7f95000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:25.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.981+0000 7f951effd700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9500066f30 0x7f95000693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9518007fd0 tx=0x7f95180016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:25.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:25.985+0000 7f9516ffd700 1 -- 172.21.15.29:0/405818817 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9508050c10 con 0x7f9520159cf0 2023-10-08T15:41:26.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.224+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95200ce730 con 0x7f9520159cf0 2023-10-08T15:41:26.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.224+0000 7f9516ffd700 1 -- 172.21.15.29:0/405818817 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f9508017020 con 0x7f9520159cf0 2023-10-08T15:41:26.225 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:26.225 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:12.039331+0000","modified":"2023-10-08T15:41:15.672568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/470731948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":470731948},{"type":"v1","addr":"172.21.15.29:6835","nonce":470731948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:41:26.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.226+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9500066f30 msgr2=0x7f95000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9500066f30 0x7f95000693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9518007fd0 tx=0x7f95180016f0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9520159cf0 msgr2=0x7f95201697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9520159cf0 0x7f95201697a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f950800c810 tx=0x7f9508007d90 comp rx=0 tx=0).stop 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 shutdown_connections 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9500066f30 0x7f95000693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f952015a0c0 0x7f952016af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95200cf1c0 0x7f95200ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 --2- 172.21.15.29:0/405818817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9520159cf0 0x7f95201697a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 >> 172.21.15.29:0/405818817 conn(0x7f952006c6e0 msgr2=0x7f95200c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 shutdown_connections 2023-10-08T15:41:26.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.227+0000 7f9525457700 1 -- 172.21.15.29:0/405818817 wait complete. 2023-10-08T15:41:26.229 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-08T15:41:26.239 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:26.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.358+0000 7f908f81c700 1 Processor -- start 2023-10-08T15:41:26.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.358+0000 7f908f81c700 1 -- start start 2023-10-08T15:41:26.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908f81c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9088143a00 0x7f908806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908f81c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f908806aa20 0x7f90880b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908f81c700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908806ae20 con 0x7f9088143630 2023-10-08T15:41:26.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908f81c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90880b3380 con 0x7f908806aa20 2023-10-08T15:41:26.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908f81c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90880b3b70 con 0x7f9088143a00 2023-10-08T15:41:26.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908ddb9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f908806aa20 0x7f90880b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908ddb9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f908806aa20 0x7f90880b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54454/0 (socket says 172.21.15.29:54454) 2023-10-08T15:41:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908ddb9700 1 -- 172.21.15.29:0/3831571505 learned_addr learned my addr 172.21.15.29:0/3831571505 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908cdb7700 1 --2- 172.21.15.29:0/3831571505 >> v2:172.21.15.183:3300/0 conn(0x7f9088143a00 0x7f908806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908ddb9700 1 -- 172.21.15.29:0/3831571505 >> v2:172.21.15.183:3300/0 conn(0x7f9088143a00 msgr2=0x7f908806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908ddb9700 1 --2- 172.21.15.29:0/3831571505 >> v2:172.21.15.183:3300/0 conn(0x7f9088143a00 0x7f908806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908ddb9700 1 -- 172.21.15.29:0/3831571505 >> v1:172.21.15.183:6789/0 conn(0x7f9088143630 legacy=0x7f90880cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908ddb9700 1 -- 172.21.15.29:0/3831571505 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880b3e50 con 0x7f908806aa20 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f908ddb9700 1 --2- 172.21.15.29:0/3831571505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f90880b4c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f90880d1de0 tx=0x7f9080009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc312b380f5e644 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f907ffff700 1 -- 172.21.15.29:0/3831571505 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000e070 con 0x7f908806aa20 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f907ffff700 1 -- 172.21.15.29:0/3831571505 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000ba50 con 0x7f908806aa20 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.359+0000 7f907ffff700 1 -- 172.21.15.29:0/3831571505 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800092e0 con 0x7f908806aa20 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.360+0000 7f908f81c700 1 -- 172.21.15.29:0/3831571505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 msgr2=0x7f90880b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.360+0000 7f908f81c700 1 --2- 172.21.15.29:0/3831571505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f90880b4c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f90880d1de0 tx=0x7f9080009840 comp rx=0 tx=0).stop 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.360+0000 7f908f81c700 1 -- 172.21.15.29:0/3831571505 shutdown_connections 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.360+0000 7f908f81c700 1 --2- 172.21.15.29:0/3831571505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f90880b4c10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.360+0000 7f908f81c700 1 --2- 172.21.15.29:0/3831571505 >> v2:172.21.15.183:3300/0 conn(0x7f9088143a00 0x7f908806a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.360+0000 7f908f81c700 1 -- 172.21.15.29:0/3831571505 >> 172.21.15.29:0/3831571505 conn(0x7f9088069760 msgr2=0x7f90880b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.360+0000 7f908f81c700 1 -- 172.21.15.29:0/3831571505 shutdown_connections 2023-10-08T15:41:26.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.360+0000 7f908f81c700 1 -- 172.21.15.29:0/3831571505 wait complete. 2023-10-08T15:41:26.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.361+0000 7f908f81c700 1 Processor -- start 2023-10-08T15:41:26.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.361+0000 7f908f81c700 1 -- start start 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908f81c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f908816a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908f81c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9088143630 0x7f908816d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908f81c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9088143a00 0x7f90880c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908f81c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908815d010 con 0x7f908806aa20 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908f81c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908816aac0 con 0x7f9088143630 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908f81c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90880c7d50 con 0x7f9088143a00 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908d5b8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f908816a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908d5b8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f908816a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54456/0 (socket says 172.21.15.29:54456) 2023-10-08T15:41:26.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908d5b8700 1 -- 172.21.15.29:0/3229795633 learned_addr learned my addr 172.21.15.29:0/3229795633 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908ddb9700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9088143a00 0x7f90880c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908cdb7700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9088143630 0x7f908816d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908d5b8700 1 -- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9088143a00 msgr2=0x7f90880c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908d5b8700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9088143a00 0x7f90880c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908d5b8700 1 -- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9088143630 msgr2=0x7f908816d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908d5b8700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9088143630 0x7f908816d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908d5b8700 1 -- 172.21.15.29:0/3229795633 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080009ae0 con 0x7f908806aa20 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908ddb9700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9088143a00 0x7f90880c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:26.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.362+0000 7f908cdb7700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9088143630 0x7f908816d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.363+0000 7f908d5b8700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f908816a580 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f908400c590 tx=0x7f908400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.363+0000 7f907d7fa700 1 -- 172.21.15.29:0/3229795633 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084011590 con 0x7f908806aa20 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.363+0000 7f907d7fa700 1 -- 172.21.15.29:0/3229795633 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90840116f0 con 0x7f908806aa20 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.363+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908815c9c0 con 0x7f908806aa20 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.363+0000 7f907d7fa700 1 -- 172.21.15.29:0/3229795633 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084011ab0 con 0x7f908806aa20 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.363+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908816d890 con 0x7f908806aa20 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.364+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908815c820 con 0x7f908806aa20 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.364+0000 7f907d7fa700 1 -- 172.21.15.29:0/3229795633 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f908401b3b0 con 0x7f908806aa20 2023-10-08T15:41:26.369 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.365+0000 7f907d7fa700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f906c066f30 0x7f906c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.365+0000 7f907d7fa700 1 -- 172.21.15.29:0/3229795633 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9084083ae0 con 0x7f908806aa20 2023-10-08T15:41:26.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.365+0000 7f908cdb7700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f906c066f30 0x7f906c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.365+0000 7f908cdb7700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f906c066f30 0x7f906c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f90880ce040 tx=0x7f9078008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.369+0000 7f907d7fa700 1 -- 172.21.15.29:0/3229795633 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f908815c820 con 0x7f908806aa20 2023-10-08T15:41:26.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.565+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f908815c820 con 0x7f908806aa20 2023-10-08T15:41:26.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.566+0000 7f907d7fa700 1 -- 172.21.15.29:0/3229795633 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f908815c820 con 0x7f908806aa20 2023-10-08T15:41:26.567 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:26.567 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":33,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:23.693155+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:10.133425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:11.014819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:26.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f906c066f30 msgr2=0x7f906c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f906c066f30 0x7f906c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f90880ce040 tx=0x7f9078008040 comp rx=0 tx=0).stop 2023-10-08T15:41:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 msgr2=0x7f908816a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f908816a580 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f908400c590 tx=0x7f908400c950 comp rx=0 tx=0).stop 2023-10-08T15:41:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 shutdown_connections 2023-10-08T15:41:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f906c066f30 0x7f906c0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9088143a00 0x7f90880c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f908806aa20 0x7f908816a580 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 --2- 172.21.15.29:0/3229795633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9088143630 0x7f908816d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.568+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 >> 172.21.15.29:0/3229795633 conn(0x7f9088069760 msgr2=0x7f90880b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.569+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 shutdown_connections 2023-10-08T15:41:26.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.569+0000 7f908f81c700 1 -- 172.21.15.29:0/3229795633 wait complete. 2023-10-08T15:41:26.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:41:10.133425+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:41:11.014819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:41:26.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:41:26.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.704+0000 7fe3564f4700 1 Processor -- start 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.704+0000 7fe3564f4700 1 -- start start 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe3564f4700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe3500cb0f0 0x7fe3500b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe3564f4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe350069870 0x7fe350069c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe3564f4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500afb50 con 0x7fe350157cc0 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe3564f4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3500afe30 con 0x7fe350069870 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe3564f4700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3500b0110 con 0x7fe3500cb0f0 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe354a91700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe350069870 0x7fe350069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe34ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe350157cc0 0x7fe3500ca9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36768/0 (socket says 172.21.15.29:36768) 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe34ffff700 1 -- 172.21.15.29:0/1878552409 learned_addr learned my addr 172.21.15.29:0/1878552409 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.705+0000 7fe34f7fe700 1 --2- 172.21.15.29:0/1878552409 >> v2:172.21.15.183:3300/0 conn(0x7fe3500cb0f0 0x7fe3500b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe354a91700 1 -- 172.21.15.29:0/1878552409 >> v2:172.21.15.183:3300/0 conn(0x7fe3500cb0f0 msgr2=0x7fe3500b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe354a91700 1 --2- 172.21.15.29:0/1878552409 >> v2:172.21.15.183:3300/0 conn(0x7fe3500cb0f0 0x7fe3500b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe354a91700 1 -- 172.21.15.29:0/1878552409 >> v1:172.21.15.29:6789/0 conn(0x7fe350157cc0 legacy=0x7fe3500ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe354a91700 1 -- 172.21.15.29:0/1878552409 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500b03f0 con 0x7fe350069870 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe34effd700 1 -- 172.21.15.29:0/1878552409 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074372626 0 0) 0x7fe3500afb50 con 0x7fe350157cc0 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe354a91700 1 --2- 172.21.15.29:0/1878552409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe350069870 0x7fe350069c70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe35006f100 tx=0x7fe348009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe0633b49a7fa4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe34effd700 1 -- 172.21.15.29:0/1878552409 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800e070 con 0x7fe350069870 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe34effd700 1 -- 172.21.15.29:0/1878552409 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800bc30 con 0x7fe350069870 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe34effd700 1 -- 172.21.15.29:0/1878552409 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348012430 con 0x7fe350069870 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe3564f4700 1 -- 172.21.15.29:0/1878552409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe350069870 msgr2=0x7fe350069c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe3564f4700 1 --2- 172.21.15.29:0/1878552409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe350069870 0x7fe350069c70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe35006f100 tx=0x7fe348009780 comp rx=0 tx=0).stop 2023-10-08T15:41:26.710 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe3564f4700 1 -- 172.21.15.29:0/1878552409 shutdown_connections 2023-10-08T15:41:26.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe3564f4700 1 --2- 172.21.15.29:0/1878552409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe350069870 0x7fe350069c70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe3564f4700 1 --2- 172.21.15.29:0/1878552409 >> v2:172.21.15.183:3300/0 conn(0x7fe3500cb0f0 0x7fe3500b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe3564f4700 1 -- 172.21.15.29:0/1878552409 >> 172.21.15.29:0/1878552409 conn(0x7fe3500cb5c0 msgr2=0x7fe3500cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe3564f4700 1 -- 172.21.15.29:0/1878552409 shutdown_connections 2023-10-08T15:41:26.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.706+0000 7fe3564f4700 1 -- 172.21.15.29:0/1878552409 wait complete. 2023-10-08T15:41:26.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.707+0000 7fe3564f4700 1 Processor -- start 2023-10-08T15:41:26.711 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.708+0000 7fe3564f4700 1 -- start start 2023-10-08T15:41:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.708+0000 7fe3564f4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe350069870 0x7fe3500c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.713 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.708+0000 7fe3564f4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3500cb0f0 0x7fe350156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.708+0000 7fe3564f4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe350157cc0 0x7fe35014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.708+0000 7fe3564f4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe350068d20 con 0x7fe3500cb0f0 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.708+0000 7fe3564f4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe350068110 con 0x7fe350069870 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.708+0000 7fe3564f4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500683f0 con 0x7fe350157cc0 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3500cb0f0 0x7fe350156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3500cb0f0 0x7fe350156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54482/0 (socket says 172.21.15.29:54482) 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 -- 172.21.15.29:0/2138646484 learned_addr learned my addr 172.21.15.29:0/2138646484 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34ffff700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe350069870 0x7fe3500c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe354a91700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe350157cc0 0x7fe35014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.714 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 -- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe350157cc0 msgr2=0x7fe35014aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe350157cc0 0x7fe35014aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 -- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe350069870 msgr2=0x7fe3500c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe350069870 0x7fe3500c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 -- 172.21.15.29:0/2138646484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348009a20 con 0x7fe3500cb0f0 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe354a91700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe350157cc0 0x7fe35014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34ffff700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe350069870 0x7fe3500c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe34f7fe700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3500cb0f0 0x7fe350156370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe34400d860 tx=0x7fe344008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe337fff700 1 -- 172.21.15.29:0/2138646484 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440125f0 con 0x7fe3500cb0f0 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe337fff700 1 -- 172.21.15.29:0/2138646484 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe344012750 con 0x7fe3500cb0f0 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3500686d0 con 0x7fe3500cb0f0 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe337fff700 1 -- 172.21.15.29:0/2138646484 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344012ad0 con 0x7fe3500cb0f0 2023-10-08T15:41:26.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.709+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3500c4d10 con 0x7fe3500cb0f0 2023-10-08T15:41:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.710+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35004c3c0 con 0x7fe3500cb0f0 2023-10-08T15:41:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.711+0000 7fe337fff700 1 -- 172.21.15.29:0/2138646484 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe34401e460 con 0x7fe3500cb0f0 2023-10-08T15:41:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.711+0000 7fe337fff700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe33c066f30 0x7fe33c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.711+0000 7fe337fff700 1 -- 172.21.15.29:0/2138646484 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe344084ba0 con 0x7fe3500cb0f0 2023-10-08T15:41:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.711+0000 7fe34ffff700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe33c066f30 0x7fe33c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.712+0000 7fe34ffff700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe33c066f30 0x7fe33c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3400011e0 tx=0x7fe340009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:26.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.716+0000 7fe337fff700 1 -- 172.21.15.29:0/2138646484 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3440558a0 con 0x7fe3500cb0f0 2023-10-08T15:41:26.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.909+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3500c4f30 con 0x7fe3500cb0f0 2023-10-08T15:41:26.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.909+0000 7fe337fff700 1 -- 172.21.15.29:0/2138646484 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe344055430 con 0x7fe3500cb0f0 2023-10-08T15:41:26.910 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:41:26.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe33c066f30 msgr2=0x7fe33c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe33c066f30 0x7fe33c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3400011e0 tx=0x7fe340009040 comp rx=0 tx=0).stop 2023-10-08T15:41:26.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3500cb0f0 msgr2=0x7fe350156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:26.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3500cb0f0 0x7fe350156370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe34400d860 tx=0x7fe344008040 comp rx=0 tx=0).stop 2023-10-08T15:41:26.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 shutdown_connections 2023-10-08T15:41:26.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe33c066f30 0x7fe33c0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe350157cc0 0x7fe35014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe350069870 0x7fe3500c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 --2- 172.21.15.29:0/2138646484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe3500cb0f0 0x7fe350156370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:26.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.911+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 >> 172.21.15.29:0/2138646484 conn(0x7fe3500cb5c0 msgr2=0x7fe350156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:26.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.912+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 shutdown_connections 2023-10-08T15:41:26.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:26.912+0000 7fe3564f4700 1 -- 172.21.15.29:0/2138646484 wait complete. 2023-10-08T15:41:26.924 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:41:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.045+0000 7fdf31f22700 1 Processor -- start 2023-10-08T15:41:27.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.045+0000 7fdf31f22700 1 -- start start 2023-10-08T15:41:27.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.046+0000 7fdf31f22700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.046+0000 7fdf31f22700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c1513f0 con 0x7fdf2c0cd300 2023-10-08T15:41:27.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.046+0000 7fdf31f22700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c15db20 con 0x7fdf2c15afb0 2023-10-08T15:41:27.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.046+0000 7fdf31f22700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c15e7a0 con 0x7fdf2c0d1470 2023-10-08T15:41:27.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.046+0000 7fdf2b7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fdf2c0cd300 0x7fdf2c0b6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36782/0 (socket says 172.21.15.29:36782) 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.046+0000 7fdf2b7fe700 1 -- 172.21.15.29:0/1986253242 learned_addr learned my addr 172.21.15.29:0/1986253242 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2bfff700 1 --2- 172.21.15.29:0/1986253242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2a7fc700 1 -- 172.21.15.29:0/1986253242 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087559612 0 0) 0x7fdf2c1513f0 con 0x7fdf2c0cd300 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2a7fc700 1 -- 172.21.15.29:0/1986253242 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf14003570 con 0x7fdf2c0cd300 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2a7fc700 1 -- 172.21.15.29:0/1986253242 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038248634 0 0) 0x7fdf2c15db20 con 0x7fdf2c15afb0 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2a7fc700 1 -- 172.21.15.29:0/1986253242 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf2c1513f0 con 0x7fdf2c15afb0 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2bfff700 1 -- 172.21.15.29:0/1986253242 >> v1:172.21.15.183:6789/0 conn(0x7fdf2c15afb0 legacy=0x7fdf2c0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2bfff700 1 -- 172.21.15.29:0/1986253242 >> v1:172.21.15.29:6789/0 conn(0x7fdf2c0cd300 legacy=0x7fdf2c0b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2a7fc700 1 -- 172.21.15.29:0/1986253242 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342319883 0 0) 0x7fdf14003570 con 0x7fdf2c0cd300 2023-10-08T15:41:27.050 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2bfff700 1 -- 172.21.15.29:0/1986253242 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c15de00 con 0x7fdf2c0d1470 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2bfff700 1 --2- 172.21.15.29:0/1986253242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c164e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009e90 tx=0x7fdf24009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f555798da8057ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2a7fc700 1 -- 172.21.15.29:0/1986253242 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400e070 con 0x7fdf2c0d1470 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2a7fc700 1 -- 172.21.15.29:0/1986253242 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400b870 con 0x7fdf2c0d1470 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.047+0000 7fdf2a7fc700 1 -- 172.21.15.29:0/1986253242 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c001470 con 0x7fdf2c0d1470 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.048+0000 7fdf31f22700 1 -- 172.21.15.29:0/1986253242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 msgr2=0x7fdf2c164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.048+0000 7fdf31f22700 1 --2- 172.21.15.29:0/1986253242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c164e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009e90 tx=0x7fdf24009780 comp rx=0 tx=0).stop 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.048+0000 7fdf31f22700 1 -- 172.21.15.29:0/1986253242 shutdown_connections 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.048+0000 7fdf31f22700 1 --2- 172.21.15.29:0/1986253242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c164e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.048+0000 7fdf31f22700 1 -- 172.21.15.29:0/1986253242 >> 172.21.15.29:0/1986253242 conn(0x7fdf2c068d90 msgr2=0x7fdf2c069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:27.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.048+0000 7fdf31f22700 1 -- 172.21.15.29:0/1986253242 shutdown_connections 2023-10-08T15:41:27.052 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.048+0000 7fdf31f22700 1 -- 172.21.15.29:0/1986253242 wait complete. 2023-10-08T15:41:27.054 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.049+0000 7fdf31f22700 1 Processor -- start 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.049+0000 7fdf31f22700 1 -- start start 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf31f22700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf2c0cd300 0x7fdf2c0b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf31f22700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf31f22700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf2c15afb0 0x7fdf2c0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf31f22700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c14fb60 con 0x7fdf2c0cd300 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf31f22700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b26c0 con 0x7fdf2c15afb0 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf31f22700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b1ab0 con 0x7fdf2c0d1470 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf2c0cd300 0x7fdf2c0b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf2c0cd300 0x7fdf2c0b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54488/0 (socket says 172.21.15.29:54488) 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2b7fe700 1 -- 172.21.15.29:0/796992740 learned_addr learned my addr 172.21.15.29:0/796992740 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2bfff700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf2c15afb0 0x7fdf2c0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2affd700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2b7fe700 1 -- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 msgr2=0x7fdf2c14f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2b7fe700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c14f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2b7fe700 1 -- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf2c15afb0 msgr2=0x7fdf2c0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2b7fe700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf2c15afb0 0x7fdf2c0c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.050+0000 7fdf2b7fe700 1 -- 172.21.15.29:0/796992740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24009a20 con 0x7fdf2c0cd300 2023-10-08T15:41:27.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.051+0000 7fdf2b7fe700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf2c0cd300 0x7fdf2c0b2b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00cb70 tx=0x7fdf1c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.051+0000 7fdf137fe700 1 -- 172.21.15.29:0/796992740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00ce80 con 0x7fdf2c0cd300 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.051+0000 7fdf137fe700 1 -- 172.21.15.29:0/796992740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c007360 con 0x7fdf2c0cd300 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.051+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0b1d90 con 0x7fdf2c0cd300 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.051+0000 7fdf137fe700 1 -- 172.21.15.29:0/796992740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c007700 con 0x7fdf2c0cd300 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.051+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0b2350 con 0x7fdf2c0cd300 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.052+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c04c3c0 con 0x7fdf2c0cd300 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.052+0000 7fdf137fe700 1 -- 172.21.15.29:0/796992740 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf1c004a40 con 0x7fdf2c0cd300 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.052+0000 7fdf137fe700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdf18066f30 0x7fdf180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.053+0000 7fdf137fe700 1 -- 172.21.15.29:0/796992740 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf1c083c70 con 0x7fdf2c0cd300 2023-10-08T15:41:27.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.053+0000 7fdf2affd700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdf18066f30 0x7fdf180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.053+0000 7fdf2affd700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdf18066f30 0x7fdf180693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0c7fb0 tx=0x7fdf20007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.057+0000 7fdf137fe700 1 -- 172.21.15.29:0/796992740 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf1c050f60 con 0x7fdf2c0cd300 2023-10-08T15:41:27.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.247+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf2c0b29a0 con 0x7fdf2c0cd300 2023-10-08T15:41:27.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.247+0000 7fdf137fe700 1 -- 172.21.15.29:0/796992740 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf1c018020 con 0x7fdf2c0cd300 2023-10-08T15:41:27.248 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:41:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdf18066f30 msgr2=0x7fdf180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdf18066f30 0x7fdf180693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0c7fb0 tx=0x7fdf20007d50 comp rx=0 tx=0).stop 2023-10-08T15:41:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf2c0cd300 msgr2=0x7fdf2c0b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf2c0cd300 0x7fdf2c0b2b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00cb70 tx=0x7fdf1c001b50 comp rx=0 tx=0).stop 2023-10-08T15:41:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 shutdown_connections 2023-10-08T15:41:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fdf18066f30 0x7fdf180693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf2c15afb0 0x7fdf2c0c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdf2c0cd300 0x7fdf2c0b2b50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 --2- 172.21.15.29:0/796992740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf2c0d1470 0x7fdf2c14f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 >> 172.21.15.29:0/796992740 conn(0x7fdf2c068d90 msgr2=0x7fdf2c069160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 shutdown_connections 2023-10-08T15:41:27.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.249+0000 7fdf31f22700 1 -- 172.21.15.29:0/796992740 wait complete. 2023-10-08T15:41:27.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:41:27.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.383+0000 7fe596c89700 1 Processor -- start 2023-10-08T15:41:27.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.383+0000 7fe596c89700 1 -- start start 2023-10-08T15:41:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe596c89700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe590159ec0 0x7fe5900af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe596c89700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe59006acb0 0x7fe5900afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe596c89700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900b0790 con 0x7fe59015a290 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe596c89700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5900ce1f0 con 0x7fe59006acb0 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe596c89700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5900b0b20 con 0x7fe590159ec0 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe595226700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe59006acb0 0x7fe5900afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe595226700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe59006acb0 0x7fe5900afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54494/0 (socket says 172.21.15.29:54494) 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe595226700 1 -- 172.21.15.29:0/3686282446 learned_addr learned my addr 172.21.15.29:0/3686282446 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe595226700 1 -- 172.21.15.29:0/3686282446 >> v2:172.21.15.183:3300/0 conn(0x7fe590159ec0 msgr2=0x7fe5900af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe595226700 1 --2- 172.21.15.29:0/3686282446 >> v2:172.21.15.183:3300/0 conn(0x7fe590159ec0 0x7fe5900af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe595226700 1 -- 172.21.15.29:0/3686282446 >> v1:172.21.15.183:6789/0 conn(0x7fe59015a290 legacy=0x7fe59006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe595226700 1 -- 172.21.15.29:0/3686282446 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900b04b0 con 0x7fe59006acb0 2023-10-08T15:41:27.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe595226700 1 --2- 172.21.15.29:0/3686282446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe59006acb0 0x7fe5900afe80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5900898e0 tx=0x7fe588009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cefa0739c61f8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe58f7fe700 1 -- 172.21.15.29:0/3686282446 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58800e070 con 0x7fe59006acb0 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe58f7fe700 1 -- 172.21.15.29:0/3686282446 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58800ba10 con 0x7fe59006acb0 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.384+0000 7fe58f7fe700 1 -- 172.21.15.29:0/3686282446 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5880092e0 con 0x7fe59006acb0 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.385+0000 7fe596c89700 1 -- 172.21.15.29:0/3686282446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe59006acb0 msgr2=0x7fe5900afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.385+0000 7fe596c89700 1 --2- 172.21.15.29:0/3686282446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe59006acb0 0x7fe5900afe80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5900898e0 tx=0x7fe588009840 comp rx=0 tx=0).stop 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.385+0000 7fe596c89700 1 -- 172.21.15.29:0/3686282446 shutdown_connections 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.385+0000 7fe596c89700 1 --2- 172.21.15.29:0/3686282446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe59006acb0 0x7fe5900afe80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.385+0000 7fe596c89700 1 --2- 172.21.15.29:0/3686282446 >> v2:172.21.15.183:3300/0 conn(0x7fe590159ec0 0x7fe5900af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.385+0000 7fe596c89700 1 -- 172.21.15.29:0/3686282446 >> 172.21.15.29:0/3686282446 conn(0x7fe5900d1880 msgr2=0x7fe5900cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.385+0000 7fe596c89700 1 -- 172.21.15.29:0/3686282446 shutdown_connections 2023-10-08T15:41:27.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.385+0000 7fe596c89700 1 -- 172.21.15.29:0/3686282446 wait complete. 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.386+0000 7fe596c89700 1 Processor -- start 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.386+0000 7fe596c89700 1 -- start start 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe596c89700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe59006acb0 0x7fe59016d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe596c89700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe590159ec0 0x7fe59016a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe596c89700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe59015a290 0x7fe5900c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe596c89700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900b4b20 con 0x7fe590159ec0 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe596c89700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900b53c0 con 0x7fe59006acb0 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe596c89700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59016d720 con 0x7fe59015a290 2023-10-08T15:41:27.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe590159ec0 0x7fe59016a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe590159ec0 0x7fe59016a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54498/0 (socket says 172.21.15.29:54498) 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 -- 172.21.15.29:0/1607867160 learned_addr learned my addr 172.21.15.29:0/1607867160 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe594a25700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe59006acb0 0x7fe59016d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe595226700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe59015a290 0x7fe5900c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 -- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe59015a290 msgr2=0x7fe5900c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe59015a290 0x7fe5900c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 -- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe59006acb0 msgr2=0x7fe59016d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe59006acb0 0x7fe59016d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 -- 172.21.15.29:0/1607867160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588009ae0 con 0x7fe590159ec0 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe594a25700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe59006acb0 0x7fe59016d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.387+0000 7fe58ffff700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe590159ec0 0x7fe59016a390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe57800b5e0 tx=0x7fe5780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.388+0000 7fe58cff9700 1 -- 172.21.15.29:0/1607867160 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800f510 con 0x7fe590159ec0 2023-10-08T15:41:27.391 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.388+0000 7fe58cff9700 1 -- 172.21.15.29:0/1607867160 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57800f690 con 0x7fe590159ec0 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.388+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5900c8110 con 0x7fe590159ec0 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.388+0000 7fe58cff9700 1 -- 172.21.15.29:0/1607867160 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800fa50 con 0x7fe590159ec0 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.388+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5900b4d70 con 0x7fe590159ec0 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.389+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5900b5530 con 0x7fe590159ec0 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.389+0000 7fe58cff9700 1 -- 172.21.15.29:0/1607867160 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe57801a400 con 0x7fe590159ec0 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.389+0000 7fe58cff9700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe570066f30 0x7fe5700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.389+0000 7fe58cff9700 1 -- 172.21.15.29:0/1607867160 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe578084080 con 0x7fe590159ec0 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.390+0000 7fe594a25700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe570066f30 0x7fe5700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.390+0000 7fe594a25700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe570066f30 0x7fe5700693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe580006fd0 tx=0x7fe580008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.394+0000 7fe58cff9700 1 -- 172.21.15.29:0/1607867160 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe578054e00 con 0x7fe590159ec0 2023-10-08T15:41:27.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.585+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe59004c3c0 con 0x7fe590159ec0 2023-10-08T15:41:27.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.586+0000 7fe58cff9700 1 -- 172.21.15.29:0/1607867160 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe578054990 con 0x7fe590159ec0 2023-10-08T15:41:27.587 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:41:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe570066f30 msgr2=0x7fe5700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe570066f30 0x7fe5700693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe580006fd0 tx=0x7fe580008040 comp rx=0 tx=0).stop 2023-10-08T15:41:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe590159ec0 msgr2=0x7fe59016a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe590159ec0 0x7fe59016a390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe57800b5e0 tx=0x7fe5780090f0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 shutdown_connections 2023-10-08T15:41:27.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe570066f30 0x7fe5700693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe59015a290 0x7fe5900c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe59006acb0 0x7fe59016d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 --2- 172.21.15.29:0/1607867160 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe590159ec0 0x7fe59016a390 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.587+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 >> 172.21.15.29:0/1607867160 conn(0x7fe5900d1880 msgr2=0x7fe5900c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:27.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.588+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 shutdown_connections 2023-10-08T15:41:27.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.588+0000 7fe596c89700 1 -- 172.21.15.29:0/1607867160 wait complete. 2023-10-08T15:41:27.600 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:27.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.721+0000 7ff4f98b5700 1 Processor -- start 2023-10-08T15:41:27.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.721+0000 7ff4f98b5700 1 -- start start 2023-10-08T15:41:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f98b5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff4f40d1c30 0x7ff4f40ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f98b5700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4f415a680 0x7ff4f40cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f98b5700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f40c5d80 con 0x7ff4f415a2b0 2023-10-08T15:41:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f98b5700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f4068470 con 0x7ff4f415a680 2023-10-08T15:41:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f98b5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f40c6060 con 0x7ff4f40d1c30 2023-10-08T15:41:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4f415a680 0x7ff4f40cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4f415a680 0x7ff4f40cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54504/0 (socket says 172.21.15.29:54504) 2023-10-08T15:41:27.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f37fe700 1 -- 172.21.15.29:0/2722560844 learned_addr learned my addr 172.21.15.29:0/2722560844 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f27fc700 1 --2- 172.21.15.29:0/2722560844 >> v2:172.21.15.183:3300/0 conn(0x7ff4f40d1c30 0x7ff4f40ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f37fe700 1 -- 172.21.15.29:0/2722560844 >> v2:172.21.15.183:3300/0 conn(0x7ff4f40d1c30 msgr2=0x7ff4f40ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f37fe700 1 --2- 172.21.15.29:0/2722560844 >> v2:172.21.15.183:3300/0 conn(0x7ff4f40d1c30 0x7ff4f40ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f37fe700 1 -- 172.21.15.29:0/2722560844 >> v1:172.21.15.183:6789/0 conn(0x7ff4f415a2b0 legacy=0x7ff4f40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f37fe700 1 -- 172.21.15.29:0/2722560844 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40c6340 con 0x7ff4f415a680 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f37fe700 1 --2- 172.21.15.29:0/2722560844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f415a680 0x7ff4f40cf710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4089190 tx=0x7ff4ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7832080258cf6ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f1ffb700 1 -- 172.21.15.29:0/2722560844 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00e070 con 0x7ff4f415a680 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f1ffb700 1 -- 172.21.15.29:0/2722560844 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec00ba20 con 0x7ff4f415a680 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.722+0000 7ff4f1ffb700 1 -- 172.21.15.29:0/2722560844 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0092e0 con 0x7ff4f415a680 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.723+0000 7ff4f98b5700 1 -- 172.21.15.29:0/2722560844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f415a680 msgr2=0x7ff4f40cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.723+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/2722560844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f415a680 0x7ff4f40cf710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4089190 tx=0x7ff4ec009840 comp rx=0 tx=0).stop 2023-10-08T15:41:27.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.723+0000 7ff4f98b5700 1 -- 172.21.15.29:0/2722560844 shutdown_connections 2023-10-08T15:41:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.723+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/2722560844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f415a680 0x7ff4f40cf710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.723+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/2722560844 >> v2:172.21.15.183:3300/0 conn(0x7ff4f40d1c30 0x7ff4f40ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.723+0000 7ff4f98b5700 1 -- 172.21.15.29:0/2722560844 >> 172.21.15.29:0/2722560844 conn(0x7ff4f4067e40 msgr2=0x7ff4f40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.723+0000 7ff4f98b5700 1 -- 172.21.15.29:0/2722560844 shutdown_connections 2023-10-08T15:41:27.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.723+0000 7ff4f98b5700 1 -- 172.21.15.29:0/2722560844 wait complete. 2023-10-08T15:41:27.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.724+0000 7ff4f98b5700 1 Processor -- start 2023-10-08T15:41:27.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.724+0000 7ff4f98b5700 1 -- start start 2023-10-08T15:41:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f98b5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f40d1c30 0x7ff4f40b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f98b5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f415a2b0 0x7ff4f416c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f98b5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4f415a680 0x7ff4f415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f98b5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41505e0 con 0x7ff4f40d1c30 2023-10-08T15:41:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f98b5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f416c880 con 0x7ff4f415a2b0 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f98b5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f415cad0 con 0x7ff4f415a680 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f40d1c30 0x7ff4f40b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f40d1c30 0x7ff4f40b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54506/0 (socket says 172.21.15.29:54506) 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f2ffd700 1 -- 172.21.15.29:0/3889623930 learned_addr learned my addr 172.21.15.29:0/3889623930 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f27fc700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f415a2b0 0x7ff4f416c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f37fe700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4f415a680 0x7ff4f415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f2ffd700 1 -- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4f415a680 msgr2=0x7ff4f415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f2ffd700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4f415a680 0x7ff4f415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f2ffd700 1 -- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f415a2b0 msgr2=0x7ff4f416c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f2ffd700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f415a2b0 0x7ff4f416c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f2ffd700 1 -- 172.21.15.29:0/3889623930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009ae0 con 0x7ff4f40d1c30 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.725+0000 7ff4f27fc700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f415a2b0 0x7ff4f416c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.726+0000 7ff4f2ffd700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f40d1c30 0x7ff4f40b5e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c540 tx=0x7ff4e4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.726+0000 7ff4daffd700 1 -- 172.21.15.29:0/3889623930 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011590 con 0x7ff4f40d1c30 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.726+0000 7ff4daffd700 1 -- 172.21.15.29:0/3889623930 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e40116f0 con 0x7ff4f40d1c30 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.726+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f416ca90 con 0x7ff4f40d1c30 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.726+0000 7ff4daffd700 1 -- 172.21.15.29:0/3889623930 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011ab0 con 0x7ff4f40d1c30 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.726+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f416d050 con 0x7ff4f40d1c30 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.727+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f4069760 con 0x7ff4f40d1c30 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.727+0000 7ff4daffd700 1 -- 172.21.15.29:0/3889623930 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4e401b3b0 con 0x7ff4f40d1c30 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.728+0000 7ff4daffd700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff4e0066f30 0x7ff4e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.728+0000 7ff4daffd700 1 -- 172.21.15.29:0/3889623930 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4e4083980 con 0x7ff4f40d1c30 2023-10-08T15:41:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.728+0000 7ff4f27fc700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff4e0066f30 0x7ff4e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.728+0000 7ff4f27fc700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff4e0066f30 0x7ff4e00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40c7070 tx=0x7ff4e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.732+0000 7ff4daffd700 1 -- 172.21.15.29:0/3889623930 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4e4050ca0 con 0x7ff4f40d1c30 2023-10-08T15:41:27.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.968+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4f404c3c0 con 0x7ff4f40d1c30 2023-10-08T15:41:27.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.969+0000 7ff4daffd700 1 -- 172.21.15.29:0/3889623930 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7ff4e4017070 con 0x7ff4f40d1c30 2023-10-08T15:41:27.969 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:27.970 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:12.039331+0000","modified":"2023-10-08T15:41:15.672568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/470731948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":470731948},{"type":"v1","addr":"172.21.15.29:6835","nonce":470731948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:41:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff4e0066f30 msgr2=0x7ff4e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff4e0066f30 0x7ff4e00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40c7070 tx=0x7ff4e8008040 comp rx=0 tx=0).stop 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f40d1c30 msgr2=0x7ff4f40b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f40d1c30 0x7ff4f40b5e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c540 tx=0x7ff4e4001070 comp rx=0 tx=0).stop 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 shutdown_connections 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff4e0066f30 0x7ff4e00693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4f415a680 0x7ff4f415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4f40d1c30 0x7ff4f40b5e00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 --2- 172.21.15.29:0/3889623930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f415a2b0 0x7ff4f416c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 >> 172.21.15.29:0/3889623930 conn(0x7ff4f4067e40 msgr2=0x7ff4f40b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 shutdown_connections 2023-10-08T15:41:27.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:27.971+0000 7ff4f98b5700 1 -- 172.21.15.29:0/3889623930 wait complete. 2023-10-08T15:41:27.973 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-08T15:41:27.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:28.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.101+0000 7fc802e7f700 1 Processor -- start 2023-10-08T15:41:28.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.101+0000 7fc802e7f700 1 -- start start 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc802e7f700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc7fc0cfe20 0x7fc7fc0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc802e7f700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7fc0c5d80 con 0x7fc7fc15a2b0 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc802e7f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7fc0c6060 con 0x7fc7fc0d1c30 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc802e7f700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc068470 con 0x7fc7fc0cfe20 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc800c1b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc7fc15a2b0 0x7fc7fc0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:36790/0 (socket says 172.21.15.29:36790) 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc800c1b700 1 -- 172.21.15.29:0/3547951789 learned_addr learned my addr 172.21.15.29:0/3547951789 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc80141c700 1 --2- 172.21.15.29:0/3547951789 >> v2:172.21.15.183:3300/0 conn(0x7fc7fc0cfe20 0x7fc7fc0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541264526 0 0) 0x7fc7fc0c5d80 con 0x7fc7fc15a2b0 2023-10-08T15:41:28.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7ec003570 con 0x7fc7fc15a2b0 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1439633618 0 0) 0x7fc7ec003570 con 0x7fc7fc15a2b0 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 >> v2:172.21.15.183:3300/0 conn(0x7fc7fc0cfe20 msgr2=0x7fc7fc0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 --2- 172.21.15.29:0/3547951789 >> v2:172.21.15.183:3300/0 conn(0x7fc7fc0cfe20 0x7fc7fc0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 >> v1:172.21.15.183:6789/0 conn(0x7fc7fc0d1c30 legacy=0x7fc7fc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc0c6340 con 0x7fc7fc15a2b0 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fc7f00015f0 con 0x7fc7fc15a2b0 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 >> v1:172.21.15.29:6789/0 conn(0x7fc7fc15a2b0 legacy=0x7fc7fc0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.102+0000 7fc7fb7fe700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec003a60 0x7fc7ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fb7fe700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fb7fe700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ec0051c0 0x7fc7ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc068470 con 0x7fc7ec004810 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec00c0d0 con 0x7fc7ec0051c0 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec00c290 con 0x7fc7ec003a60 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fbfff700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc80141c700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ec0051c0 0x7fc7ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc800c1b700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec003a60 0x7fc7ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fbfff700 1 -- 172.21.15.29:0/3547951789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec003a60 msgr2=0x7fc7ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fbfff700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec003a60 0x7fc7ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fbfff700 1 -- 172.21.15.29:0/3547951789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ec0051c0 msgr2=0x7fc7ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fbfff700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7ec0051c0 0x7fc7ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc80141c700 1 -- 172.21.15.29:0/3547951789 reap_dead start 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fbfff700 1 -- 172.21.15.29:0/3547951789 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec003570 con 0x7fc7ec004810 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fbfff700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8001880 tx=0x7fc7e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243f05f23a43366e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8012420 con 0x7fc7ec004810 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e80125a0 con 0x7fc7ec004810 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.103+0000 7fc7fb7fe700 1 -- 172.21.15.29:0/3547951789 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8012960 con 0x7fc7ec004810 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.104+0000 7fc802e7f700 1 -- 172.21.15.29:0/3547951789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7ec004810 msgr2=0x7fc7ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.104+0000 7fc802e7f700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8001880 tx=0x7fc7e8007d30 comp rx=0 tx=0).stop 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.104+0000 7fc802e7f700 1 -- 172.21.15.29:0/3547951789 shutdown_connections 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.104+0000 7fc802e7f700 1 --2- 172.21.15.29:0/3547951789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.104+0000 7fc802e7f700 1 -- 172.21.15.29:0/3547951789 >> 172.21.15.29:0/3547951789 conn(0x7fc7fc067e40 msgr2=0x7fc7fc0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:28.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.104+0000 7fc802e7f700 1 -- 172.21.15.29:0/3547951789 shutdown_connections 2023-10-08T15:41:28.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.104+0000 7fc802e7f700 1 -- 172.21.15.29:0/3547951789 wait complete. 2023-10-08T15:41:28.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.105+0000 7fc802e7f700 1 Processor -- start 2023-10-08T15:41:28.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.105+0000 7fc802e7f700 1 -- start start 2023-10-08T15:41:28.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc802e7f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec004810 0x7fc7fc15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc802e7f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7fc16dbf0 0x7fc7fc159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc802e7f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7fc1602f0 0x7fc7fc0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc802e7f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc16a610 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc802e7f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc16e090 con 0x7fc7fc1602f0 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc802e7f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc16e370 con 0x7fc7ec004810 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7fc16dbf0 0x7fc7fc159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7fc16dbf0 0x7fc7fc159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54530/0 (socket says 172.21.15.29:54530) 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 -- 172.21.15.29:0/1368737918 learned_addr learned my addr 172.21.15.29:0/1368737918 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc800c1b700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec004810 0x7fc7fc15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc80141c700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7fc1602f0 0x7fc7fc0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 -- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec004810 msgr2=0x7fc7fc15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec004810 0x7fc7fc15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 -- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7fc1602f0 msgr2=0x7fc7fc0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7fc1602f0 0x7fc7fc0cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 -- 172.21.15.29:0/1368737918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc16e650 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7fbfff700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7fc16dbf0 0x7fc7fc159c90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00c0a0 tx=0x7fc7e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7f8ff9700 1 -- 172.21.15.29:0/1368737918 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8006820 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc7f8ff9700 1 -- 172.21.15.29:0/1368737918 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e80069a0 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.106+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc16e930 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.107+0000 7fc7f8ff9700 1 -- 172.21.15.29:0/1368737918 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8006d60 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.107+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc160f20 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.107+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc0cd840 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.108+0000 7fc7f8ff9700 1 -- 172.21.15.29:0/1368737918 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7e8019030 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.108+0000 7fc7f8ff9700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc7e0066f30 0x7fc7e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.108+0000 7fc7f8ff9700 1 -- 172.21.15.29:0/1368737918 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7e8085580 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.109+0000 7fc800c1b700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc7e0066f30 0x7fc7e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.109+0000 7fc800c1b700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc7e0066f30 0x7fc7e00693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0000e10 tx=0x7fc7f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.113+0000 7fc7f8ff9700 1 -- 172.21.15.29:0/1368737918 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7e8052750 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.308+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7fc04c3c0 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.309+0000 7fc7f8ff9700 1 -- 172.21.15.29:0/1368737918 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc7e8017090 con 0x7fc7fc16dbf0 2023-10-08T15:41:28.309 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:28.310 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":33,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:23.693155+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:10.133425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:11.014819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:28.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc7e0066f30 msgr2=0x7fc7e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc7e0066f30 0x7fc7e00693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0000e10 tx=0x7fc7f0009040 comp rx=0 tx=0).stop 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7fc16dbf0 msgr2=0x7fc7fc159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7fc16dbf0 0x7fc7fc159c90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00c0a0 tx=0x7fc7e8015000 comp rx=0 tx=0).stop 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 shutdown_connections 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc7e0066f30 0x7fc7e00693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7fc1602f0 0x7fc7fc0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7ec004810 0x7fc7fc15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 --2- 172.21.15.29:0/1368737918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc7fc16dbf0 0x7fc7fc159c90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 >> 172.21.15.29:0/1368737918 conn(0x7fc7fc067e40 msgr2=0x7fc7fc0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:28.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 shutdown_connections 2023-10-08T15:41:28.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.311+0000 7fc802e7f700 1 -- 172.21.15.29:0/1368737918 wait complete. 2023-10-08T15:41:28.324 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T15:41:28.325 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:28.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.444+0000 7f8367148700 1 Processor -- start 2023-10-08T15:41:28.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.444+0000 7f8367148700 1 -- start start 2023-10-08T15:41:28.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.444+0000 7f8367148700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f836015bf00 0x7f83600ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.444+0000 7f8367148700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83601523f0 0x7f836006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.444+0000 7f8367148700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83600cbb10 con 0x7f8360152020 2023-10-08T15:41:28.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.444+0000 7f8367148700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83600cbfa0 con 0x7f836015bf00 2023-10-08T15:41:28.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.444+0000 7f8367148700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83600caca0 con 0x7f83601523f0 2023-10-08T15:41:28.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f8364ee4700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8360152020 0x7f836015b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39120/0 (socket says 172.21.15.29:39120) 2023-10-08T15:41:28.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f8364ee4700 1 -- 172.21.15.29:0/4217140915 learned_addr learned my addr 172.21.15.29:0/4217140915 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:28.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f83656e5700 1 --2- 172.21.15.29:0/4217140915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83601523f0 0x7f836006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f835ffff700 1 --2- 172.21.15.29:0/4217140915 >> v2:172.21.15.183:3300/0 conn(0x7f836015bf00 0x7f83600ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f835f7fe700 1 -- 172.21.15.29:0/4217140915 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547557782 0 0) 0x7f83600cbb10 con 0x7f8360152020 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f835f7fe700 1 -- 172.21.15.29:0/4217140915 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8348003570 con 0x7f8360152020 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f835f7fe700 1 -- 172.21.15.29:0/4217140915 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2029577661 0 0) 0x7f8348003570 con 0x7f8360152020 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f83656e5700 1 -- 172.21.15.29:0/4217140915 >> v2:172.21.15.183:3300/0 conn(0x7f836015bf00 msgr2=0x7f83600ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f83656e5700 1 --2- 172.21.15.29:0/4217140915 >> v2:172.21.15.183:3300/0 conn(0x7f836015bf00 0x7f83600ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f83656e5700 1 -- 172.21.15.29:0/4217140915 >> v1:172.21.15.29:6789/0 conn(0x7f8360152020 legacy=0x7f836015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f83656e5700 1 -- 172.21.15.29:0/4217140915 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836006cd30 con 0x7f83601523f0 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f83656e5700 1 --2- 172.21.15.29:0/4217140915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83601523f0 0x7f836006c7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f83500098e0 tx=0x7f83500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=668f411773b988bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.445+0000 7f835f7fe700 1 -- 172.21.15.29:0/4217140915 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580017f0 con 0x7f83601523f0 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f835f7fe700 1 -- 172.21.15.29:0/4217140915 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8350011420 con 0x7f83601523f0 2023-10-08T15:41:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f835f7fe700 1 -- 172.21.15.29:0/4217140915 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500117c0 con 0x7f83601523f0 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f8367148700 1 -- 172.21.15.29:0/4217140915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83601523f0 msgr2=0x7f836006c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f8367148700 1 --2- 172.21.15.29:0/4217140915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83601523f0 0x7f836006c7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f83500098e0 tx=0x7f83500091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f8367148700 1 -- 172.21.15.29:0/4217140915 shutdown_connections 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f8367148700 1 --2- 172.21.15.29:0/4217140915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83601523f0 0x7f836006c7f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f8367148700 1 --2- 172.21.15.29:0/4217140915 >> v2:172.21.15.183:3300/0 conn(0x7f836015bf00 0x7f83600ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f8367148700 1 -- 172.21.15.29:0/4217140915 >> 172.21.15.29:0/4217140915 conn(0x7f8360069870 msgr2=0x7f8360069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f8367148700 1 -- 172.21.15.29:0/4217140915 shutdown_connections 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.446+0000 7f8367148700 1 -- 172.21.15.29:0/4217140915 wait complete. 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.447+0000 7f8367148700 1 Processor -- start 2023-10-08T15:41:28.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.447+0000 7f8367148700 1 -- start start 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f8367148700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8360152020 0x7f83600cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f8367148700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83601523f0 0x7f83600c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f8367148700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836015bf00 0x7f83600c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f8367148700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83600c8300 con 0x7f83601523f0 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f8367148700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83600b2a20 con 0x7f836015bf00 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f8367148700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83600b2d00 con 0x7f8360152020 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f835ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83601523f0 0x7f83600c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f835ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83601523f0 0x7f83600c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54226/0 (socket says 172.21.15.29:54226) 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f835ffff700 1 -- 172.21.15.29:0/3288216176 learned_addr learned my addr 172.21.15.29:0/3288216176 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:28.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f8364ee4700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8360152020 0x7f83600cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f835ffff700 1 -- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8360152020 msgr2=0x7f83600cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f835ffff700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8360152020 0x7f83600cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.448+0000 7f83656e5700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836015bf00 0x7f83600c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f835ffff700 1 -- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836015bf00 msgr2=0x7f83600c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f835ffff700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836015bf00 0x7f83600c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f835ffff700 1 -- 172.21.15.29:0/3288216176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350009420 con 0x7f83601523f0 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f8364ee4700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8360152020 0x7f83600cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f835ffff700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83601523f0 0x7f83600c7880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f835400e900 tx=0x7f83540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f835cff9700 1 -- 172.21.15.29:0/3288216176 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400eea0 con 0x7f83601523f0 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f835cff9700 1 -- 172.21.15.29:0/3288216176 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835400c850 con 0x7f83601523f0 2023-10-08T15:41:28.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83600b2fe0 con 0x7f83601523f0 2023-10-08T15:41:28.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f835cff9700 1 -- 172.21.15.29:0/3288216176 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835400cc10 con 0x7f83601523f0 2023-10-08T15:41:28.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.449+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83600b2640 con 0x7f83601523f0 2023-10-08T15:41:28.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.450+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83600b3480 con 0x7f83601523f0 2023-10-08T15:41:28.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.450+0000 7f835cff9700 1 -- 172.21.15.29:0/3288216176 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8354013470 con 0x7f83601523f0 2023-10-08T15:41:28.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.451+0000 7f835cff9700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f834c066f30 0x7f834c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.451+0000 7f835cff9700 1 -- 172.21.15.29:0/3288216176 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f83540846d0 con 0x7f83601523f0 2023-10-08T15:41:28.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.451+0000 7f8364ee4700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f834c066f30 0x7f834c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.452+0000 7f8364ee4700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f834c066f30 0x7f834c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83580019a0 tx=0x7f8358009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.455 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.455+0000 7f835cff9700 1 -- 172.21.15.29:0/3288216176 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8354051940 con 0x7f83601523f0 2023-10-08T15:41:28.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.696+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f836004c3c0 con 0x7f83601523f0 2023-10-08T15:41:28.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.696+0000 7f835cff9700 1 -- 172.21.15.29:0/3288216176 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8354054f60 con 0x7f83601523f0 2023-10-08T15:41:28.697 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:28.697 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:12.039331+0000","modified":"2023-10-08T15:41:15.672568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/470731948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":470731948},{"type":"v1","addr":"172.21.15.29:6835","nonce":470731948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:41:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f834c066f30 msgr2=0x7f834c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f834c066f30 0x7f834c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83580019a0 tx=0x7f8358009040 comp rx=0 tx=0).stop 2023-10-08T15:41:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83601523f0 msgr2=0x7f83600c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83601523f0 0x7f83600c7880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f835400e900 tx=0x7f83540091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 shutdown_connections 2023-10-08T15:41:28.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f834c066f30 0x7f834c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836015bf00 0x7f83600c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8360152020 0x7f83600cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 --2- 172.21.15.29:0/3288216176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83601523f0 0x7f83600c7880 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 >> 172.21.15.29:0/3288216176 conn(0x7f8360069870 msgr2=0x7f836006c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 shutdown_connections 2023-10-08T15:41:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.698+0000 7f8367148700 1 -- 172.21.15.29:0/3288216176 wait complete. 2023-10-08T15:41:28.700 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-08T15:41:28.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:28.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.830+0000 7f3cbd557700 1 Processor -- start 2023-10-08T15:41:28.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.830+0000 7f3cbd557700 1 -- start start 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.830+0000 7f3cbd557700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3cb8157870 0x7f3cb815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.830+0000 7f3cbd557700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb815cbb0 con 0x7f3cb815a620 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.830+0000 7f3cbd557700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb815bfa0 con 0x7f3cb8157c40 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.830+0000 7f3cbd557700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb815c280 con 0x7f3cb8157870 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb67fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3cb815a620 0x7f3cb815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39126/0 (socket says 172.21.15.29:39126) 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb67fc700 1 -- 172.21.15.29:0/789648524 learned_addr learned my addr 172.21.15.29:0/789648524 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb6ffd700 1 --2- 172.21.15.29:0/789648524 >> v2:172.21.15.183:3300/0 conn(0x7f3cb8157870 0x7f3cb815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231043466 0 0) 0x7f3cb815cbb0 con 0x7f3cb815a620 2023-10-08T15:41:28.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca4003570 con 0x7f3cb815a620 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2238882321 0 0) 0x7f3ca4003570 con 0x7f3cb815a620 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 >> v2:172.21.15.183:3300/0 conn(0x7f3cb8157870 msgr2=0x7f3cb815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 --2- 172.21.15.29:0/789648524 >> v2:172.21.15.183:3300/0 conn(0x7f3cb8157870 0x7f3cb815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 >> v1:172.21.15.183:6789/0 conn(0x7f3cb8157c40 legacy=0x7f3cb8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb815c560 con 0x7f3cb815a620 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f3ca0001470 con 0x7f3cb815a620 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 >> v1:172.21.15.29:6789/0 conn(0x7f3cb815a620 legacy=0x7f3cb815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4003a60 0x7f3ca4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca4004810 0x7f3ca4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40051c0 0x7f3ca400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb815c280 con 0x7f3ca4004810 2023-10-08T15:41:28.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca400c0e0 con 0x7f3ca40051c0 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca400c2a0 con 0x7f3ca4003a60 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb67fc700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca4004810 0x7f3ca4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb6ffd700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4003a60 0x7f3ca4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.831+0000 7f3cb77fe700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40051c0 0x7f3ca400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb67fc700 1 -- 172.21.15.29:0/789648524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4003a60 msgr2=0x7f3ca4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb67fc700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4003a60 0x7f3ca4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb67fc700 1 -- 172.21.15.29:0/789648524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40051c0 msgr2=0x7f3ca400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb67fc700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40051c0 0x7f3ca400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb77fe700 1 -- 172.21.15.29:0/789648524 reap_dead start 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb67fc700 1 -- 172.21.15.29:0/789648524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4003570 con 0x7f3ca4004810 2023-10-08T15:41:28.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb67fc700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca4004810 0x7f3ca4004c80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000c2a0 tx=0x7f3ca0001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28089b15fa16cb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000cb90 con 0x7f3ca4004810 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca000ccf0 con 0x7f3ca4004810 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cb5ffb700 1 -- 172.21.15.29:0/789648524 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0005b70 con 0x7f3ca4004810 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cbd557700 1 -- 172.21.15.29:0/789648524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca4004810 msgr2=0x7f3ca4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cbd557700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca4004810 0x7f3ca4004c80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000c2a0 tx=0x7f3ca0001df0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cbd557700 1 -- 172.21.15.29:0/789648524 shutdown_connections 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cbd557700 1 --2- 172.21.15.29:0/789648524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ca4004810 0x7f3ca4004c80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.832+0000 7f3cbd557700 1 -- 172.21.15.29:0/789648524 >> 172.21.15.29:0/789648524 conn(0x7f3cb8068ce0 msgr2=0x7f3cb80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.833+0000 7f3cbd557700 1 -- 172.21.15.29:0/789648524 shutdown_connections 2023-10-08T15:41:28.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.833+0000 7f3cbd557700 1 -- 172.21.15.29:0/789648524 wait complete. 2023-10-08T15:41:28.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.834+0000 7f3cbd557700 1 Processor -- start 2023-10-08T15:41:28.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.834+0000 7f3cbd557700 1 -- start start 2023-10-08T15:41:28.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.834+0000 7f3cbd557700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4004810 0x7f3cb81487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.834+0000 7f3cbd557700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8155880 0x7f3cb815e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.834+0000 7f3cbd557700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb8160570 0x7f3cb80c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.834+0000 7f3cbd557700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb815dea0 con 0x7f3cb8160570 2023-10-08T15:41:28.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cbd557700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb815db70 con 0x7f3cb8155880 2023-10-08T15:41:28.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cbd557700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb815ffb0 con 0x7f3ca4004810 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb8160570 0x7f3cb80c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb6ffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4004810 0x7f3cb81487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb8160570 0x7f3cb80c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54236/0 (socket says 172.21.15.29:54236) 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 -- 172.21.15.29:0/1904048733 learned_addr learned my addr 172.21.15.29:0/1904048733 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb67fc700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8155880 0x7f3cb815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 -- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4004810 msgr2=0x7f3cb81487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4004810 0x7f3cb81487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 -- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8155880 msgr2=0x7f3cb815e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8155880 0x7f3cb815e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 -- 172.21.15.29:0/1904048733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8160290 con 0x7f3cb8160570 2023-10-08T15:41:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cb77fe700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb8160570 0x7f3cb80c7200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80b3830 tx=0x7f3ca80016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3caeffd700 1 -- 172.21.15.29:0/1904048733 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8006ba0 con 0x7f3cb8160570 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3caeffd700 1 -- 172.21.15.29:0/1904048733 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8006d20 con 0x7f3cb8160570 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb8148ce0 con 0x7f3cb8160570 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3caeffd700 1 -- 172.21.15.29:0/1904048733 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800c7f0 con 0x7f3cb8160570 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.835+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb81609f0 con 0x7f3cb8160570 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.836+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb815dce0 con 0x7f3cb8160570 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.837+0000 7f3caeffd700 1 -- 172.21.15.29:0/1904048733 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ca800cbe0 con 0x7f3cb8160570 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.837+0000 7f3caeffd700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c98066f30 0x7f3c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.837+0000 7f3caeffd700 1 -- 172.21.15.29:0/1904048733 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ca8083b40 con 0x7f3cb8160570 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.837+0000 7f3cb6ffd700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c98066f30 0x7f3c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:28.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.838+0000 7f3cb6ffd700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c98066f30 0x7f3c980693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8156f10 tx=0x7f3cb00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:28.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:28.841+0000 7f3caeffd700 1 -- 172.21.15.29:0/1904048733 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ca804c5a0 con 0x7f3cb8160570 2023-10-08T15:41:29.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.080+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cb804c3c0 con 0x7f3cb8160570 2023-10-08T15:41:29.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.081+0000 7f3caeffd700 1 -- 172.21.15.29:0/1904048733 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f3cb815dce0 con 0x7f3cb8160570 2023-10-08T15:41:29.081 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:29.081 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:12.039331+0000","modified":"2023-10-08T15:41:15.672568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/470731948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":470731948},{"type":"v1","addr":"172.21.15.29:6835","nonce":470731948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T15:41:29.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c98066f30 msgr2=0x7f3c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c98066f30 0x7f3c980693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8156f10 tx=0x7f3cb00091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb8160570 msgr2=0x7f3cb80c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb8160570 0x7f3cb80c7200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80b3830 tx=0x7f3ca80016d0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 shutdown_connections 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c98066f30 0x7f3c980693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cb8160570 0x7f3cb80c7200 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4004810 0x7f3cb81487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 --2- 172.21.15.29:0/1904048733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8155880 0x7f3cb815e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 >> 172.21.15.29:0/1904048733 conn(0x7f3cb8068ce0 msgr2=0x7f3cb80b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 shutdown_connections 2023-10-08T15:41:29.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.083+0000 7f3cbd557700 1 -- 172.21.15.29:0/1904048733 wait complete. 2023-10-08T15:41:29.085 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 17 2023-10-08T15:41:29.096 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.213+0000 7ff000882700 1 Processor -- start 2023-10-08T15:41:29.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.213+0000 7ff000882700 1 -- start start 2023-10-08T15:41:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.214+0000 7ff000882700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feffc159be0 0x7feffc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.214+0000 7ff000882700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feffc0cf060 0x7feffc0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.214+0000 7ff000882700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc067800 con 0x7feffc159fb0 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.214+0000 7ff000882700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc0701f0 con 0x7feffc0cf060 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.214+0000 7ff000882700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc067ae0 con 0x7feffc159be0 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.214+0000 7feffbfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feffc0cf060 0x7feffc0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.214+0000 7feffbfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feffc0cf060 0x7feffc0b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54246/0 (socket says 172.21.15.29:54246) 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.214+0000 7feffbfff700 1 -- 172.21.15.29:0/2398199696 learned_addr learned my addr 172.21.15.29:0/2398199696 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffb7fe700 1 --2- 172.21.15.29:0/2398199696 >> v2:172.21.15.183:3300/0 conn(0x7feffc159be0 0x7feffc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffbfff700 1 -- 172.21.15.29:0/2398199696 >> v2:172.21.15.183:3300/0 conn(0x7feffc159be0 msgr2=0x7feffc068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffbfff700 1 --2- 172.21.15.29:0/2398199696 >> v2:172.21.15.183:3300/0 conn(0x7feffc159be0 0x7feffc068db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffbfff700 1 -- 172.21.15.29:0/2398199696 >> v1:172.21.15.183:6789/0 conn(0x7feffc159fb0 legacy=0x7feffc0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:29.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffbfff700 1 -- 172.21.15.29:0/2398199696 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc067dc0 con 0x7feffc0cf060 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffb7fe700 1 --2- 172.21.15.29:0/2398199696 >> v2:172.21.15.183:3300/0 conn(0x7feffc159be0 0x7feffc068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffbfff700 1 --2- 172.21.15.29:0/2398199696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc0cf060 0x7feffc0b3c70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feffc06efa0 tx=0x7feff4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab644afbdd9be2e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffa7fc700 1 -- 172.21.15.29:0/2398199696 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff400e070 con 0x7feffc0cf060 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffa7fc700 1 -- 172.21.15.29:0/2398199696 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff400ba10 con 0x7feffc0cf060 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7feffa7fc700 1 -- 172.21.15.29:0/2398199696 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff40092e0 con 0x7feffc0cf060 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7ff000882700 1 -- 172.21.15.29:0/2398199696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc0cf060 msgr2=0x7feffc0b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7ff000882700 1 --2- 172.21.15.29:0/2398199696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc0cf060 0x7feffc0b3c70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feffc06efa0 tx=0x7feff4009840 comp rx=0 tx=0).stop 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.215+0000 7ff000882700 1 -- 172.21.15.29:0/2398199696 shutdown_connections 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.216+0000 7ff000882700 1 --2- 172.21.15.29:0/2398199696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc0cf060 0x7feffc0b3c70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.216+0000 7ff000882700 1 --2- 172.21.15.29:0/2398199696 >> v2:172.21.15.183:3300/0 conn(0x7feffc159be0 0x7feffc068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.216+0000 7ff000882700 1 -- 172.21.15.29:0/2398199696 >> 172.21.15.29:0/2398199696 conn(0x7feffc06bc70 msgr2=0x7feffc06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.216+0000 7ff000882700 1 -- 172.21.15.29:0/2398199696 shutdown_connections 2023-10-08T15:41:29.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.216+0000 7ff000882700 1 -- 172.21.15.29:0/2398199696 wait complete. 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.217+0000 7ff000882700 1 Processor -- start 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.217+0000 7ff000882700 1 -- start start 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7ff000882700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feffc0cf060 0x7feffc157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7ff000882700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc159be0 0x7feffc0c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7ff000882700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feffc159fb0 0x7feffc0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7ff000882700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc157fd0 con 0x7feffc159be0 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7ff000882700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0c6170 con 0x7feffc159fb0 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7ff000882700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0b25a0 con 0x7feffc0cf060 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc159be0 0x7feffc0c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc159be0 0x7feffc0c2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54256/0 (socket says 172.21.15.29:54256) 2023-10-08T15:41:29.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 -- 172.21.15.29:0/3687862447 learned_addr learned my addr 172.21.15.29:0/3687862447 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffbfff700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feffc159fb0 0x7feffc0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffb7fe700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feffc0cf060 0x7feffc157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 -- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feffc0cf060 msgr2=0x7feffc157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feffc0cf060 0x7feffc157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 -- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feffc159fb0 msgr2=0x7feffc0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feffc159fb0 0x7feffc0c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 -- 172.21.15.29:0/3687862447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4009ae0 con 0x7feffc159be0 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffb7fe700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feffc0cf060 0x7feffc157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7feffaffd700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc159be0 0x7feffc0c2420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feff0002ee0 tx=0x7feff0007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7fefe37fe700 1 -- 172.21.15.29:0/3687862447 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff0016070 con 0x7feffc159be0 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7fefe37fe700 1 -- 172.21.15.29:0/3687862447 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff0006820 con 0x7feffc159be0 2023-10-08T15:41:29.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc0b2880 con 0x7feffc159be0 2023-10-08T15:41:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7fefe37fe700 1 -- 172.21.15.29:0/3687862447 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff0006be0 con 0x7feffc159be0 2023-10-08T15:41:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.218+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc0b2e40 con 0x7feffc159be0 2023-10-08T15:41:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.219+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc0c6330 con 0x7feffc159be0 2023-10-08T15:41:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.220+0000 7fefe37fe700 1 -- 172.21.15.29:0/3687862447 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feff0007020 con 0x7feffc159be0 2023-10-08T15:41:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.220+0000 7fefe37fe700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fefe8066f30 0x7fefe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.220+0000 7fefe37fe700 1 -- 172.21.15.29:0/3687862447 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feff0083d30 con 0x7feffc159be0 2023-10-08T15:41:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.220+0000 7feffb7fe700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fefe8066f30 0x7fefe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.221+0000 7feffb7fe700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fefe8066f30 0x7fefe80693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fefec00ac10 tx=0x7fefec006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.224+0000 7fefe37fe700 1 -- 172.21.15.29:0/3687862447 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feff0050fa0 con 0x7feffc159be0 2023-10-08T15:41:29.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.420+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feffc04bb80 con 0x7feffc159be0 2023-10-08T15:41:29.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.421+0000 7fefe37fe700 1 -- 172.21.15.29:0/3687862447 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7feff00545c0 con 0x7feffc159be0 2023-10-08T15:41:29.422 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":33,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:23.693155+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:10.133425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:11.014819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:29.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fefe8066f30 msgr2=0x7fefe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fefe8066f30 0x7fefe80693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fefec00ac10 tx=0x7fefec006f90 comp rx=0 tx=0).stop 2023-10-08T15:41:29.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc159be0 msgr2=0x7feffc0c2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc159be0 0x7feffc0c2420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feff0002ee0 tx=0x7feff0007f20 comp rx=0 tx=0).stop 2023-10-08T15:41:29.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 shutdown_connections 2023-10-08T15:41:29.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fefe8066f30 0x7fefe80693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feffc159fb0 0x7feffc0c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feffc0cf060 0x7feffc157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 --2- 172.21.15.29:0/3687862447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feffc159be0 0x7feffc0c2420 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 >> 172.21.15.29:0/3687862447 conn(0x7feffc06bc70 msgr2=0x7feffc158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:29.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 shutdown_connections 2023-10-08T15:41:29.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.423+0000 7ff000882700 1 -- 172.21.15.29:0/3687862447 wait complete. 2023-10-08T15:41:29.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T15:41:29.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.554+0000 7fbb6bce2700 1 Processor -- start 2023-10-08T15:41:29.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.555+0000 7fbb6bce2700 1 -- start start 2023-10-08T15:41:29.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.555+0000 7fbb6bce2700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb640d1c30 0x7fbb640ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6bce2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbb6415a680 0x7fbb640cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6bce2700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb640c5d80 con 0x7fbb6415a2b0 2023-10-08T15:41:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6bce2700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb64068470 con 0x7fbb640d1c30 2023-10-08T15:41:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6bce2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640c6060 con 0x7fbb6415a680 2023-10-08T15:41:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6927d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb640d1c30 0x7fbb640ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6927d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbb640d1c30 0x7fbb640ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54264/0 (socket says 172.21.15.29:54264) 2023-10-08T15:41:29.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6927d700 1 -- 172.21.15.29:0/3023653905 learned_addr learned my addr 172.21.15.29:0/3023653905 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6a27f700 1 --2- 172.21.15.29:0/3023653905 >> v2:172.21.15.183:3300/0 conn(0x7fbb6415a680 0x7fbb640cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6927d700 1 -- 172.21.15.29:0/3023653905 >> v2:172.21.15.183:3300/0 conn(0x7fbb6415a680 msgr2=0x7fbb640cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6927d700 1 --2- 172.21.15.29:0/3023653905 >> v2:172.21.15.183:3300/0 conn(0x7fbb6415a680 0x7fbb640cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6927d700 1 -- 172.21.15.29:0/3023653905 >> v1:172.21.15.183:6789/0 conn(0x7fbb6415a2b0 legacy=0x7fbb640b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6927d700 1 -- 172.21.15.29:0/3023653905 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640c6340 con 0x7fbb640d1c30 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6a27f700 1 --2- 172.21.15.29:0/3023653905 >> v2:172.21.15.183:3300/0 conn(0x7fbb6415a680 0x7fbb640cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb6927d700 1 --2- 172.21.15.29:0/3023653905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb640d1c30 0x7fbb640ccdd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbb64064970 tx=0x7fbb58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7aa3b6b53a04b39 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb68a7c700 1 -- 172.21.15.29:0/3023653905 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800b820 con 0x7fbb640d1c30 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb68a7c700 1 -- 172.21.15.29:0/3023653905 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800b980 con 0x7fbb640d1c30 2023-10-08T15:41:29.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.556+0000 7fbb68a7c700 1 -- 172.21.15.29:0/3023653905 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800bd20 con 0x7fbb640d1c30 2023-10-08T15:41:29.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.557+0000 7fbb6bce2700 1 -- 172.21.15.29:0/3023653905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb640d1c30 msgr2=0x7fbb640ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.557+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/3023653905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb640d1c30 0x7fbb640ccdd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbb64064970 tx=0x7fbb58009250 comp rx=0 tx=0).stop 2023-10-08T15:41:29.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.557+0000 7fbb6bce2700 1 -- 172.21.15.29:0/3023653905 shutdown_connections 2023-10-08T15:41:29.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.557+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/3023653905 >> v2:172.21.15.183:3300/0 conn(0x7fbb6415a680 0x7fbb640cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.557+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/3023653905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb640d1c30 0x7fbb640ccdd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.557+0000 7fbb6bce2700 1 -- 172.21.15.29:0/3023653905 >> 172.21.15.29:0/3023653905 conn(0x7fbb64067e40 msgr2=0x7fbb640d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:29.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.557+0000 7fbb6bce2700 1 -- 172.21.15.29:0/3023653905 shutdown_connections 2023-10-08T15:41:29.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.557+0000 7fbb6bce2700 1 -- 172.21.15.29:0/3023653905 wait complete. 2023-10-08T15:41:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.558+0000 7fbb6bce2700 1 Processor -- start 2023-10-08T15:41:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.558+0000 7fbb6bce2700 1 -- start start 2023-10-08T15:41:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6bce2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb640d1c30 0x7fbb6415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6bce2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6415a2b0 0x7fbb64158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6bce2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb6415a680 0x7fbb640c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6bce2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb640c8d80 con 0x7fbb6415a680 2023-10-08T15:41:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6bce2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb640c9060 con 0x7fbb640d1c30 2023-10-08T15:41:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6bce2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb640c9340 con 0x7fbb6415a2b0 2023-10-08T15:41:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb6415a680 0x7fbb640c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb6415a680 0x7fbb640c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54274/0 (socket says 172.21.15.29:54274) 2023-10-08T15:41:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 -- 172.21.15.29:0/56976017 learned_addr learned my addr 172.21.15.29:0/56976017 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:29.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb69a7e700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb640d1c30 0x7fbb6415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6927d700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6415a2b0 0x7fbb64158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 -- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6415a2b0 msgr2=0x7fbb64158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6415a2b0 0x7fbb64158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 -- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb640d1c30 msgr2=0x7fbb6415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb640d1c30 0x7fbb6415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 -- 172.21.15.29:0/56976017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580094f0 con 0x7fbb6415a680 2023-10-08T15:41:29.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb6a27f700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb6415a680 0x7fbb640c9b40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400cef0 tx=0x7fbb54007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb61ffb700 1 -- 172.21.15.29:0/56976017 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400ad20 con 0x7fbb6415a680 2023-10-08T15:41:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.559+0000 7fbb61ffb700 1 -- 172.21.15.29:0/56976017 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb54016420 con 0x7fbb6415a680 2023-10-08T15:41:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.560+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb640c9620 con 0x7fbb6415a680 2023-10-08T15:41:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.560+0000 7fbb61ffb700 1 -- 172.21.15.29:0/56976017 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400aea0 con 0x7fbb6415a680 2023-10-08T15:41:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.560+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6415afe0 con 0x7fbb6415a680 2023-10-08T15:41:29.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.561+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb640c9860 con 0x7fbb6415a680 2023-10-08T15:41:29.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.561+0000 7fbb61ffb700 1 -- 172.21.15.29:0/56976017 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb54016a70 con 0x7fbb6415a680 2023-10-08T15:41:29.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.561+0000 7fbb61ffb700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbb50066f30 0x7fbb500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.562+0000 7fbb61ffb700 1 -- 172.21.15.29:0/56976017 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb54012070 con 0x7fbb6415a680 2023-10-08T15:41:29.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.562+0000 7fbb69a7e700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbb50066f30 0x7fbb500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.562+0000 7fbb69a7e700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbb50066f30 0x7fbb500693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c006fd0 tx=0x7fbb5c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.566+0000 7fbb61ffb700 1 -- 172.21.15.29:0/56976017 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb5404e5a0 con 0x7fbb6415a680 2023-10-08T15:41:29.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.803+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbb6404c3c0 con 0x7fbb6415a680 2023-10-08T15:41:29.804 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-08T15:41:29.804+0000 7f3b39a11700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T15:41:29.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.808+0000 7fbb61ffb700 1 -- 172.21.15.29:0/56976017 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbb54051fc0 con 0x7fbb6415a680 2023-10-08T15:41:29.809 INFO:tasks.ceph.mds.c.smithi029.stderr: -4543> 2023-10-08T15:41:04.764+0000 7f1106e4c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-08T15:41:29.810 INFO:tasks.ceph.mds.c.smithi029.stderr: -3350> 2023-10-08T15:41:16.629+0000 7f1100e40700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:41:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbb50066f30 msgr2=0x7fbb500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbb50066f30 0x7fbb500693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c006fd0 tx=0x7fbb5c009060 comp rx=0 tx=0).stop 2023-10-08T15:41:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb6415a680 msgr2=0x7fbb640c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb6415a680 0x7fbb640c9b40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400cef0 tx=0x7fbb54007860 comp rx=0 tx=0).stop 2023-10-08T15:41:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 shutdown_connections 2023-10-08T15:41:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbb50066f30 0x7fbb500693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbb6415a680 0x7fbb640c9b40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb640d1c30 0x7fbb6415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 --2- 172.21.15.29:0/56976017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6415a2b0 0x7fbb64158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 >> 172.21.15.29:0/56976017 conn(0x7fbb64067e40 msgr2=0x7fbb64068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:29.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 shutdown_connections 2023-10-08T15:41:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.811+0000 7fbb6bce2700 1 -- 172.21.15.29:0/56976017 wait complete. 2023-10-08T15:41:29.814 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T15:41:29.824 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T15:41:29.835 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-08T15:41:29.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.945+0000 7f2c9d799700 1 Processor -- start 2023-10-08T15:41:29.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.945+0000 7f2c9d799700 1 -- start start 2023-10-08T15:41:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9d799700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2c98159e80 0x7f2c980b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9d799700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c980b1300 0x7f2c980b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9d799700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c980b6b10 con 0x7f2c980aada0 2023-10-08T15:41:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9d799700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980b50a0 con 0x7f2c980b1300 2023-10-08T15:41:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9d799700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980b0e70 con 0x7f2c98159e80 2023-10-08T15:41:29.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9cf98700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c980b1300 0x7f2c980b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c977fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2c980aada0 0x7f2c980ab240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39152/0 (socket says 172.21.15.29:39152) 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c977fe700 1 -- 172.21.15.29:0/1465182510 learned_addr learned my addr 172.21.15.29:0/1465182510 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c97fff700 1 --2- 172.21.15.29:0/1465182510 >> v2:172.21.15.183:3300/0 conn(0x7f2c98159e80 0x7f2c980b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9cf98700 1 -- 172.21.15.29:0/1465182510 >> v2:172.21.15.183:3300/0 conn(0x7f2c98159e80 msgr2=0x7f2c980b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9cf98700 1 --2- 172.21.15.29:0/1465182510 >> v2:172.21.15.183:3300/0 conn(0x7f2c98159e80 0x7f2c980b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c9cf98700 1 -- 172.21.15.29:0/1465182510 >> v1:172.21.15.29:6789/0 conn(0x7f2c980aada0 legacy=0x7f2c980ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.946+0000 7f2c96ffd700 1 -- 172.21.15.29:0/1465182510 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809974689 0 0) 0x7f2c980b6b10 con 0x7f2c980aada0 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9cf98700 1 -- 172.21.15.29:0/1465182510 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c980b52c0 con 0x7f2c980b1300 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9cf98700 1 --2- 172.21.15.29:0/1465182510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c980b1300 0x7f2c980b1750 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2c9808a5c0 tx=0x7f2c90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c850cf5b417adf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c96ffd700 1 -- 172.21.15.29:0/1465182510 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000e070 con 0x7f2c980b1300 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c96ffd700 1 -- 172.21.15.29:0/1465182510 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000bc30 con 0x7f2c980b1300 2023-10-08T15:41:29.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c96ffd700 1 -- 172.21.15.29:0/1465182510 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90012430 con 0x7f2c980b1300 2023-10-08T15:41:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9d799700 1 -- 172.21.15.29:0/1465182510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c980b1300 msgr2=0x7f2c980b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9d799700 1 --2- 172.21.15.29:0/1465182510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c980b1300 0x7f2c980b1750 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2c9808a5c0 tx=0x7f2c90009780 comp rx=0 tx=0).stop 2023-10-08T15:41:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9d799700 1 -- 172.21.15.29:0/1465182510 shutdown_connections 2023-10-08T15:41:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9d799700 1 --2- 172.21.15.29:0/1465182510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c980b1300 0x7f2c980b1750 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9d799700 1 --2- 172.21.15.29:0/1465182510 >> v2:172.21.15.183:3300/0 conn(0x7f2c98159e80 0x7f2c980b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9d799700 1 -- 172.21.15.29:0/1465182510 >> 172.21.15.29:0/1465182510 conn(0x7f2c98099f50 msgr2=0x7f2c98067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9d799700 1 -- 172.21.15.29:0/1465182510 shutdown_connections 2023-10-08T15:41:29.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.947+0000 7f2c9d799700 1 -- 172.21.15.29:0/1465182510 wait complete. 2023-10-08T15:41:29.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.948+0000 7f2c9d799700 1 Processor -- start 2023-10-08T15:41:29.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.949+0000 7f2c9d799700 1 -- start start 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.949+0000 7f2c9d799700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c980aada0 0x7f2c98153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.949+0000 7f2c9d799700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c980b1300 0x7f2c980cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.949+0000 7f2c9d799700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98159e80 0x7f2c98152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.949+0000 7f2c9d799700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980cfe10 con 0x7f2c98159e80 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.949+0000 7f2c9d799700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9815f140 con 0x7f2c980aada0 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.949+0000 7f2c9d799700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9816d6c0 con 0x7f2c980b1300 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.949+0000 7f2c9cf98700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98159e80 0x7f2c98152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9cf98700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98159e80 0x7f2c98152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54310/0 (socket says 172.21.15.29:54310) 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9cf98700 1 -- 172.21.15.29:0/2119618485 learned_addr learned my addr 172.21.15.29:0/2119618485 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c97fff700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c980aada0 0x7f2c98153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c977fe700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c980b1300 0x7f2c980cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9cf98700 1 -- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c980b1300 msgr2=0x7f2c980cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9cf98700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c980b1300 0x7f2c980cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9cf98700 1 -- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c980aada0 msgr2=0x7f2c98153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9cf98700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c980aada0 0x7f2c98153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9cf98700 1 -- 172.21.15.29:0/2119618485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90009a20 con 0x7f2c98159e80 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9cf98700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98159e80 0x7f2c98152010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2c98089cb0 tx=0x7f2c90019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c7ffff700 1 -- 172.21.15.29:0/2119618485 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9001d630 con 0x7f2c98159e80 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c7ffff700 1 -- 172.21.15.29:0/2119618485 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9001d790 con 0x7f2c98159e80 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9816d9a0 con 0x7f2c98159e80 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c7ffff700 1 -- 172.21.15.29:0/2119618485 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9001db50 con 0x7f2c98159e80 2023-10-08T15:41:29.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.950+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9816df60 con 0x7f2c98159e80 2023-10-08T15:41:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.951+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c98089110 con 0x7f2c98159e80 2023-10-08T15:41:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.952+0000 7f2c7ffff700 1 -- 172.21.15.29:0/2119618485 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c90024070 con 0x7f2c98159e80 2023-10-08T15:41:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.952+0000 7f2c7ffff700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2c84066f30 0x7f2c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.952+0000 7f2c7ffff700 1 -- 172.21.15.29:0/2119618485 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2c90086f50 con 0x7f2c98159e80 2023-10-08T15:41:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.952+0000 7f2c97fff700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2c84066f30 0x7f2c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:29.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.953+0000 7f2c97fff700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2c84066f30 0x7f2c840693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0089b0 tx=0x7f2c8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:29.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:29.956+0000 7f2c7ffff700 1 -- 172.21.15.29:0/2119618485 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c90054170 con 0x7f2c98159e80 2023-10-08T15:41:30.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.193+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2c980b0310 con 0x7f2c98159e80 2023-10-08T15:41:30.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.810+0000 7f2c7ffff700 1 -- 172.21.15.29:0/2119618485 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2c90057790 con 0x7f2c98159e80 2023-10-08T15:41:30.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2c84066f30 msgr2=0x7f2c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:30.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2c84066f30 0x7f2c840693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0089b0 tx=0x7f2c8c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:30.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98159e80 msgr2=0x7f2c98152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:30.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98159e80 0x7f2c98152010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2c98089cb0 tx=0x7f2c90019000 comp rx=0 tx=0).stop 2023-10-08T15:41:30.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 shutdown_connections 2023-10-08T15:41:30.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2c84066f30 0x7f2c840693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:30.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c98159e80 0x7f2c98152010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:30.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c980aada0 0x7f2c98153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:30.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 --2- 172.21.15.29:0/2119618485 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c980b1300 0x7f2c980cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:30.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 >> 172.21.15.29:0/2119618485 conn(0x7f2c98099f50 msgr2=0x7f2c9815ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:30.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.812+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 shutdown_connections 2023-10-08T15:41:30.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.813+0000 7f2c9d799700 1 -- 172.21.15.29:0/2119618485 wait complete. 2023-10-08T15:41:30.826 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T15:41:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.992+0000 7f44541ab700 1 Processor -- start 2023-10-08T15:41:30.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.993+0000 7f44541ab700 1 -- start start 2023-10-08T15:41:30.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.993+0000 7f44541ab700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f444c0af8f0 0x7f444c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.993+0000 7f44541ab700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c0c6f20 con 0x7f444c06dad0 2023-10-08T15:41:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.993+0000 7f44541ab700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c0c7200 con 0x7f444c156210 2023-10-08T15:41:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.993+0000 7f44541ab700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c0c74e0 con 0x7f444c0af8f0 2023-10-08T15:41:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4452748700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f444c06dad0 0x7f444c0cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39156/0 (socket says 172.21.15.29:39156) 2023-10-08T15:41:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4452748700 1 -- 172.21.15.29:0/464837599 learned_addr learned my addr 172.21.15.29:0/464837599 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994016526 0 0) 0x7f444c0c6f20 con 0x7f444c06dad0 2023-10-08T15:41:31.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4451746700 1 --2- 172.21.15.29:0/464837599 >> v2:172.21.15.183:3300/0 conn(0x7f444c0af8f0 0x7f444c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4434003570 con 0x7f444c06dad0 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2074396612 0 0) 0x7f4434003570 con 0x7f444c06dad0 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 >> v2:172.21.15.183:3300/0 conn(0x7f444c0af8f0 msgr2=0x7f444c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 --2- 172.21.15.29:0/464837599 >> v2:172.21.15.183:3300/0 conn(0x7f444c0af8f0 0x7f444c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 >> v1:172.21.15.183:6789/0 conn(0x7f444c156210 legacy=0x7f444c06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0c77c0 con 0x7f444c06dad0 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f443c001470 con 0x7f444c06dad0 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 >> v1:172.21.15.29:6789/0 conn(0x7f444c06dad0 legacy=0x7f444c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4434003a60 0x7f4434003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4434004810 0x7f4434004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44340052e0 0x7f443400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0c74e0 con 0x7f4434003a60 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443400d3b0 con 0x7f4434004810 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443400d570 con 0x7f44340052e0 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4451f47700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4434003a60 0x7f4434003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.994+0000 7f4451746700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4434004810 0x7f4434004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4452748700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44340052e0 0x7f443400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4451f47700 1 -- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44340052e0 msgr2=0x7f443400cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:31.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4451f47700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44340052e0 0x7f443400cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4451f47700 1 -- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4434004810 msgr2=0x7f4434004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4451f47700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4434004810 0x7f4434004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4451f47700 1 -- 172.21.15.29:0/464837599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4434003570 con 0x7f4434003a60 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4451746700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4434004810 0x7f4434004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4452748700 1 -- 172.21.15.29:0/464837599 reap_dead start 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4451f47700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4434003a60 0x7f4434003e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4444001fc0 tx=0x7f4444001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1514daf5c4138463 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444001950 con 0x7f4434003a60 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444400c8b0 con 0x7f4434003a60 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f4450f45700 1 -- 172.21.15.29:0/464837599 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444400cc50 con 0x7f4434003a60 2023-10-08T15:41:31.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.995+0000 7f44541ab700 1 -- 172.21.15.29:0/464837599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4434003a60 msgr2=0x7f4434003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.996+0000 7f44541ab700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4434003a60 0x7f4434003e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4444001fc0 tx=0x7f4444001640 comp rx=0 tx=0).stop 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.996+0000 7f44541ab700 1 -- 172.21.15.29:0/464837599 shutdown_connections 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.996+0000 7f44541ab700 1 --2- 172.21.15.29:0/464837599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4434003a60 0x7f4434003e70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.996+0000 7f44541ab700 1 -- 172.21.15.29:0/464837599 >> 172.21.15.29:0/464837599 conn(0x7f444c0cd450 msgr2=0x7f444c0c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.996+0000 7f44541ab700 1 -- 172.21.15.29:0/464837599 shutdown_connections 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.996+0000 7f44541ab700 1 -- 172.21.15.29:0/464837599 wait complete. 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.997+0000 7f44541ab700 1 Processor -- start 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.997+0000 7f44541ab700 1 -- start start 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.997+0000 7f44541ab700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4434003a60 0x7f444c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.997+0000 7f44541ab700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444c1565e0 0x7f444c0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.997+0000 7f44541ab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f444c14a360 0x7f444c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.997+0000 7f44541ab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c14c100 con 0x7f444c14a360 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.997+0000 7f44541ab700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0ac9b0 con 0x7f444c1565e0 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.997+0000 7f44541ab700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0ae5b0 con 0x7f4434003a60 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f444c14a360 0x7f444c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f444c14a360 0x7f444c0b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54326/0 (socket says 172.21.15.29:54326) 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 -- 172.21.15.29:0/439605872 learned_addr learned my addr 172.21.15.29:0/439605872 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4451f47700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4434003a60 0x7f444c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4451746700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444c1565e0 0x7f444c0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 -- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4434003a60 msgr2=0x7f444c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4434003a60 0x7f444c0aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 -- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444c1565e0 msgr2=0x7f444c0ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444c1565e0 0x7f444c0ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 -- 172.21.15.29:0/439605872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0ae890 con 0x7f444c14a360 2023-10-08T15:41:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4452748700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f444c14a360 0x7f444c0b1250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f443c000c00 tx=0x7f443c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4449ffb700 1 -- 172.21.15.29:0/439605872 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c010520 con 0x7f444c14a360 2023-10-08T15:41:31.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4449ffb700 1 -- 172.21.15.29:0/439605872 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c010680 con 0x7f444c14a360 2023-10-08T15:41:31.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c0aeb70 con 0x7f444c14a360 2023-10-08T15:41:31.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f4449ffb700 1 -- 172.21.15.29:0/439605872 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c010a40 con 0x7f444c14a360 2023-10-08T15:41:31.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:30.998+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c156a50 con 0x7f444c14a360 2023-10-08T15:41:31.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.000+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c14c270 con 0x7f444c14a360 2023-10-08T15:41:31.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.000+0000 7f4449ffb700 1 -- 172.21.15.29:0/439605872 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f443c0133e0 con 0x7f444c14a360 2023-10-08T15:41:31.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.000+0000 7f4449ffb700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4438066fb0 0x7f4438069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.000+0000 7f4449ffb700 1 -- 172.21.15.29:0/439605872 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f443c083d30 con 0x7f444c14a360 2023-10-08T15:41:31.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.000+0000 7f4451f47700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4438066fb0 0x7f4438069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.001+0000 7f4451f47700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4438066fb0 0x7f4438069460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4444001390 tx=0x7f4444015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:31.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.005+0000 7f4449ffb700 1 -- 172.21.15.29:0/439605872 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f443c050eb0 con 0x7f444c14a360 2023-10-08T15:41:31.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.197+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f444c04c3c0 con 0x7f444c14a360 2023-10-08T15:41:31.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.813+0000 7f4449ffb700 1 -- 172.21.15.29:0/439605872 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f443c019070 con 0x7f444c14a360 2023-10-08T15:41:31.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4438066fb0 msgr2=0x7f4438069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4438066fb0 0x7f4438069460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4444001390 tx=0x7f4444015000 comp rx=0 tx=0).stop 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f444c14a360 msgr2=0x7f444c0b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f444c14a360 0x7f444c0b1250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f443c000c00 tx=0x7f443c000ed0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 shutdown_connections 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4438066fb0 0x7f4438069460 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f444c14a360 0x7f444c0b1250 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4434003a60 0x7f444c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 --2- 172.21.15.29:0/439605872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f444c1565e0 0x7f444c0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 >> 172.21.15.29:0/439605872 conn(0x7f444c0cd450 msgr2=0x7f444c06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:31.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 shutdown_connections 2023-10-08T15:41:31.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.816+0000 7f44541ab700 1 -- 172.21.15.29:0/439605872 wait complete. 2023-10-08T15:41:31.819 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-08T15:41:31.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.967+0000 7fe7a6d24700 1 Processor -- start 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.967+0000 7fe7a6d24700 1 -- start start 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a6d24700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7a015d240 0x7fe7a00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a6d24700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a00cc940 0x7fe7a00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a6d24700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a00b3f40 con 0x7fe7a00c59e0 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a6d24700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a00cbb80 con 0x7fe7a015d240 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a6d24700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00cbe60 con 0x7fe7a00cc940 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a5d22700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7a015d240 0x7fe7a00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a5d22700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7a015d240 0x7fe7a00b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54334/0 (socket says 172.21.15.29:54334) 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a5d22700 1 -- 172.21.15.29:0/4127852127 learned_addr learned my addr 172.21.15.29:0/4127852127 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.968+0000 7fe7a5521700 1 --2- 172.21.15.29:0/4127852127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a00cc940 0x7fe7a00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a5d22700 1 -- 172.21.15.29:0/4127852127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a00cc940 msgr2=0x7fe7a00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a5d22700 1 --2- 172.21.15.29:0/4127852127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a00cc940 0x7fe7a00ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a5d22700 1 -- 172.21.15.29:0/4127852127 >> v1:172.21.15.183:6789/0 conn(0x7fe7a00c59e0 legacy=0x7fe7a00c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a5d22700 1 -- 172.21.15.29:0/4127852127 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00cc140 con 0x7fe7a015d240 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a5d22700 1 --2- 172.21.15.29:0/4127852127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a015d240 0x7fe7a00b3a00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe790009f70 tx=0x7fe790009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76e8d3bd83df4d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a4d20700 1 -- 172.21.15.29:0/4127852127 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79000e070 con 0x7fe7a015d240 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a4d20700 1 -- 172.21.15.29:0/4127852127 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79000bad0 con 0x7fe7a015d240 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a4d20700 1 -- 172.21.15.29:0/4127852127 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900092e0 con 0x7fe7a015d240 2023-10-08T15:41:31.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a6d24700 1 -- 172.21.15.29:0/4127852127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a015d240 msgr2=0x7fe7a00b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/4127852127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a015d240 0x7fe7a00b3a00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe790009f70 tx=0x7fe790009840 comp rx=0 tx=0).stop 2023-10-08T15:41:31.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a6d24700 1 -- 172.21.15.29:0/4127852127 shutdown_connections 2023-10-08T15:41:31.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/4127852127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a015d240 0x7fe7a00b3a00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/4127852127 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a00cc940 0x7fe7a00ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a6d24700 1 -- 172.21.15.29:0/4127852127 >> 172.21.15.29:0/4127852127 conn(0x7fe7a0067e40 msgr2=0x7fe7a00d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:31.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a6d24700 1 -- 172.21.15.29:0/4127852127 shutdown_connections 2023-10-08T15:41:31.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.969+0000 7fe7a6d24700 1 -- 172.21.15.29:0/4127852127 wait complete. 2023-10-08T15:41:31.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a6d24700 1 Processor -- start 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a6d24700 1 -- start start 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a6d24700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7a00c59e0 0x7fe7a0155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a6d24700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a00cc940 0x7fe7a015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a6d24700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a015d240 0x7fe7a015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a6d24700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a015aa30 con 0x7fe7a00cc940 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a6d24700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0159e20 con 0x7fe7a00c59e0 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a6d24700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a015a100 con 0x7fe7a015d240 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a5521700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a00cc940 0x7fe7a015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a5521700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a00cc940 0x7fe7a015c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54348/0 (socket says 172.21.15.29:54348) 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.971+0000 7fe7a5521700 1 -- 172.21.15.29:0/3004750535 learned_addr learned my addr 172.21.15.29:0/3004750535 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:31.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a5d22700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7a00c59e0 0x7fe7a0155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a6523700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a015d240 0x7fe7a015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a5521700 1 -- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a015d240 msgr2=0x7fe7a015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a5521700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a015d240 0x7fe7a015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a5521700 1 -- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7a00c59e0 msgr2=0x7fe7a0155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a5521700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7a00c59e0 0x7fe7a0155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a5521700 1 -- 172.21.15.29:0/3004750535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790009ae0 con 0x7fe7a00cc940 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a5521700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a00cc940 0x7fe7a015c110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe79400d860 tx=0x7fe794008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe79dffb700 1 -- 172.21.15.29:0/3004750535 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7940125f0 con 0x7fe7a00cc940 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe79dffb700 1 -- 172.21.15.29:0/3004750535 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794012770 con 0x7fe7a00cc940 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe79dffb700 1 -- 172.21.15.29:0/3004750535 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794012b30 con 0x7fe7a00cc940 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a015a3e0 con 0x7fe7a00cc940 2023-10-08T15:41:31.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.972+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a01562e0 con 0x7fe7a00cc940 2023-10-08T15:41:31.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.973+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a015abe0 con 0x7fe7a00cc940 2023-10-08T15:41:31.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.974+0000 7fe79dffb700 1 -- 172.21.15.29:0/3004750535 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe794013480 con 0x7fe7a00cc940 2023-10-08T15:41:31.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.974+0000 7fe79dffb700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe78c066f30 0x7fe78c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:31.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.974+0000 7fe79dffb700 1 -- 172.21.15.29:0/3004750535 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fe794084750 con 0x7fe7a00cc940 2023-10-08T15:41:31.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.974+0000 7fe7a5d22700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe78c066f30 0x7fe78c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:31.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.975+0000 7fe7a5d22700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe78c066f30 0x7fe78c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe790009880 tx=0x7fe790018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:31.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:31.979+0000 7fe79dffb700 1 -- 172.21.15.29:0/3004750535 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7a015abe0 con 0x7fe7a00cc940 2023-10-08T15:41:32.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.170+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe7a006ac60 con 0x7fe7a00cc940 2023-10-08T15:41:32.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.817+0000 7fe79dffb700 1 -- 172.21.15.29:0/3004750535 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe7940555b0 con 0x7fe7a00cc940 2023-10-08T15:41:32.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.819+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe78c066f30 msgr2=0x7fe78c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.819+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe78c066f30 0x7fe78c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe790009880 tx=0x7fe790018000 comp rx=0 tx=0).stop 2023-10-08T15:41:32.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.819+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a00cc940 msgr2=0x7fe7a015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.819+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a00cc940 0x7fe7a015c110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe79400d860 tx=0x7fe794008040 comp rx=0 tx=0).stop 2023-10-08T15:41:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.820+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 shutdown_connections 2023-10-08T15:41:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.820+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe78c066f30 0x7fe78c0693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.820+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7a015d240 0x7fe7a015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.820+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7a00c59e0 0x7fe7a0155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.820+0000 7fe7a6d24700 1 --2- 172.21.15.29:0/3004750535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7a00cc940 0x7fe7a015c110 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.820+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 >> 172.21.15.29:0/3004750535 conn(0x7fe7a0067e40 msgr2=0x7fe7a00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.820+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 shutdown_connections 2023-10-08T15:41:32.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.820+0000 7fe7a6d24700 1 -- 172.21.15.29:0/3004750535 wait complete. 2023-10-08T15:41:32.822 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-08T15:41:32.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T15:41:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.959+0000 7fa6b9771700 1 Processor -- start 2023-10-08T15:41:32.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.959+0000 7fa6b9771700 1 -- start start 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.959+0000 7fa6b9771700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6b40697c0 0x7fa6b415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.959+0000 7fa6b9771700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b415a230 0x7fa6b40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.959+0000 7fa6b9771700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b415ea90 con 0x7fa6b4159e60 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.959+0000 7fa6b9771700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40d1cf0 con 0x7fa6b40697c0 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.959+0000 7fa6b9771700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40b3100 con 0x7fa6b415a230 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6b40697c0 0x7fa6b415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b27fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6b40697c0 0x7fa6b415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54360/0 (socket says 172.21.15.29:54360) 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b27fc700 1 -- 172.21.15.29:0/1632081463 learned_addr learned my addr 172.21.15.29:0/1632081463 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b37fe700 1 --2- 172.21.15.29:0/1632081463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b415a230 0x7fa6b40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b27fc700 1 -- 172.21.15.29:0/1632081463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b415a230 msgr2=0x7fa6b40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b27fc700 1 --2- 172.21.15.29:0/1632081463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b415a230 0x7fa6b40af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b27fc700 1 -- 172.21.15.29:0/1632081463 >> v1:172.21.15.183:6789/0 conn(0x7fa6b4159e60 legacy=0x7fa6b40690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b27fc700 1 -- 172.21.15.29:0/1632081463 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40d10e0 con 0x7fa6b40697c0 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b37fe700 1 --2- 172.21.15.29:0/1632081463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b415a230 0x7fa6b40af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b27fc700 1 --2- 172.21.15.29:0/1632081463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b40697c0 0x7fa6b415e550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0099b0 tx=0x7fa69c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdef0ec6dbe1ce9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b1ffb700 1 -- 172.21.15.29:0/1632081463 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c00b820 con 0x7fa6b40697c0 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b1ffb700 1 -- 172.21.15.29:0/1632081463 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69c00b980 con 0x7fa6b40697c0 2023-10-08T15:41:32.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.960+0000 7fa6b1ffb700 1 -- 172.21.15.29:0/1632081463 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c00bd20 con 0x7fa6b40697c0 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.961+0000 7fa6b9771700 1 -- 172.21.15.29:0/1632081463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b40697c0 msgr2=0x7fa6b415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.961+0000 7fa6b9771700 1 --2- 172.21.15.29:0/1632081463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b40697c0 0x7fa6b415e550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0099b0 tx=0x7fa69c009250 comp rx=0 tx=0).stop 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.961+0000 7fa6b9771700 1 -- 172.21.15.29:0/1632081463 shutdown_connections 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.961+0000 7fa6b9771700 1 --2- 172.21.15.29:0/1632081463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b415a230 0x7fa6b40af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.961+0000 7fa6b9771700 1 --2- 172.21.15.29:0/1632081463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b40697c0 0x7fa6b415e550 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.961+0000 7fa6b9771700 1 -- 172.21.15.29:0/1632081463 >> 172.21.15.29:0/1632081463 conn(0x7fa6b4070700 msgr2=0x7fa6b4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.961+0000 7fa6b9771700 1 -- 172.21.15.29:0/1632081463 shutdown_connections 2023-10-08T15:41:32.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.961+0000 7fa6b9771700 1 -- 172.21.15.29:0/1632081463 wait complete. 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.962+0000 7fa6b9771700 1 Processor -- start 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.962+0000 7fa6b9771700 1 -- start start 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b9771700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b40697c0 0x7fa6b40c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b9771700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b4159e60 0x7fa6b416a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b9771700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b415a230 0x7fa6b415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b9771700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40c4f30 con 0x7fa6b4159e60 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b9771700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40c5210 con 0x7fa6b415a230 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b9771700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40c54f0 con 0x7fa6b40697c0 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b27fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b4159e60 0x7fa6b416a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b27fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b4159e60 0x7fa6b416a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54370/0 (socket says 172.21.15.29:54370) 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b27fc700 1 -- 172.21.15.29:0/4124520639 learned_addr learned my addr 172.21.15.29:0/4124520639 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b2ffd700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b40697c0 0x7fa6b40c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b37fe700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b415a230 0x7fa6b415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b27fc700 1 -- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b40697c0 msgr2=0x7fa6b40c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b27fc700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b40697c0 0x7fa6b40c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b27fc700 1 -- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b415a230 msgr2=0x7fa6b415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b27fc700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b415a230 0x7fa6b415bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.963+0000 7fa6b27fc700 1 -- 172.21.15.29:0/4124520639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c0094f0 con 0x7fa6b4159e60 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.964+0000 7fa6b27fc700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b4159e60 0x7fa6b416a890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009290 tx=0x7fa69c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.964+0000 7fa6aaffd700 1 -- 172.21.15.29:0/4124520639 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c011c10 con 0x7fa6b4159e60 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.964+0000 7fa6aaffd700 1 -- 172.21.15.29:0/4124520639 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69c020070 con 0x7fa6b4159e60 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.964+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b40c57d0 con 0x7fa6b4159e60 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.964+0000 7fa6aaffd700 1 -- 172.21.15.29:0/4124520639 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c01b450 con 0x7fa6b4159e60 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.964+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b40c4c20 con 0x7fa6b4159e60 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.965+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b404c3c0 con 0x7fa6b4159e60 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.965+0000 7fa6aaffd700 1 -- 172.21.15.29:0/4124520639 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa69c022030 con 0x7fa6b4159e60 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.965+0000 7fa6aaffd700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa694066f30 0x7fa6940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:32.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.966+0000 7fa6aaffd700 1 -- 172.21.15.29:0/4124520639 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa69c0860a0 con 0x7fa6b4159e60 2023-10-08T15:41:32.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.966+0000 7fa6b2ffd700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa694066f30 0x7fa6940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:32.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.966+0000 7fa6b2ffd700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa694066f30 0x7fa6940693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4007fd0 tx=0x7fa6a40026a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:32.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:32.970+0000 7fa6aaffd700 1 -- 172.21.15.29:0/4124520639 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa69c053610 con 0x7fa6b4159e60 2023-10-08T15:41:33.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.161+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa6b404c3c0 con 0x7fa6b4159e60 2023-10-08T15:41:33.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.165+0000 7fa6aaffd700 1 -- 172.21.15.29:0/4124520639 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa69c009350 con 0x7fa6b4159e60 2023-10-08T15:41:33.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa694066f30 msgr2=0x7fa6940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa694066f30 0x7fa6940693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4007fd0 tx=0x7fa6a40026a0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b4159e60 msgr2=0x7fa6b416a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b4159e60 0x7fa6b416a890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009290 tx=0x7fa69c016000 comp rx=0 tx=0).stop 2023-10-08T15:41:33.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 shutdown_connections 2023-10-08T15:41:33.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa694066f30 0x7fa6940693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa6b415a230 0x7fa6b415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6b40697c0 0x7fa6b40c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 --2- 172.21.15.29:0/4124520639 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6b4159e60 0x7fa6b416a890 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 >> 172.21.15.29:0/4124520639 conn(0x7fa6b4070700 msgr2=0x7fa6b40afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 shutdown_connections 2023-10-08T15:41:33.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.167+0000 7fa6b9771700 1 -- 172.21.15.29:0/4124520639 wait complete. 2023-10-08T15:41:33.179 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-08T15:41:33.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.298+0000 7f851d083700 1 Processor -- start 2023-10-08T15:41:33.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.298+0000 7f851d083700 1 -- start start 2023-10-08T15:41:33.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.299+0000 7f851d083700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f851815a620 0x7f851815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.299+0000 7f851d083700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f851815d580 0x7f8518158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.299+0000 7f851d083700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851815cbb0 con 0x7f8518157870 2023-10-08T15:41:33.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.299+0000 7f851d083700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851815bdb0 con 0x7f851815d580 2023-10-08T15:41:33.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.299+0000 7f851d083700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851815bfa0 con 0x7f851815a620 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.299+0000 7f8516d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8518157870 0x7f851815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39168/0 (socket says 172.21.15.29:39168) 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.299+0000 7f8516d9d700 1 -- 172.21.15.29:0/2164738112 learned_addr learned my addr 172.21.15.29:0/2164738112 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209308528 0 0) 0x7f851815cbb0 con 0x7f8518157870 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851659c700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f851815a620 0x7f851815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851759e700 1 --2- 172.21.15.29:0/2164738112 >> v2:172.21.15.183:3300/0 conn(0x7f851815d580 0x7f8518158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8504003570 con 0x7f8518157870 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729276371 0 0) 0x7f8504003570 con 0x7f8518157870 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f851815a620 msgr2=0x7f851815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f851815a620 0x7f851815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 >> v2:172.21.15.183:3300/0 conn(0x7f851815d580 msgr2=0x7f8518158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 --2- 172.21.15.29:0/2164738112 >> v2:172.21.15.183:3300/0 conn(0x7f851815d580 0x7f8518158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851815c280 con 0x7f8518157870 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f85080017f0 con 0x7f8518157870 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 >> v1:172.21.15.29:6789/0 conn(0x7f8518157870 legacy=0x7f851815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8504003a60 0x7f8504003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f851815a620 0x7f8504004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8504004d50 0x7f85040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851815bfa0 con 0x7f8504004d50 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850400ba60 con 0x7f8504003a60 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850400bba0 con 0x7f851815a620 2023-10-08T15:41:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851759e700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8504004d50 0x7f85040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8516d9d700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8504003a60 0x7f8504003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851659c700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f851815a620 0x7f8504004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851759e700 1 -- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f851815a620 msgr2=0x7f8504004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851759e700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f851815a620 0x7f8504004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851759e700 1 -- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8504003a60 msgr2=0x7f8504003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851759e700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8504003a60 0x7f8504003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f851759e700 1 -- 172.21.15.29:0/2164738112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8504003570 con 0x7f8504004d50 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.300+0000 7f8516d9d700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8504003a60 0x7f8504003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f851759e700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8504004d50 0x7f85040051c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f851815d9e0 tx=0x7f85100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a2ce8c10c3bd80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000e6b0 con 0x7f8504004d50 2023-10-08T15:41:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851000e810 con 0x7f8504004d50 2023-10-08T15:41:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f8515d9b700 1 -- 172.21.15.29:0/2164738112 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000ebd0 con 0x7f8504004d50 2023-10-08T15:41:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f851d083700 1 -- 172.21.15.29:0/2164738112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8504004d50 msgr2=0x7f85040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f851d083700 1 --2- 172.21.15.29:0/2164738112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8504004d50 0x7f85040051c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f851815d9e0 tx=0x7f85100091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f851759e700 1 -- 172.21.15.29:0/2164738112 reap_dead start 2023-10-08T15:41:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f851d083700 1 -- 172.21.15.29:0/2164738112 shutdown_connections 2023-10-08T15:41:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f851d083700 1 -- 172.21.15.29:0/2164738112 >> 172.21.15.29:0/2164738112 conn(0x7f8518068ce0 msgr2=0x7f85180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f851d083700 1 -- 172.21.15.29:0/2164738112 shutdown_connections 2023-10-08T15:41:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.301+0000 7f851d083700 1 -- 172.21.15.29:0/2164738112 wait complete. 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851d083700 1 Processor -- start 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851d083700 1 -- start start 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851d083700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f851814a9d0 0x7f8518154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851d083700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f851814ada0 0x7f85180b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851d083700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85180b06c0 0x7f85180b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851d083700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180b1080 con 0x7f851814ada0 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851d083700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518159ab0 con 0x7f851814a9d0 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851d083700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85181544e0 con 0x7f85180b06c0 2023-10-08T15:41:33.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f851814ada0 0x7f85180b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f851814ada0 0x7f85180b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54376/0 (socket says 172.21.15.29:54376) 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.303+0000 7f851659c700 1 -- 172.21.15.29:0/63511195 learned_addr learned my addr 172.21.15.29:0/63511195 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f8516d9d700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f851814a9d0 0x7f8518154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851759e700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85180b06c0 0x7f85180b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851659c700 1 -- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85180b06c0 msgr2=0x7f85180b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851659c700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85180b06c0 0x7f85180b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851659c700 1 -- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f851814a9d0 msgr2=0x7f8518154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851659c700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f851814a9d0 0x7f8518154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851659c700 1 -- 172.21.15.29:0/63511195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85181597d0 con 0x7f851814ada0 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851659c700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f851814ada0 0x7f85180b1270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8500011780 tx=0x7f8500008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f850effd700 1 -- 172.21.15.29:0/63511195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500015670 con 0x7f851814ada0 2023-10-08T15:41:33.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f850effd700 1 -- 172.21.15.29:0/63511195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85000157d0 con 0x7f851814ada0 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8518154780 con 0x7f851814ada0 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f850effd700 1 -- 172.21.15.29:0/63511195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500015b90 con 0x7f851814ada0 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.304+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85180b17b0 con 0x7f851814ada0 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.305+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8518160320 con 0x7f851814ada0 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.305+0000 7f850effd700 1 -- 172.21.15.29:0/63511195 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f850001e450 con 0x7f851814ada0 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.306+0000 7f850effd700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f84f8066f30 0x7f84f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.306+0000 7f850effd700 1 -- 172.21.15.29:0/63511195 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8500084510 con 0x7f851814ada0 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.306+0000 7f8516d9d700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f84f8066f30 0x7f84f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.307+0000 7f8516d9d700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f84f8066f30 0x7f84f80693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8508004c10 tx=0x7f850800c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.310+0000 7f850effd700 1 -- 172.21.15.29:0/63511195 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8500051a80 con 0x7f851814ada0 2023-10-08T15:41:33.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.581+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f851804c3c0 con 0x7f851814ada0 2023-10-08T15:41:33.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.817+0000 7f850effd700 1 -- 172.21.15.29:0/63511195 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v83) v1 ==== 130+0+0 (secure 0 0 0) 0x7f85000550a0 con 0x7f851814ada0 2023-10-08T15:41:33.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f84f8066f30 msgr2=0x7f84f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f84f8066f30 0x7f84f80693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8508004c10 tx=0x7f850800c040 comp rx=0 tx=0).stop 2023-10-08T15:41:33.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f851814ada0 msgr2=0x7f85180b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f851814ada0 0x7f85180b1270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8500011780 tx=0x7f8500008040 comp rx=0 tx=0).stop 2023-10-08T15:41:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 shutdown_connections 2023-10-08T15:41:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f84f8066f30 0x7f84f80693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85180b06c0 0x7f85180b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f851814a9d0 0x7f8518154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 --2- 172.21.15.29:0/63511195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f851814ada0 0x7f85180b1270 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 >> 172.21.15.29:0/63511195 conn(0x7f8518068ce0 msgr2=0x7f851815fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 shutdown_connections 2023-10-08T15:41:33.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.820+0000 7f851d083700 1 -- 172.21.15.29:0/63511195 wait complete. 2023-10-08T15:41:33.833 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-08T15:41:33.833 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-08T15:41:33.833 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-08T15:41:33.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.955+0000 7f5cc72d3700 1 Processor -- start 2023-10-08T15:41:33.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.956+0000 7f5cc72d3700 1 -- start start 2023-10-08T15:41:33.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.956+0000 7f5cc72d3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5cc0159e60 0x7f5cc00b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.956+0000 7f5cc72d3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5cc00cffa0 0x7f5cc006a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.956+0000 7f5cc72d3700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00b3d40 con 0x7f5cc015a230 2023-10-08T15:41:33.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.956+0000 7f5cc72d3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc0069d70 con 0x7f5cc0159e60 2023-10-08T15:41:33.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.956+0000 7f5cc72d3700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc00b4300 con 0x7f5cc00cffa0 2023-10-08T15:41:33.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc506f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5cc0159e60 0x7f5cc00b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc506f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5cc0159e60 0x7f5cc00b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54382/0 (socket says 172.21.15.29:54382) 2023-10-08T15:41:33.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc506f700 1 -- 172.21.15.29:0/186480941 learned_addr learned my addr 172.21.15.29:0/186480941 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:33.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc486e700 1 --2- 172.21.15.29:0/186480941 >> v2:172.21.15.183:3300/0 conn(0x7f5cc00cffa0 0x7f5cc006a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc506f700 1 -- 172.21.15.29:0/186480941 >> v2:172.21.15.183:3300/0 conn(0x7f5cc00cffa0 msgr2=0x7f5cc006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc506f700 1 --2- 172.21.15.29:0/186480941 >> v2:172.21.15.183:3300/0 conn(0x7f5cc00cffa0 0x7f5cc006a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc506f700 1 -- 172.21.15.29:0/186480941 >> v1:172.21.15.183:6789/0 conn(0x7f5cc015a230 legacy=0x7f5cc00b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc506f700 1 -- 172.21.15.29:0/186480941 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00d0480 con 0x7f5cc0159e60 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cc506f700 1 --2- 172.21.15.29:0/186480941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc00b6890 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5cc008a2c0 tx=0x7f5cb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6644d4b4c8f252 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cbffff700 1 -- 172.21.15.29:0/186480941 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000b860 con 0x7f5cc0159e60 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cbffff700 1 -- 172.21.15.29:0/186480941 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb000b9c0 con 0x7f5cc0159e60 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.957+0000 7f5cbffff700 1 -- 172.21.15.29:0/186480941 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000bd60 con 0x7f5cc0159e60 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.958+0000 7f5cc72d3700 1 -- 172.21.15.29:0/186480941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 msgr2=0x7f5cc00b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.958+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/186480941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc00b6890 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5cc008a2c0 tx=0x7f5cb0009250 comp rx=0 tx=0).stop 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.958+0000 7f5cc72d3700 1 -- 172.21.15.29:0/186480941 shutdown_connections 2023-10-08T15:41:33.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.958+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/186480941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc00b6890 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.958+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/186480941 >> v2:172.21.15.183:3300/0 conn(0x7f5cc00cffa0 0x7f5cc006a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.958+0000 7f5cc72d3700 1 -- 172.21.15.29:0/186480941 >> 172.21.15.29:0/186480941 conn(0x7f5cc00d1a50 msgr2=0x7f5cc0068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:33.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.958+0000 7f5cc72d3700 1 -- 172.21.15.29:0/186480941 shutdown_connections 2023-10-08T15:41:33.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.958+0000 7f5cc72d3700 1 -- 172.21.15.29:0/186480941 wait complete. 2023-10-08T15:41:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.959+0000 7f5cc72d3700 1 Processor -- start 2023-10-08T15:41:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.959+0000 7f5cc72d3700 1 -- start start 2023-10-08T15:41:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc72d3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cc00cffa0 0x7f5cc016d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc72d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc72d3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cc015a230 0x7f5cc015f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc72d3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc016db60 con 0x7f5cc0159e60 2023-10-08T15:41:33.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc72d3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0152040 con 0x7f5cc00cffa0 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc72d3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0151430 con 0x7f5cc015a230 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc0150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54386/0 (socket says 172.21.15.29:54386) 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 -- 172.21.15.29:0/4142632273 learned_addr learned my addr 172.21.15.29:0/4142632273 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc506f700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cc00cffa0 0x7f5cc016d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc5870700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cc015a230 0x7f5cc015f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 -- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cc015a230 msgr2=0x7f5cc015f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cc015a230 0x7f5cc015f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 -- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cc00cffa0 msgr2=0x7f5cc016d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cc00cffa0 0x7f5cc016d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 -- 172.21.15.29:0/4142632273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb00094f0 con 0x7f5cc0159e60 2023-10-08T15:41:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc5870700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cc015a230 0x7f5cc015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.960+0000 7f5cc486e700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc0150a30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400d7e0 tx=0x7f5cb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.961+0000 7f5cbd7fa700 1 -- 172.21.15.29:0/4142632273 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb40125f0 con 0x7f5cc0159e60 2023-10-08T15:41:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.961+0000 7f5cbd7fa700 1 -- 172.21.15.29:0/4142632273 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb4012750 con 0x7f5cc0159e60 2023-10-08T15:41:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.961+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc0151710 con 0x7f5cc0159e60 2023-10-08T15:41:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.961+0000 7f5cbd7fa700 1 -- 172.21.15.29:0/4142632273 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4012af0 con 0x7f5cc0159e60 2023-10-08T15:41:33.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.961+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc0151cd0 con 0x7f5cc0159e60 2023-10-08T15:41:33.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.962+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc01521f0 con 0x7f5cc0159e60 2023-10-08T15:41:33.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.962+0000 7f5cbd7fa700 1 -- 172.21.15.29:0/4142632273 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cb401e460 con 0x7f5cc0159e60 2023-10-08T15:41:33.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.963+0000 7f5cbd7fa700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5cac066f30 0x7f5cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:33.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.963+0000 7f5cbd7fa700 1 -- 172.21.15.29:0/4142632273 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5cb4084800 con 0x7f5cc0159e60 2023-10-08T15:41:33.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.963+0000 7f5cc506f700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5cac066f30 0x7f5cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:33.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.963+0000 7f5cc506f700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5cac066f30 0x7f5cac0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5cc008a2c0 tx=0x7f5cb0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:33.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:33.967+0000 7f5cbd7fa700 1 -- 172.21.15.29:0/4142632273 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cc01521f0 con 0x7f5cc0159e60 2023-10-08T15:41:34.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.239+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f5cc0151e60 con 0x7f5cc0159e60 2023-10-08T15:41:34.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.821+0000 7f5cbd7fa700 1 -- 172.21.15.29:0/4142632273 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v84) v1 ==== 145+0+0 (secure 0 0 0) 0x7f5cb4055800 con 0x7f5cc0159e60 2023-10-08T15:41:34.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5cac066f30 msgr2=0x7f5cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5cac066f30 0x7f5cac0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5cc008a2c0 tx=0x7f5cb0017000 comp rx=0 tx=0).stop 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 msgr2=0x7f5cc0150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc0150a30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400d7e0 tx=0x7f5cb4008040 comp rx=0 tx=0).stop 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 shutdown_connections 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5cac066f30 0x7f5cac0693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cc015a230 0x7f5cc015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cc00cffa0 0x7f5cc016d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 --2- 172.21.15.29:0/4142632273 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cc0159e60 0x7f5cc0150a30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 >> 172.21.15.29:0/4142632273 conn(0x7f5cc00d1a50 msgr2=0x7f5cc00b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:34.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 shutdown_connections 2023-10-08T15:41:34.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:34.824+0000 7f5cc72d3700 1 -- 172.21.15.29:0/4142632273 wait complete. 2023-10-08T15:41:34.838 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-08T15:41:34.978 INFO:teuthology.orchestra.run.smithi029.stdout:{"osd_objectstore":"memstore"} 2023-10-08T15:41:34.978 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-08T15:41:34.979 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T15:41:35.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.100+0000 7fcafe5e1700 1 Processor -- start 2023-10-08T15:41:35.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.100+0000 7fcafe5e1700 1 -- start start 2023-10-08T15:41:35.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcafe5e1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815dcc0 0x7fcaf815e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcafe5e1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcaf815e5d0 0x7fcaf815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcafe5e1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcaf80cd900 0x7fcaf80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcafe5e1700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf809af70 con 0x7fcaf815e5d0 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcafe5e1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf80c7830 con 0x7fcaf80cd900 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcafe5e1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80c7b10 con 0x7fcaf815dcc0 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcaf77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcaf815e5d0 0x7fcaf815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcaf77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcaf815e5d0 0x7fcaf815b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54390/0 (socket says 172.21.15.29:54390) 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.101+0000 7fcaf77fe700 1 -- 172.21.15.29:0/1046390823 learned_addr learned my addr 172.21.15.29:0/1046390823 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcafcb7e700 1 --2- 172.21.15.29:0/1046390823 >> v2:172.21.15.183:3300/0 conn(0x7fcaf80cd900 0x7fcaf80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf7fff700 1 --2- 172.21.15.29:0/1046390823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815dcc0 0x7fcaf815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf77fe700 1 -- 172.21.15.29:0/1046390823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815dcc0 msgr2=0x7fcaf815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf77fe700 1 --2- 172.21.15.29:0/1046390823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815dcc0 0x7fcaf815e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf77fe700 1 -- 172.21.15.29:0/1046390823 >> v2:172.21.15.183:3300/0 conn(0x7fcaf80cd900 msgr2=0x7fcaf80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf77fe700 1 --2- 172.21.15.29:0/1046390823 >> v2:172.21.15.183:3300/0 conn(0x7fcaf80cd900 0x7fcaf80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf77fe700 1 -- 172.21.15.29:0/1046390823 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf80c7df0 con 0x7fcaf815e5d0 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf77fe700 1 --2- 172.21.15.29:0/1046390823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf815e5d0 0x7fcaf815b4f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80cd1a0 tx=0x7fcaec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84da79acb36cc52e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf6ffd700 1 -- 172.21.15.29:0/1046390823 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00b860 con 0x7fcaf815e5d0 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf6ffd700 1 -- 172.21.15.29:0/1046390823 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec00b9c0 con 0x7fcaf815e5d0 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.102+0000 7fcaf6ffd700 1 -- 172.21.15.29:0/1046390823 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00bd60 con 0x7fcaf815e5d0 2023-10-08T15:41:35.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1046390823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf815e5d0 msgr2=0x7fcaf815b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1046390823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf815e5d0 0x7fcaf815b4f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80cd1a0 tx=0x7fcaec009250 comp rx=0 tx=0).stop 2023-10-08T15:41:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1046390823 shutdown_connections 2023-10-08T15:41:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1046390823 >> v2:172.21.15.183:3300/0 conn(0x7fcaf80cd900 0x7fcaf80c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1046390823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815dcc0 0x7fcaf815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1046390823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf815e5d0 0x7fcaf815b4f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1046390823 >> 172.21.15.29:0/1046390823 conn(0x7fcaf8068170 msgr2=0x7fcaf80cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1046390823 shutdown_connections 2023-10-08T15:41:35.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.103+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1046390823 wait complete. 2023-10-08T15:41:35.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.104+0000 7fcafe5e1700 1 Processor -- start 2023-10-08T15:41:35.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.104+0000 7fcafe5e1700 1 -- start start 2023-10-08T15:41:35.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcafe5e1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf80cd900 0x7fcaf8099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcafe5e1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcaf815dcc0 0x7fcaf816a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcafe5e1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815e5d0 0x7fcaf80b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcafe5e1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80affa0 con 0x7fcaf80cd900 2023-10-08T15:41:35.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcafe5e1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80b0260 con 0x7fcaf815dcc0 2023-10-08T15:41:35.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcafe5e1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80b0540 con 0x7fcaf815e5d0 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf80cd900 0x7fcaf8099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf80cd900 0x7fcaf8099a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54400/0 (socket says 172.21.15.29:54400) 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 -- 172.21.15.29:0/1333074428 learned_addr learned my addr 172.21.15.29:0/1333074428 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf77fe700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcaf815dcc0 0x7fcaf816a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcafcb7e700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815e5d0 0x7fcaf80b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 -- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815e5d0 msgr2=0x7fcaf80b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815e5d0 0x7fcaf80b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 -- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcaf815dcc0 msgr2=0x7fcaf816a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcaf815dcc0 0x7fcaf816a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 -- 172.21.15.29:0/1333074428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0094f0 con 0x7fcaf80cd900 2023-10-08T15:41:35.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcaf7fff700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf80cd900 0x7fcaf8099a20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcae800d890 tx=0x7fcae8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.105+0000 7fcadffff700 1 -- 172.21.15.29:0/1333074428 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80125f0 con 0x7fcaf80cd900 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.106+0000 7fcadffff700 1 -- 172.21.15.29:0/1333074428 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae8012770 con 0x7fcaf80cd900 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.106+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf80b0820 con 0x7fcaf80cd900 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.106+0000 7fcadffff700 1 -- 172.21.15.29:0/1333074428 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8012b30 con 0x7fcaf80cd900 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.106+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf8099f60 con 0x7fcaf80cd900 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.106+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf809a150 con 0x7fcaf80cd900 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.107+0000 7fcadffff700 1 -- 172.21.15.29:0/1333074428 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcae801e460 con 0x7fcaf80cd900 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.107+0000 7fcadffff700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcae4066f30 0x7fcae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.107+0000 7fcadffff700 1 -- 172.21.15.29:0/1333074428 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcae8084800 con 0x7fcaf80cd900 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.108+0000 7fcaf77fe700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcae4066f30 0x7fcae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.108+0000 7fcaf77fe700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcae4066f30 0x7fcae40693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80cd1a0 tx=0x7fcaec017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.112+0000 7fcadffff700 1 -- 172.21.15.29:0/1333074428 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaf809a150 con 0x7fcaf80cd900 2023-10-08T15:41:35.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.304+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcaf80b0d40 con 0x7fcaf80cd900 2023-10-08T15:41:35.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.308+0000 7fcadffff700 1 -- 172.21.15.29:0/1333074428 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcaf80b0d40 con 0x7fcaf80cd900 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcae4066f30 msgr2=0x7fcae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcae4066f30 0x7fcae40693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80cd1a0 tx=0x7fcaec017000 comp rx=0 tx=0).stop 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf80cd900 msgr2=0x7fcaf8099a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf80cd900 0x7fcaf8099a20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcae800d890 tx=0x7fcae8008040 comp rx=0 tx=0).stop 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 shutdown_connections 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcae4066f30 0x7fcae40693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcaf815e5d0 0x7fcaf80b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf80cd900 0x7fcaf8099a20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 --2- 172.21.15.29:0/1333074428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcaf815dcc0 0x7fcaf816a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 >> 172.21.15.29:0/1333074428 conn(0x7fcaf8068170 msgr2=0x7fcaf80aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 shutdown_connections 2023-10-08T15:41:35.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.310+0000 7fcafe5e1700 1 -- 172.21.15.29:0/1333074428 wait complete. 2023-10-08T15:41:35.322 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:41:35.323 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:35.360 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:41:35.403 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:41:35.403 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T15:41:35.403 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:35.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.520+0000 7f8b1521e700 1 Processor -- start 2023-10-08T15:41:35.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.520+0000 7f8b1521e700 1 -- start start 2023-10-08T15:41:35.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.521+0000 7f8b1521e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b100cb000 0x7f8b1006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.521+0000 7f8b1521e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b10068a90 con 0x7f8b10070e10 2023-10-08T15:41:35.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.521+0000 7f8b1521e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1015ca70 con 0x7f8b1015b340 2023-10-08T15:41:35.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.521+0000 7f8b1521e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100ca330 con 0x7f8b100cb000 2023-10-08T15:41:35.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.521+0000 7f8b0f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b100cb000 0x7f8b1006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.521+0000 7f8b0f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8b100cb000 0x7f8b1006e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54402/0 (socket says 172.21.15.29:54402) 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.521+0000 7f8b0f59e700 1 -- 172.21.15.29:0/3937949976 learned_addr learned my addr 172.21.15.29:0/3937949976 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.521+0000 7f8b0e59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8b10070e10 0x7f8b1006e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39174/0 (socket says 172.21.15.29:39174) 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b0f59e700 1 -- 172.21.15.29:0/3937949976 >> v1:172.21.15.183:6789/0 conn(0x7f8b1015b340 legacy=0x7f8b10070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b0f59e700 1 -- 172.21.15.29:0/3937949976 >> v1:172.21.15.29:6789/0 conn(0x7f8b10070e10 legacy=0x7f8b1006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b0f59e700 1 -- 172.21.15.29:0/3937949976 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10068f20 con 0x7f8b100cb000 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b0f59e700 1 --2- 172.21.15.29:0/3937949976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b100cb000 0x7f8b1006e9c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009f20 tx=0x7f8b08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819cdb1ebb7a42cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b0dd9b700 1 -- 172.21.15.29:0/3937949976 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800e070 con 0x7f8b100cb000 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b0dd9b700 1 -- 172.21.15.29:0/3937949976 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800ba80 con 0x7f8b100cb000 2023-10-08T15:41:35.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b0dd9b700 1 -- 172.21.15.29:0/3937949976 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080092e0 con 0x7f8b100cb000 2023-10-08T15:41:35.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b1521e700 1 -- 172.21.15.29:0/3937949976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b100cb000 msgr2=0x7f8b1006e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b1521e700 1 --2- 172.21.15.29:0/3937949976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b100cb000 0x7f8b1006e9c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009f20 tx=0x7f8b08009840 comp rx=0 tx=0).stop 2023-10-08T15:41:35.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b1521e700 1 -- 172.21.15.29:0/3937949976 shutdown_connections 2023-10-08T15:41:35.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b1521e700 1 --2- 172.21.15.29:0/3937949976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b100cb000 0x7f8b1006e9c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b1521e700 1 -- 172.21.15.29:0/3937949976 >> 172.21.15.29:0/3937949976 conn(0x7f8b100ca4f0 msgr2=0x7f8b100ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b1521e700 1 -- 172.21.15.29:0/3937949976 shutdown_connections 2023-10-08T15:41:35.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.522+0000 7f8b1521e700 1 -- 172.21.15.29:0/3937949976 wait complete. 2023-10-08T15:41:35.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.524+0000 7f8b1521e700 1 Processor -- start 2023-10-08T15:41:35.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.524+0000 7f8b1521e700 1 -- start start 2023-10-08T15:41:35.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.524+0000 7f8b1521e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b10070e10 0x7f8b100c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.524+0000 7f8b1521e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b100cb000 0x7f8b100c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.524+0000 7f8b1521e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b1015b340 0x7f8b101599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b1521e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c3ed0 con 0x7f8b10070e10 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b1521e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c32c0 con 0x7f8b1015b340 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b1521e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c35a0 con 0x7f8b100cb000 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b10070e10 0x7f8b100c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b10070e10 0x7f8b100c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54420/0 (socket says 172.21.15.29:54420) 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 -- 172.21.15.29:0/673704731 learned_addr learned my addr 172.21.15.29:0/673704731 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0f59e700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b1015b340 0x7f8b101599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0e59c700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b100cb000 0x7f8b100c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 -- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b100cb000 msgr2=0x7f8b100c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b100cb000 0x7f8b100c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 -- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b1015b340 msgr2=0x7f8b101599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b1015b340 0x7f8b101599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 -- 172.21.15.29:0/673704731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08009ae0 con 0x7f8b10070e10 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0f59e700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b1015b340 0x7f8b101599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b0ed9d700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b10070e10 0x7f8b100c77e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000c4e0 tx=0x7f8b0000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8af6ffd700 1 -- 172.21.15.29:0/673704731 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00011590 con 0x7f8b10070e10 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8af6ffd700 1 -- 172.21.15.29:0/673704731 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b00011710 con 0x7f8b10070e10 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b100c3880 con 0x7f8b10070e10 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8af6ffd700 1 -- 172.21.15.29:0/673704731 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00011ad0 con 0x7f8b10070e10 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.525+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b100c7d20 con 0x7f8b10070e10 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.526+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100c4080 con 0x7f8b10070e10 2023-10-08T15:41:35.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.527+0000 7f8af6ffd700 1 -- 172.21.15.29:0/673704731 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b0001b3b0 con 0x7f8b10070e10 2023-10-08T15:41:35.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.527+0000 7f8af6ffd700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8afc066f30 0x7f8afc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.527+0000 7f8af6ffd700 1 -- 172.21.15.29:0/673704731 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8b00083740 con 0x7f8b10070e10 2023-10-08T15:41:35.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.527+0000 7f8b0e59c700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8afc066f30 0x7f8afc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.528+0000 7f8b0e59c700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8afc066f30 0x7f8afc0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b04007fd0 tx=0x7f8b04007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.531+0000 7f8af6ffd700 1 -- 172.21.15.29:0/673704731 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b100c4080 con 0x7f8b10070e10 2023-10-08T15:41:35.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.768+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b1004c3c0 con 0x7f8b10070e10 2023-10-08T15:41:35.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.768+0000 7f8af6ffd700 1 -- 172.21.15.29:0/673704731 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f8b00017020 con 0x7f8b10070e10 2023-10-08T15:41:35.769 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:35.769 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2731609838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2731609838},{"type":"v1","addr":"172.21.15.183:6836","nonce":2731609838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1263140500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":1263140500},{"type":"v1","addr":"172.21.15.183:6837","nonce":1263140500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2412755333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2412755333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2412755333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/658480795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":658480795},{"type":"v1","addr":"172.21.15.29:6835","nonce":658480795}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-10-08T15:41:35.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8afc066f30 msgr2=0x7f8afc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8afc066f30 0x7f8afc0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b04007fd0 tx=0x7f8b04007d70 comp rx=0 tx=0).stop 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b10070e10 msgr2=0x7f8b100c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b10070e10 0x7f8b100c77e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000c4e0 tx=0x7f8b0000c8a0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 shutdown_connections 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8afc066f30 0x7f8afc0693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b1015b340 0x7f8b101599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b10070e10 0x7f8b100c77e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 --2- 172.21.15.29:0/673704731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b100cb000 0x7f8b100c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 >> 172.21.15.29:0/673704731 conn(0x7f8b100ca4f0 msgr2=0x7f8b10156460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 shutdown_connections 2023-10-08T15:41:35.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.771+0000 7f8b1521e700 1 -- 172.21.15.29:0/673704731 wait complete. 2023-10-08T15:41:35.773 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 19 2023-10-08T15:41:35.783 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:41:35.784 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T15:41:35.784 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T15:41:35.784 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:35.785 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T15:41:35.785 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T15:41:35.785 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T15:41:35.785 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:35.785 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:41:35.785 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T15:41:35.786 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T15:41:35.786 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:35.786 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T15:41:35.786 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T15:41:35.786 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T15:41:35.786 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:41:35.792 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T15:41:35.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:41:35.793 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T15:41:35.794 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T15:41:35.796 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T15:41:35.796 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:41:35.797 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T15:41:35.797 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T15:41:35.834 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:41:35.835 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:35.835 INFO:tasks.ceph.mds.c:Started 2023-10-08T15:41:35.835 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:35.838 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:41:35.838 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:35.839 INFO:tasks.ceph.mds.d:Started 2023-10-08T15:41:35.839 DEBUG:teuthology.parallel:result is None 2023-10-08T15:41:35.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T15:41:35.911 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-08T15:41:35.911 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-08T15:41:35.917 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-10-08T15:41:35.917 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-10-08T15:41:35.917 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-10-08T15:41:35.917+0000 7ff4bc343700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-08T15:41:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.964+0000 7f3f6d36c700 1 Processor -- start 2023-10-08T15:41:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.964+0000 7f3f6d36c700 1 -- start start 2023-10-08T15:41:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f6d36c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f6806ec90 0x7f3f68070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f6d36c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3f680b0060 0x7f3f68070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f6d36c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f68068310 con 0x7f3f680afc90 2023-10-08T15:41:35.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f6d36c700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f68067700 con 0x7f3f6806ec90 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f6d36c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680679e0 con 0x7f3f680b0060 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f677fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f6806ec90 0x7f3f68070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f67fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3f680afc90 0x7f3f680688e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39206/0 (socket says 172.21.15.29:39206) 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f67fff700 1 -- 172.21.15.29:0/530079658 learned_addr learned my addr 172.21.15.29:0/530079658 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f6cb6b700 1 --2- 172.21.15.29:0/530079658 >> v2:172.21.15.183:3300/0 conn(0x7f3f680b0060 0x7f3f68070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f677fe700 1 -- 172.21.15.29:0/530079658 >> v2:172.21.15.183:3300/0 conn(0x7f3f680b0060 msgr2=0x7f3f68070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f677fe700 1 --2- 172.21.15.29:0/530079658 >> v2:172.21.15.183:3300/0 conn(0x7f3f680b0060 0x7f3f68070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f677fe700 1 -- 172.21.15.29:0/530079658 >> v1:172.21.15.29:6789/0 conn(0x7f3f680afc90 legacy=0x7f3f680688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f677fe700 1 -- 172.21.15.29:0/530079658 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f68067cc0 con 0x7f3f6806ec90 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.965+0000 7f3f66ffd700 1 -- 172.21.15.29:0/530079658 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950661772 0 0) 0x7f3f68068310 con 0x7f3f680afc90 2023-10-08T15:41:35.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f677fe700 1 --2- 172.21.15.29:0/530079658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f6806ec90 0x7f3f68070700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3f680c7e60 tx=0x7f3f580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8cf146f43781b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f66ffd700 1 -- 172.21.15.29:0/530079658 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011630 con 0x7f3f6806ec90 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f66ffd700 1 -- 172.21.15.29:0/530079658 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58011790 con 0x7f3f6806ec90 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f66ffd700 1 -- 172.21.15.29:0/530079658 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011b30 con 0x7f3f6806ec90 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f6d36c700 1 -- 172.21.15.29:0/530079658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f6806ec90 msgr2=0x7f3f68070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/530079658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f6806ec90 0x7f3f68070700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3f680c7e60 tx=0x7f3f580091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f6d36c700 1 -- 172.21.15.29:0/530079658 shutdown_connections 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/530079658 >> v2:172.21.15.183:3300/0 conn(0x7f3f680b0060 0x7f3f68070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/530079658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f6806ec90 0x7f3f68070700 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f6d36c700 1 -- 172.21.15.29:0/530079658 >> 172.21.15.29:0/530079658 conn(0x7f3f680cd890 msgr2=0x7f3f680cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f6d36c700 1 -- 172.21.15.29:0/530079658 shutdown_connections 2023-10-08T15:41:35.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.966+0000 7f3f6d36c700 1 -- 172.21.15.29:0/530079658 wait complete. 2023-10-08T15:41:35.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.968+0000 7f3f6d36c700 1 Processor -- start 2023-10-08T15:41:35.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.968+0000 7f3f6d36c700 1 -- start start 2023-10-08T15:41:35.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.968+0000 7f3f6d36c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f6806ec90 0x7f3f6815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.968+0000 7f3f6d36c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f680afc90 0x7f3f68150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.968+0000 7f3f6d36c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f680b0060 0x7f3f6815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.968+0000 7f3f6d36c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6815b880 con 0x7f3f680afc90 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f6d36c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6815ac70 con 0x7f3f680b0060 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f6d36c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6815af50 con 0x7f3f6806ec90 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f680afc90 0x7f3f68150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f680afc90 0x7f3f68150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54458/0 (socket says 172.21.15.29:54458) 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 -- 172.21.15.29:0/2563340665 learned_addr learned my addr 172.21.15.29:0/2563340665 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f6cb6b700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f680b0060 0x7f3f6815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f67fff700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f6806ec90 0x7f3f6815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 -- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f6806ec90 msgr2=0x7f3f6815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f6806ec90 0x7f3f6815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 -- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f680b0060 msgr2=0x7f3f6815bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f680b0060 0x7f3f6815bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:35.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 -- 172.21.15.29:0/2563340665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f58009420 con 0x7f3f680afc90 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f6cb6b700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f680b0060 0x7f3f6815bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f677fe700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f680afc90 0x7f3f68150220 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3f58013000 tx=0x7f3f58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f4ffff700 1 -- 172.21.15.29:0/2563340665 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011900 con 0x7f3f680afc90 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f4ffff700 1 -- 172.21.15.29:0/2563340665 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58011a60 con 0x7f3f680afc90 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6815b230 con 0x7f3f680afc90 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f4ffff700 1 -- 172.21.15.29:0/2563340665 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58025670 con 0x7f3f680afc90 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.969+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6815a8b0 con 0x7f3f680afc90 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.970+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6815b9f0 con 0x7f3f680afc90 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.971+0000 7f3f4ffff700 1 -- 172.21.15.29:0/2563340665 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f58023070 con 0x7f3f680afc90 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.971+0000 7f3f4ffff700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3f54066f30 0x7f3f540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:35.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.971+0000 7f3f4ffff700 1 -- 172.21.15.29:0/2563340665 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3f580857d0 con 0x7f3f680afc90 2023-10-08T15:41:35.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.971+0000 7f3f67fff700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3f54066f30 0x7f3f540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:35.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.972+0000 7f3f67fff700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3f54066f30 0x7f3f540693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0011e0 tx=0x7f3f5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:35.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:35.975+0000 7f3f4ffff700 1 -- 172.21.15.29:0/2563340665 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f58052d40 con 0x7f3f680afc90 2023-10-08T15:41:36.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:36.185+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3f68068ee0 con 0x7f3f680afc90 2023-10-08T15:41:37.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.493+0000 7f3f4ffff700 1 -- 172.21.15.29:0/2563340665 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3f58056360 con 0x7f3f680afc90 2023-10-08T15:41:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3f54066f30 msgr2=0x7f3f540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3f54066f30 0x7f3f540693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0011e0 tx=0x7f3f5c009040 comp rx=0 tx=0).stop 2023-10-08T15:41:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f680afc90 msgr2=0x7f3f68150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f680afc90 0x7f3f68150220 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3f58013000 tx=0x7f3f58017000 comp rx=0 tx=0).stop 2023-10-08T15:41:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 shutdown_connections 2023-10-08T15:41:37.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3f54066f30 0x7f3f540693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f680b0060 0x7f3f6815bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f6806ec90 0x7f3f6815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 --2- 172.21.15.29:0/2563340665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f680afc90 0x7f3f68150220 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 >> 172.21.15.29:0/2563340665 conn(0x7f3f680cd890 msgr2=0x7f3f680c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:37.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 shutdown_connections 2023-10-08T15:41:37.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.496+0000 7f3f6d36c700 1 -- 172.21.15.29:0/2563340665 wait complete. 2023-10-08T15:41:37.498 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2023-10-08T15:41:37.512 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T15:41:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.637+0000 7f3c708cb700 1 Processor -- start 2023-10-08T15:41:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.637+0000 7f3c708cb700 1 -- start start 2023-10-08T15:41:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.637+0000 7f3c708cb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c159e10 0x7f3c6c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.637+0000 7f3c708cb700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3c6c15a1e0 0x7f3c6c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.637+0000 7f3c708cb700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c15db80 con 0x7f3c6c0b1610 2023-10-08T15:41:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.637+0000 7f3c708cb700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c15e800 con 0x7f3c6c15a1e0 2023-10-08T15:41:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.637+0000 7f3c708cb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c15de60 con 0x7f3c6c159e10 2023-10-08T15:41:37.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6ad9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3c6c0b1610 0x7f3c6c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39210/0 (socket says 172.21.15.29:39210) 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6ad9d700 1 -- 172.21.15.29:0/1509871339 learned_addr learned my addr 172.21.15.29:0/1509871339 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1509871339 >> v2:172.21.15.183:3300/0 conn(0x7f3c6c15a1e0 0x7f3c6c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6a59c700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c159e10 0x7f3c6c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885095845 0 0) 0x7f3c6c15db80 con 0x7f3c6c0b1610 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c58003570 con 0x7f3c6c0b1610 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645205200 0 0) 0x7f3c58003570 con 0x7f3c6c0b1610 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c159e10 msgr2=0x7f3c6c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c159e10 0x7f3c6c0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 >> v2:172.21.15.183:3300/0 conn(0x7f3c6c15a1e0 msgr2=0x7f3c6c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 --2- 172.21.15.29:0/1509871339 >> v2:172.21.15.183:3300/0 conn(0x7f3c6c15a1e0 0x7f3c6c0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.642 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c15e140 con 0x7f3c6c0b1610 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f3c64001490 con 0x7f3c6c0b1610 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 >> v1:172.21.15.29:6789/0 conn(0x7f3c6c0b1610 legacy=0x7f3c6c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c159e10 0x7f3c58003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c58004d50 0x7f3c580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c15e800 con 0x7f3c58003fe0 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c15de60 con 0x7f3c58004d50 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5800ba90 con 0x7f3c6c159e10 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.638+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c6a59c700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c159e10 0x7f3c58003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c6ad9d700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c58004d50 0x7f3c580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c69d9b700 1 -- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c159e10 msgr2=0x7f3c58003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c159e10 0x7f3c58003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c69d9b700 1 -- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c58004d50 msgr2=0x7f3c580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c58004d50 0x7f3c580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c69d9b700 1 -- 172.21.15.29:0/1509871339 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58003570 con 0x7f3c58003fe0 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c58004810 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009c00 tx=0x7f3c540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fdb23523896929 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400e6b0 con 0x7f3c58003fe0 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5400e810 con 0x7f3c58003fe0 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c6959a700 1 -- 172.21.15.29:0/1509871339 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400ebd0 con 0x7f3c58003fe0 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c708cb700 1 -- 172.21.15.29:0/1509871339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 msgr2=0x7f3c58004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c708cb700 1 --2- 172.21.15.29:0/1509871339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c58004810 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009c00 tx=0x7f3c540091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.639+0000 7f3c6ad9d700 1 -- 172.21.15.29:0/1509871339 reap_dead start 2023-10-08T15:41:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.640+0000 7f3c708cb700 1 -- 172.21.15.29:0/1509871339 shutdown_connections 2023-10-08T15:41:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.640+0000 7f3c708cb700 1 -- 172.21.15.29:0/1509871339 >> 172.21.15.29:0/1509871339 conn(0x7f3c6c067660 msgr2=0x7f3c6c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.640+0000 7f3c708cb700 1 -- 172.21.15.29:0/1509871339 shutdown_connections 2023-10-08T15:41:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.640+0000 7f3c708cb700 1 -- 172.21.15.29:0/1509871339 wait complete. 2023-10-08T15:41:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.641+0000 7f3c708cb700 1 Processor -- start 2023-10-08T15:41:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.641+0000 7f3c708cb700 1 -- start start 2023-10-08T15:41:37.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.641+0000 7f3c708cb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c6c153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.641+0000 7f3c708cb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c0d0680 0x7f3c6c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.641+0000 7f3c708cb700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c6c0b4c70 0x7f3c6c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.641+0000 7f3c708cb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0b5650 con 0x7f3c58003fe0 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.641+0000 7f3c708cb700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0c5b80 con 0x7f3c6c0b4c70 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.641+0000 7f3c708cb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0c5d10 con 0x7f3c6c0d0680 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c6c153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c6c153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54472/0 (socket says 172.21.15.29:54472) 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 -- 172.21.15.29:0/1434737077 learned_addr learned my addr 172.21.15.29:0/1434737077 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c0d0680 0x7f3c6c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6ad9d700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c6c0b4c70 0x7f3c6c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 -- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c0d0680 msgr2=0x7f3c6c0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c0d0680 0x7f3c6c0ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 -- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c6c0b4c70 msgr2=0x7f3c6c0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c6c0b4c70 0x7f3c6c0b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 -- 172.21.15.29:0/1434737077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0cf1e0 con 0x7f3c58003fe0 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c0d0680 0x7f3c6c0ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c6a59c700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c6c153990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c011f80 tx=0x7f3c5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c627fc700 1 -- 172.21.15.29:0/1434737077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00e040 con 0x7f3c58003fe0 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c627fc700 1 -- 172.21.15.29:0/1434737077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c00f040 con 0x7f3c58003fe0 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c0cf4c0 con 0x7f3c58003fe0 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c627fc700 1 -- 172.21.15.29:0/1434737077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c015430 con 0x7f3c58003fe0 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.642+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c0cfa80 con 0x7f3c58003fe0 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.643+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c153f30 con 0x7f3c58003fe0 2023-10-08T15:41:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.643+0000 7f3c627fc700 1 -- 172.21.15.29:0/1434737077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c5c0157e0 con 0x7f3c58003fe0 2023-10-08T15:41:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.644+0000 7f3c627fc700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.644+0000 7f3c627fc700 1 -- 172.21.15.29:0/1434737077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c5c084f00 con 0x7f3c58003fe0 2023-10-08T15:41:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.644+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.645+0000 7f3c69d9b700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c4c066f30 0x7f3c4c0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0b5840 tx=0x7f3c5401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.648+0000 7f3c627fc700 1 -- 172.21.15.29:0/1434737077 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c5c055f50 con 0x7f3c58003fe0 2023-10-08T15:41:37.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.921+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3c6c04c3c0 con 0x7f3c58003fe0 2023-10-08T15:41:37.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.921+0000 7f3c627fc700 1 -- 172.21.15.29:0/1434737077 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3c5c055ae0 con 0x7f3c58003fe0 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlYRZwCRAAGoAPqAnl5NDkgFSuSAb0dQ==", 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:37.922 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlXJDaFBAAC2AbAwL8n7M+sYYTc2TPsw==", 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:37.923 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl2PBqEBAAFdiMT6RrjHdj7SRjAbP4sQ==", 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.924 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlsZmxGxAA36NsIsK3XcPqbAnnT92G0Q==", 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2023-10-08T15:41:37.925 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlbwxYCxAAi9e56N5uN63J7J+CFrotmQ==", 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlrFhCEhAAkg2cwfL0v9izcWZW8IkKvA==", 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:37.926 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlb/xdGxAAXhOqn1ZfBDqVNynmIESgsQ==", 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.927 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlmaSCJBAAD0mbJDLpY+XnpBfW+PxKwg==", 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2023-10-08T15:41:37.928 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBSzSJlostbMhAADG+AgRpi1nAPh9OYWKfmXg==", 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBSzSJlEG4vORAA0iGg702OP3gHtLsYax/jeg==", 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:37.929 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTzSJlshaZBhAAe3VfHlxRqfigbN61EJnizg==", 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.930 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTzSJlvFS/DxAAOFmLFOOLsMk+glMEkwb+0A==", 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl89iQHxAA+CyqKmHWtMkmRiZd82Bm+A==", 2023-10-08T15:41:37.931 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow r", 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlldcVKBAAZKujKb3x/HYn/QzJ0/iUGA==", 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:41:37.932 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlyMQQJRAA4Wz0XqtCvc38O4gm+T+Ipw==", 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.933 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl5494LRAAMVyV+XR9M7FmtYcUMmZNSA==", 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2023-10-08T15:41:37.934 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBMzSJlYMULKhAArem31P8khIAGuU9Fghu/tA==", 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlvI5NBhAAgIljkxa68BKP6MhsV8a5kA==", 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.935 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlAiPhAhAAP7NTLjG1tB3zd69Xz9z/Dw==", 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:41:37.936 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.937 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:37.937 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:37.937 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:41:37.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c4c066f30 msgr2=0x7f3c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c4c066f30 0x7f3c4c0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0b5840 tx=0x7f3c5401a000 comp rx=0 tx=0).stop 2023-10-08T15:41:37.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 msgr2=0x7f3c6c153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:37.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c6c153990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c011f80 tx=0x7f3c5c00b040 comp rx=0 tx=0).stop 2023-10-08T15:41:37.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 shutdown_connections 2023-10-08T15:41:37.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3c4c066f30 0x7f3c4c0693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c6c0b4c70 0x7f3c6c0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3c58003fe0 0x7f3c6c153990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 --2- 172.21.15.29:0/1434737077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c6c0d0680 0x7f3c6c0ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 >> 172.21.15.29:0/1434737077 conn(0x7f3c6c067660 msgr2=0x7f3c6c0b5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 shutdown_connections 2023-10-08T15:41:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:37.923+0000 7f3c708cb700 1 -- 172.21.15.29:0/1434737077 wait complete. 2023-10-08T15:41:37.939 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.058+0000 7feee8981700 1 Processor -- start 2023-10-08T15:41:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.058+0000 7feee8981700 1 -- start start 2023-10-08T15:41:38.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee8981700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feee40cd6e0 0x7feee40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee8981700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feee40cdab0 0x7feee415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee8981700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40cb7c0 con 0x7feee415dda0 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee8981700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee415e850 con 0x7feee40cdab0 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee8981700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee40cd030 con 0x7feee40cd6e0 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee2ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feee40cdab0 0x7feee415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee2ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feee40cdab0 0x7feee415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54480/0 (socket says 172.21.15.29:54480) 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee2ffd700 1 -- 172.21.15.29:0/577890451 learned_addr learned my addr 172.21.15.29:0/577890451 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee3fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7feee415dda0 0x7feee415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:39220/0 (socket says 172.21.15.29:39220) 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee37fe700 1 --2- 172.21.15.29:0/577890451 >> v2:172.21.15.183:3300/0 conn(0x7feee40cd6e0 0x7feee40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee2ffd700 1 -- 172.21.15.29:0/577890451 >> v2:172.21.15.183:3300/0 conn(0x7feee40cd6e0 msgr2=0x7feee40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee2ffd700 1 --2- 172.21.15.29:0/577890451 >> v2:172.21.15.183:3300/0 conn(0x7feee40cd6e0 0x7feee40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee2ffd700 1 -- 172.21.15.29:0/577890451 >> v1:172.21.15.29:6789/0 conn(0x7feee415dda0 legacy=0x7feee415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee27fc700 1 -- 172.21.15.29:0/577890451 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185626231 0 0) 0x7feee40cb7c0 con 0x7feee415dda0 2023-10-08T15:41:38.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee2ffd700 1 -- 172.21.15.29:0/577890451 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee415e290 con 0x7feee40cdab0 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.059+0000 7feee37fe700 1 --2- 172.21.15.29:0/577890451 >> v2:172.21.15.183:3300/0 conn(0x7feee40cd6e0 0x7feee40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee2ffd700 1 --2- 172.21.15.29:0/577890451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee415d860 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7feee406b730 tx=0x7feed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0d130f2c8b9121 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee27fc700 1 -- 172.21.15.29:0/577890451 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800b860 con 0x7feee40cdab0 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee27fc700 1 -- 172.21.15.29:0/577890451 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed800b9c0 con 0x7feee40cdab0 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee27fc700 1 -- 172.21.15.29:0/577890451 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800bd60 con 0x7feee40cdab0 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee8981700 1 -- 172.21.15.29:0/577890451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 msgr2=0x7feee415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee8981700 1 --2- 172.21.15.29:0/577890451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee415d860 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7feee406b730 tx=0x7feed8009250 comp rx=0 tx=0).stop 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee8981700 1 -- 172.21.15.29:0/577890451 shutdown_connections 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee8981700 1 --2- 172.21.15.29:0/577890451 >> v2:172.21.15.183:3300/0 conn(0x7feee40cd6e0 0x7feee40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee8981700 1 --2- 172.21.15.29:0/577890451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee415d860 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee8981700 1 -- 172.21.15.29:0/577890451 >> 172.21.15.29:0/577890451 conn(0x7feee4067660 msgr2=0x7feee4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee8981700 1 -- 172.21.15.29:0/577890451 shutdown_connections 2023-10-08T15:41:38.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.060+0000 7feee8981700 1 -- 172.21.15.29:0/577890451 wait complete. 2023-10-08T15:41:38.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee8981700 1 Processor -- start 2023-10-08T15:41:38.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee8981700 1 -- start start 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee8981700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feee40cd6e0 0x7feee416ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee8981700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee4150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee8981700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feee415dda0 0x7feee40c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee8981700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40caaa0 con 0x7feee40cdab0 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee8981700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee414ce90 con 0x7feee40cd6e0 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee8981700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40b5a70 con 0x7feee415dda0 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee4150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee4150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54486/0 (socket says 172.21.15.29:54486) 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.062+0000 7feee2ffd700 1 -- 172.21.15.29:0/3537767190 learned_addr learned my addr 172.21.15.29:0/3537767190 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee37fe700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feee40cd6e0 0x7feee416ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee3fff700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feee415dda0 0x7feee40c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee2ffd700 1 -- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feee415dda0 msgr2=0x7feee40c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee2ffd700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feee415dda0 0x7feee40c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee2ffd700 1 -- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feee40cd6e0 msgr2=0x7feee416ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee2ffd700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feee40cd6e0 0x7feee416ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee2ffd700 1 -- 172.21.15.29:0/3537767190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80094f0 con 0x7feee40cdab0 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee2ffd700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee4150c60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feed80090b0 tx=0x7feed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feecb7fe700 1 -- 172.21.15.29:0/3537767190 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8011e60 con 0x7feee40cdab0 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feecb7fe700 1 -- 172.21.15.29:0/3537767190 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed801f070 con 0x7feee40cdab0 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40b5d50 con 0x7feee40cdab0 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feecb7fe700 1 -- 172.21.15.29:0/3537767190 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed801a890 con 0x7feee40cdab0 2023-10-08T15:41:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.063+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee416a540 con 0x7feee40cdab0 2023-10-08T15:41:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.064+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee416a990 con 0x7feee40cdab0 2023-10-08T15:41:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.065+0000 7feecb7fe700 1 -- 172.21.15.29:0/3537767190 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feed801ac00 con 0x7feee40cdab0 2023-10-08T15:41:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.065+0000 7feecb7fe700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7feed0066f30 0x7feed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.065+0000 7feecb7fe700 1 -- 172.21.15.29:0/3537767190 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feed8021070 con 0x7feee40cdab0 2023-10-08T15:41:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.065+0000 7feee37fe700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7feed0066f30 0x7feed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.066+0000 7feee37fe700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7feed0066f30 0x7feed00693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feed4006f00 tx=0x7feed4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.069+0000 7feecb7fe700 1 -- 172.21.15.29:0/3537767190 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feed8053790 con 0x7feee40cdab0 2023-10-08T15:41:38.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.262+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feee4089310 con 0x7feee40cdab0 2023-10-08T15:41:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.263+0000 7feecb7fe700 1 -- 172.21.15.29:0/3537767190 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+12134 (secure 0 0 0) 0x7feed8015090 con 0x7feee40cdab0 2023-10-08T15:41:38.264 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:38.264 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":41,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:37.490493+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:38.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7feed0066f30 msgr2=0x7feed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7feed0066f30 0x7feed00693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feed4006f00 tx=0x7feed4008040 comp rx=0 tx=0).stop 2023-10-08T15:41:38.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 msgr2=0x7feee4150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee4150c60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feed80090b0 tx=0x7feed8017000 comp rx=0 tx=0).stop 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 shutdown_connections 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7feed0066f30 0x7feed00693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feee415dda0 0x7feee40c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feee40cd6e0 0x7feee416ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 --2- 172.21.15.29:0/3537767190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feee40cdab0 0x7feee4150c60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.265+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 >> 172.21.15.29:0/3537767190 conn(0x7feee4067660 msgr2=0x7feee415c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.266+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 shutdown_connections 2023-10-08T15:41:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.266+0000 7feee8981700 1 -- 172.21.15.29:0/3537767190 wait complete. 2023-10-08T15:41:38.278 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:41:38.278 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:41:38.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.400+0000 7fd380ac6700 1 Processor -- start 2023-10-08T15:41:38.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.400+0000 7fd380ac6700 1 -- start start 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd380ac6700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd37c159ec0 0x7fd37c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd380ac6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c15a290 0x7fd37c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd380ac6700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0b0790 con 0x7fd37c06a5a0 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd380ac6700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0ce1f0 con 0x7fd37c159ec0 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd380ac6700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b0b20 con 0x7fd37c15a290 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37ad9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd37c06a5a0 0x7fd37c15db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37542/0 (socket says 172.21.15.29:37542) 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37ad9d700 1 -- 172.21.15.29:0/1841513962 learned_addr learned my addr 172.21.15.29:0/1841513962 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37a59c700 1 --2- 172.21.15.29:0/1841513962 >> v2:172.21.15.183:3300/0 conn(0x7fd37c159ec0 0x7fd37c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd379d9b700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c15a290 0x7fd37c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372091169 0 0) 0x7fd37c0b0790 con 0x7fd37c06a5a0 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd368003570 con 0x7fd37c06a5a0 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 615614210 0 0) 0x7fd368003570 con 0x7fd37c06a5a0 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c15a290 msgr2=0x7fd37c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37959a700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c15a290 0x7fd37c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 >> v2:172.21.15.183:3300/0 conn(0x7fd37c159ec0 msgr2=0x7fd37c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.401+0000 7fd37959a700 1 --2- 172.21.15.29:0/1841513962 >> v2:172.21.15.183:3300/0 conn(0x7fd37c159ec0 0x7fd37c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0b04b0 con 0x7fd37c06a5a0 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fd3740017f0 con 0x7fd37c06a5a0 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 >> v1:172.21.15.29:6789/0 conn(0x7fd37c06a5a0 legacy=0x7fd37c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd368003a60 0x7fd368003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd368004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c15a290 0x7fd3680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0ce1f0 con 0x7fd368004810 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b0b20 con 0x7fd368003a60 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36800ba60 con 0x7fd37c15a290 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37a59c700 1 --2- 172.21.15.29:0/1841513962 >> v2:172.21.15.183:3300/0 conn(0x7fd37c159ec0 0x7fd37c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd379d9b700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd368004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37ad9d700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c15a290 0x7fd3680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37a59c700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd368003a60 0x7fd368003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd379d9b700 1 -- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c15a290 msgr2=0x7fd3680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd379d9b700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c15a290 0x7fd3680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd379d9b700 1 -- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd368003a60 msgr2=0x7fd368003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd379d9b700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd368003a60 0x7fd368003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd379d9b700 1 -- 172.21.15.29:0/1841513962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368003570 con 0x7fd368004810 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37a59c700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd368003a60 0x7fd368003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd379d9b700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd368004c80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd364009c30 tx=0x7fd3640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de4aa15e723b28 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400e710 con 0x7fd368004810 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36400e870 con 0x7fd368004810 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.402+0000 7fd37959a700 1 -- 172.21.15.29:0/1841513962 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400ec30 con 0x7fd368004810 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.403+0000 7fd380ac6700 1 -- 172.21.15.29:0/1841513962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 msgr2=0x7fd368004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.403+0000 7fd380ac6700 1 --2- 172.21.15.29:0/1841513962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd368004c80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd364009c30 tx=0x7fd3640091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.403+0000 7fd37ad9d700 1 -- 172.21.15.29:0/1841513962 reap_dead start 2023-10-08T15:41:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.403+0000 7fd380ac6700 1 -- 172.21.15.29:0/1841513962 shutdown_connections 2023-10-08T15:41:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.403+0000 7fd380ac6700 1 -- 172.21.15.29:0/1841513962 >> 172.21.15.29:0/1841513962 conn(0x7fd37c0d1880 msgr2=0x7fd37c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.403+0000 7fd380ac6700 1 -- 172.21.15.29:0/1841513962 shutdown_connections 2023-10-08T15:41:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.403+0000 7fd380ac6700 1 -- 172.21.15.29:0/1841513962 wait complete. 2023-10-08T15:41:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.404+0000 7fd380ac6700 1 Processor -- start 2023-10-08T15:41:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.404+0000 7fd380ac6700 1 -- start start 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd380ac6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd37c0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd380ac6700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd37c0c8a40 0x7fd37c0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd380ac6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd380ac6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c15b840 con 0x7fd368004810 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd380ac6700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b4bf0 con 0x7fd37c0c8a40 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd380ac6700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b4ed0 con 0x7fd37c0c8eb0 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd37c0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd37c0b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36176/0 (socket says 172.21.15.29:36176) 2023-10-08T15:41:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 -- 172.21.15.29:0/2731607003 learned_addr learned my addr 172.21.15.29:0/2731607003 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37ad9d700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd379d9b700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd37c0c8a40 0x7fd37c0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 -- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c0c8eb0 msgr2=0x7fd37c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 -- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd37c0c8a40 msgr2=0x7fd37c0ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd37c0c8a40 0x7fd37c0ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 -- 172.21.15.29:0/2731607003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0b51b0 con 0x7fd368004810 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37ad9d700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.405+0000 7fd37a59c700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd37c0b45e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009fd0 tx=0x7fd36c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.406+0000 7fd3727fc700 1 -- 172.21.15.29:0/2731607003 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00f9b0 con 0x7fd368004810 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.406+0000 7fd3727fc700 1 -- 172.21.15.29:0/2731607003 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c00fb10 con 0x7fd368004810 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.406+0000 7fd3727fc700 1 -- 172.21.15.29:0/2731607003 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00fe90 con 0x7fd368004810 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.406+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c0b5490 con 0x7fd368004810 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.406+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c155a40 con 0x7fd368004810 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.407+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c071b90 con 0x7fd368004810 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.407+0000 7fd3727fc700 1 -- 172.21.15.29:0/2731607003 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd36c015670 con 0x7fd368004810 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.407+0000 7fd3727fc700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd35c066f30 0x7fd35c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.408+0000 7fd3727fc700 1 -- 172.21.15.29:0/2731607003 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd36c084ca0 con 0x7fd368004810 2023-10-08T15:41:38.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.408+0000 7fd379d9b700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd35c066f30 0x7fd35c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.408+0000 7fd379d9b700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd35c066f30 0x7fd35c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3640091e0 tx=0x7fd36401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.412+0000 7fd3727fc700 1 -- 172.21.15.29:0/2731607003 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd37c071b90 con 0x7fd368004810 2023-10-08T15:41:38.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.603+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd37c071b90 con 0x7fd368004810 2023-10-08T15:41:38.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.604+0000 7fd3727fc700 1 -- 172.21.15.29:0/2731607003 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd37c071b90 con 0x7fd368004810 2023-10-08T15:41:38.604 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:41:38.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd35c066f30 msgr2=0x7fd35c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd35c066f30 0x7fd35c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3640091e0 tx=0x7fd36401a000 comp rx=0 tx=0).stop 2023-10-08T15:41:38.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 msgr2=0x7fd37c0b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd37c0b45e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009fd0 tx=0x7fd36c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:38.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 shutdown_connections 2023-10-08T15:41:38.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd35c066f30 0x7fd35c0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd37c0c8eb0 0x7fd37c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd368004810 0x7fd37c0b45e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 --2- 172.21.15.29:0/2731607003 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd37c0c8a40 0x7fd37c0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 >> 172.21.15.29:0/2731607003 conn(0x7fd37c0d1880 msgr2=0x7fd37c0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 shutdown_connections 2023-10-08T15:41:38.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.606+0000 7fd380ac6700 1 -- 172.21.15.29:0/2731607003 wait complete. 2023-10-08T15:41:38.618 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:41:38.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.736+0000 7fbe6025d700 1 Processor -- start 2023-10-08T15:41:38.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe6025d700 1 -- start start 2023-10-08T15:41:38.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe6025d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbe581577d0 0x7fbe580cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe6025d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbe5806ac30 0x7fbe5815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe6025d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5815c360 con 0x7fbe58157ba0 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe6025d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5815b790 con 0x7fbe5806ac30 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe6025d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5815ba30 con 0x7fbe581577d0 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe5e7fa700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbe5806ac30 0x7fbe5815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe5d7f8700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbe58157ba0 0x7fbe5806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37552/0 (socket says 172.21.15.29:37552) 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.737+0000 7fbe5d7f8700 1 -- 172.21.15.29:0/1967512646 learned_addr learned my addr 172.21.15.29:0/1967512646 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5cff7700 1 -- 172.21.15.29:0/1967512646 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885477575 0 0) 0x7fbe5815c360 con 0x7fbe58157ba0 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5dff9700 1 --2- 172.21.15.29:0/1967512646 >> v2:172.21.15.183:3300/0 conn(0x7fbe581577d0 0x7fbe580cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5cff7700 1 -- 172.21.15.29:0/1967512646 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe40003570 con 0x7fbe58157ba0 2023-10-08T15:41:38.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5e7fa700 1 -- 172.21.15.29:0/1967512646 >> v2:172.21.15.183:3300/0 conn(0x7fbe581577d0 msgr2=0x7fbe580cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5e7fa700 1 --2- 172.21.15.29:0/1967512646 >> v2:172.21.15.183:3300/0 conn(0x7fbe581577d0 0x7fbe580cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5e7fa700 1 -- 172.21.15.29:0/1967512646 >> v1:172.21.15.29:6789/0 conn(0x7fbe58157ba0 legacy=0x7fbe5806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5e7fa700 1 -- 172.21.15.29:0/1967512646 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5815bd10 con 0x7fbe5806ac30 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5e7fa700 1 --2- 172.21.15.29:0/1967512646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe5806ac30 0x7fbe5815c7f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbe580b6dc0 tx=0x7fbe500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dded473d920ec60e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5cff7700 1 -- 172.21.15.29:0/1967512646 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50011630 con 0x7fbe5806ac30 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5cff7700 1 -- 172.21.15.29:0/1967512646 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe50011790 con 0x7fbe5806ac30 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.738+0000 7fbe5cff7700 1 -- 172.21.15.29:0/1967512646 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50011b30 con 0x7fbe5806ac30 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.739+0000 7fbe6025d700 1 -- 172.21.15.29:0/1967512646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe5806ac30 msgr2=0x7fbe5815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.739+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1967512646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe5806ac30 0x7fbe5815c7f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbe580b6dc0 tx=0x7fbe500091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.739+0000 7fbe6025d700 1 -- 172.21.15.29:0/1967512646 shutdown_connections 2023-10-08T15:41:38.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.739+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1967512646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe5806ac30 0x7fbe5815c7f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.739+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1967512646 >> v2:172.21.15.183:3300/0 conn(0x7fbe581577d0 0x7fbe580cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.739+0000 7fbe6025d700 1 -- 172.21.15.29:0/1967512646 >> 172.21.15.29:0/1967512646 conn(0x7fbe58068ce0 msgr2=0x7fbe580690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.739+0000 7fbe6025d700 1 -- 172.21.15.29:0/1967512646 shutdown_connections 2023-10-08T15:41:38.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.739+0000 7fbe6025d700 1 -- 172.21.15.29:0/1967512646 wait complete. 2023-10-08T15:41:38.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.740+0000 7fbe6025d700 1 Processor -- start 2023-10-08T15:41:38.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.740+0000 7fbe6025d700 1 -- start start 2023-10-08T15:41:38.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe6025d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe5806ac30 0x7fbe5814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe6025d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe581577d0 0x7fbe58150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe6025d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe58157ba0 0x7fbe581580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe6025d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5815db00 con 0x7fbe58157ba0 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe6025d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5815e460 con 0x7fbe5806ac30 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe6025d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5815d540 con 0x7fbe581577d0 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe58157ba0 0x7fbe581580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe58157ba0 0x7fbe581580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36190/0 (socket says 172.21.15.29:36190) 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 -- 172.21.15.29:0/1104655063 learned_addr learned my addr 172.21.15.29:0/1104655063 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5dff9700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe5806ac30 0x7fbe5814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5d7f8700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe581577d0 0x7fbe58150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 -- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe581577d0 msgr2=0x7fbe58150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe581577d0 0x7fbe58150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 -- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe5806ac30 msgr2=0x7fbe5814ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe5806ac30 0x7fbe5814ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 -- 172.21.15.29:0/1104655063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50009420 con 0x7fbe58157ba0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe5e7fa700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe58157ba0 0x7fbe581580b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbe50013000 tx=0x7fbe50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe55ffb700 1 -- 172.21.15.29:0/1104655063 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500195c0 con 0x7fbe58157ba0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe55ffb700 1 -- 172.21.15.29:0/1104655063 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe50019740 con 0x7fbe58157ba0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5815d820 con 0x7fbe58157ba0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.741+0000 7fbe55ffb700 1 -- 172.21.15.29:0/1104655063 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50019b00 con 0x7fbe58157ba0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.742+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe581585f0 con 0x7fbe58157ba0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.743+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5815df50 con 0x7fbe58157ba0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.743+0000 7fbe55ffb700 1 -- 172.21.15.29:0/1104655063 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe500253f0 con 0x7fbe58157ba0 2023-10-08T15:41:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.743+0000 7fbe55ffb700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbe44066f30 0x7fbe440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.744+0000 7fbe55ffb700 1 -- 172.21.15.29:0/1104655063 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbe50085d40 con 0x7fbe58157ba0 2023-10-08T15:41:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.744+0000 7fbe5dff9700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbe44066f30 0x7fbe440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.744+0000 7fbe5dff9700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbe44066f30 0x7fbe440693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe480075a0 tx=0x7fbe480097a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:38.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.748+0000 7fbe55ffb700 1 -- 172.21.15.29:0/1104655063 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe5815df50 con 0x7fbe58157ba0 2023-10-08T15:41:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.941+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbe5815df50 con 0x7fbe58157ba0 2023-10-08T15:41:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.941+0000 7fbe55ffb700 1 -- 172.21.15.29:0/1104655063 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbe5815df50 con 0x7fbe58157ba0 2023-10-08T15:41:38.941 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:38.942 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-08T15:41:38.942 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:38.942 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-08T15:41:38.942 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-08T15:41:38.942 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:38.942 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-08T15:41:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbe44066f30 msgr2=0x7fbe440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbe44066f30 0x7fbe440693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe480075a0 tx=0x7fbe480097a0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe58157ba0 msgr2=0x7fbe581580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe58157ba0 0x7fbe581580b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbe50013000 tx=0x7fbe50017000 comp rx=0 tx=0).stop 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 shutdown_connections 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbe44066f30 0x7fbe440693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe58157ba0 0x7fbe581580b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe5806ac30 0x7fbe5814ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 --2- 172.21.15.29:0/1104655063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe581577d0 0x7fbe58150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 >> 172.21.15.29:0/1104655063 conn(0x7fbe58068ce0 msgr2=0x7fbe581594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 shutdown_connections 2023-10-08T15:41:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:38.943+0000 7fbe6025d700 1 -- 172.21.15.29:0/1104655063 wait complete. 2023-10-08T15:41:38.955 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:41:38.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:41:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.079+0000 7fce971fd700 1 Processor -- start 2023-10-08T15:41:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.079+0000 7fce971fd700 1 -- start start 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.079+0000 7fce971fd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 0x7fce900b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.079+0000 7fce971fd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fce90068cb0 0x7fce90069110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.079+0000 7fce971fd700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce90069650 con 0x7fce900b3370 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.079+0000 7fce971fd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900b0d60 con 0x7fce90068cb0 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.079+0000 7fce971fd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce900d15b0 con 0x7fce90159e50 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce8ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fce900b3370 0x7fce900b11f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37564/0 (socket says 172.21.15.29:37564) 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce8ffff700 1 -- 172.21.15.29:0/91749717 learned_addr learned my addr 172.21.15.29:0/91749717 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce9579a700 1 --2- 172.21.15.29:0/91749717 >> v2:172.21.15.183:3300/0 conn(0x7fce90068cb0 0x7fce90069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce94f99700 1 --2- 172.21.15.29:0/91749717 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 0x7fce900b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce8f7fe700 1 -- 172.21.15.29:0/91749717 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211201407 0 0) 0x7fce84001110 con 0x7fce900b3370 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce8f7fe700 1 -- 172.21.15.29:0/91749717 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce78003570 con 0x7fce900b3370 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce9579a700 1 -- 172.21.15.29:0/91749717 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 msgr2=0x7fce900b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce9579a700 1 --2- 172.21.15.29:0/91749717 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 0x7fce900b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce9579a700 1 -- 172.21.15.29:0/91749717 >> v1:172.21.15.29:6789/0 conn(0x7fce900b3370 legacy=0x7fce900b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce9579a700 1 -- 172.21.15.29:0/91749717 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce900d1890 con 0x7fce90068cb0 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce9579a700 1 --2- 172.21.15.29:0/91749717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 0x7fce90069110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce800098e0 tx=0x7fce800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=103fc8e8d63fa0ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.080+0000 7fce8f7fe700 1 -- 172.21.15.29:0/91749717 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80011630 con 0x7fce90068cb0 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce8f7fe700 1 -- 172.21.15.29:0/91749717 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80011790 con 0x7fce90068cb0 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce8f7fe700 1 -- 172.21.15.29:0/91749717 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80011b10 con 0x7fce90068cb0 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce971fd700 1 -- 172.21.15.29:0/91749717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 msgr2=0x7fce90069110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce971fd700 1 --2- 172.21.15.29:0/91749717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 0x7fce90069110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce800098e0 tx=0x7fce800091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce971fd700 1 -- 172.21.15.29:0/91749717 shutdown_connections 2023-10-08T15:41:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce971fd700 1 --2- 172.21.15.29:0/91749717 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 0x7fce90069110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce971fd700 1 --2- 172.21.15.29:0/91749717 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 0x7fce900b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce971fd700 1 -- 172.21.15.29:0/91749717 >> 172.21.15.29:0/91749717 conn(0x7fce90068130 msgr2=0x7fce900d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce971fd700 1 -- 172.21.15.29:0/91749717 shutdown_connections 2023-10-08T15:41:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.081+0000 7fce971fd700 1 -- 172.21.15.29:0/91749717 wait complete. 2023-10-08T15:41:39.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.082+0000 7fce971fd700 1 Processor -- start 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.082+0000 7fce971fd700 1 -- start start 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce971fd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 0x7fce901440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce971fd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce900b3370 0x7fce90147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce971fd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 0x7fce90145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce971fd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90146720 con 0x7fce900b3370 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce971fd700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90145b10 con 0x7fce90068cb0 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce971fd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce90145df0 con 0x7fce90159e50 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce8ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce900b3370 0x7fce90147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce8ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce900b3370 0x7fce90147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36196/0 (socket says 172.21.15.29:36196) 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce8ffff700 1 -- 172.21.15.29:0/4121096063 learned_addr learned my addr 172.21.15.29:0/4121096063 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce9579a700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 0x7fce90145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce94f99700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 0x7fce901440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce8ffff700 1 -- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 msgr2=0x7fce90145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce8ffff700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 0x7fce90145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce8ffff700 1 -- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 msgr2=0x7fce901440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce8ffff700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 0x7fce901440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.083+0000 7fce8ffff700 1 -- 172.21.15.29:0/4121096063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80009420 con 0x7fce900b3370 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.084+0000 7fce8ffff700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce900b3370 0x7fce90147c20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c7c0 tx=0x7fce84007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.084+0000 7fce8cff9700 1 -- 172.21.15.29:0/4121096063 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84005b30 con 0x7fce900b3370 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.084+0000 7fce8cff9700 1 -- 172.21.15.29:0/4121096063 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce84005cb0 con 0x7fce900b3370 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.084+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce901460d0 con 0x7fce900b3370 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.084+0000 7fce8cff9700 1 -- 172.21.15.29:0/4121096063 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84007320 con 0x7fce900b3370 2023-10-08T15:41:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.084+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce90148160 con 0x7fce900b3370 2023-10-08T15:41:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.085+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9004c3c0 con 0x7fce900b3370 2023-10-08T15:41:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.085+0000 7fce8cff9700 1 -- 172.21.15.29:0/4121096063 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce84007690 con 0x7fce900b3370 2023-10-08T15:41:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.085+0000 7fce8cff9700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce7c066f30 0x7fce7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.086+0000 7fce8cff9700 1 -- 172.21.15.29:0/4121096063 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fce84083530 con 0x7fce900b3370 2023-10-08T15:41:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.086+0000 7fce94f99700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce7c066f30 0x7fce7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.086+0000 7fce94f99700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce7c066f30 0x7fce7c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce880076c0 tx=0x7fce8800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:39.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.090+0000 7fce8cff9700 1 -- 172.21.15.29:0/4121096063 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce84050af0 con 0x7fce900b3370 2023-10-08T15:41:39.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.282+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fce90063ac0 con 0x7fce900b3370 2023-10-08T15:41:39.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.844+0000 7fce8cff9700 1 -- 172.21.15.29:0/4121096063 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) v1 ==== 138+0+0 (secure 0 0 0) 0x7fce840170b0 con 0x7fce900b3370 2023-10-08T15:41:39.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce7c066f30 msgr2=0x7fce7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce7c066f30 0x7fce7c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce880076c0 tx=0x7fce8800b040 comp rx=0 tx=0).stop 2023-10-08T15:41:39.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce900b3370 msgr2=0x7fce90147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce900b3370 0x7fce90147c20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c7c0 tx=0x7fce84007c10 comp rx=0 tx=0).stop 2023-10-08T15:41:39.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 shutdown_connections 2023-10-08T15:41:39.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fce7c066f30 0x7fce7c0693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce90159e50 0x7fce90145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce90068cb0 0x7fce901440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 --2- 172.21.15.29:0/4121096063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce900b3370 0x7fce90147c20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 >> 172.21.15.29:0/4121096063 conn(0x7fce90068130 msgr2=0x7fce90158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 shutdown_connections 2023-10-08T15:41:39.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.847+0000 7fce971fd700 1 -- 172.21.15.29:0/4121096063 wait complete. 2023-10-08T15:41:39.850 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-08T15:41:39.862 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:41:39.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.990+0000 7f4493593700 1 Processor -- start 2023-10-08T15:41:39.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.990+0000 7f4493593700 1 -- start start 2023-10-08T15:41:39.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.991+0000 7f4493593700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f448c0cdaa0 0x7f448c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.991+0000 7f4493593700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0add80 con 0x7f448c159d30 2023-10-08T15:41:39.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.991+0000 7f4493593700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0cfed0 con 0x7f448c0cf690 2023-10-08T15:41:39.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.991+0000 7f4493593700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c0adbf0 con 0x7f448c0cdaa0 2023-10-08T15:41:39.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.991+0000 7f4492591700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f448c159d30 0x7f448c0cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37568/0 (socket says 172.21.15.29:37568) 2023-10-08T15:41:39.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.991+0000 7f4492591700 1 -- 172.21.15.29:0/2248441937 learned_addr learned my addr 172.21.15.29:0/2248441937 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:39.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.991+0000 7f4491d90700 1 --2- 172.21.15.29:0/2248441937 >> v2:172.21.15.183:3300/0 conn(0x7f448c0cdaa0 0x7f448c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.991+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428239155 0 0) 0x7f448c0add80 con 0x7f448c159d30 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4474003570 con 0x7f448c159d30 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2181739505 0 0) 0x7f4474003570 con 0x7f448c159d30 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 >> v2:172.21.15.183:3300/0 conn(0x7f448c0cdaa0 msgr2=0x7f448c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 --2- 172.21.15.29:0/2248441937 >> v2:172.21.15.183:3300/0 conn(0x7f448c0cdaa0 0x7f448c0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 >> v1:172.21.15.183:6789/0 conn(0x7f448c0cf690 legacy=0x7f448c0ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0d01b0 con 0x7f448c159d30 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f44840015f0 con 0x7f448c159d30 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 >> v1:172.21.15.29:6789/0 conn(0x7f448c159d30 legacy=0x7f448c0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4474003a60 0x7f4474003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f4474004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44740051c0 0x7f447400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0adbf0 con 0x7f4474004810 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447400c050 con 0x7f44740051c0 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447400c210 con 0x7f4474003a60 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4491d90700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f4474004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4492591700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4474003a60 0x7f4474003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4492d92700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44740051c0 0x7f447400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:39.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4491d90700 1 -- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4474003a60 msgr2=0x7f4474003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4491d90700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4474003a60 0x7f4474003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4491d90700 1 -- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44740051c0 msgr2=0x7f447400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4491d90700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44740051c0 0x7f447400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4491d90700 1 -- 172.21.15.29:0/2248441937 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4474003570 con 0x7f4474004810 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4492d92700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44740051c0 0x7f447400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.992+0000 7f4492d92700 1 -- 172.21.15.29:0/2248441937 reap_dead start 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f4491d90700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f4474004c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4480009c00 tx=0x7f44800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1d758f7dadd017 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448000e710 con 0x7f4474004810 2023-10-08T15:41:39.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448000e870 con 0x7f4474004810 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f449158f700 1 -- 172.21.15.29:0/2248441937 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448000ec30 con 0x7f4474004810 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f4493593700 1 -- 172.21.15.29:0/2248441937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 msgr2=0x7f4474004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f4493593700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f4474004c80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4480009c00 tx=0x7f44800091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f4493593700 1 -- 172.21.15.29:0/2248441937 shutdown_connections 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f4493593700 1 --2- 172.21.15.29:0/2248441937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f4474004c80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f4493593700 1 -- 172.21.15.29:0/2248441937 >> 172.21.15.29:0/2248441937 conn(0x7f448c099f50 msgr2=0x7f448c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f4493593700 1 -- 172.21.15.29:0/2248441937 shutdown_connections 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.993+0000 7f4493593700 1 -- 172.21.15.29:0/2248441937 wait complete. 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.994+0000 7f4493593700 1 Processor -- start 2023-10-08T15:41:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.994+0000 7f4493593700 1 -- start start 2023-10-08T15:41:40.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4493593700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f448c0c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4493593700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f448c1591f0 0x7f448c0c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4493593700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f448c15ddf0 0x7f448c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4493593700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c15e7a0 con 0x7f4474004810 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4493593700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c15b150 con 0x7f448c15ddf0 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4493593700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c0c7670 con 0x7f448c1591f0 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4492591700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f448c0c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4492591700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f448c0c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36208/0 (socket says 172.21.15.29:36208) 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4492591700 1 -- 172.21.15.29:0/2717958545 learned_addr learned my addr 172.21.15.29:0/2717958545 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4492d92700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f448c15ddf0 0x7f448c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.995+0000 7f4491d90700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f448c1591f0 0x7f448c0c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f4492591700 1 -- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f448c1591f0 msgr2=0x7f448c0c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f4492591700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f448c1591f0 0x7f448c0c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f4492591700 1 -- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f448c15ddf0 msgr2=0x7f448c15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f4492591700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f448c15ddf0 0x7f448c15e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f4492591700 1 -- 172.21.15.29:0/2717958545 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0c5610 con 0x7f4474004810 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f4492591700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f448c0c4fe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4484007fd0 tx=0x7f4484009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f448a7fc700 1 -- 172.21.15.29:0/2717958545 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840073b0 con 0x7f4474004810 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f448a7fc700 1 -- 172.21.15.29:0/2717958545 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484007510 con 0x7f4474004810 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c0c58f0 con 0x7f4474004810 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f448a7fc700 1 -- 172.21.15.29:0/2717958545 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484005a40 con 0x7f4474004810 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.996+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c0c5eb0 con 0x7f4474004810 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.997+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c06ada0 con 0x7f4474004810 2023-10-08T15:41:40.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.997+0000 7f448a7fc700 1 -- 172.21.15.29:0/2717958545 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f448400d710 con 0x7f4474004810 2023-10-08T15:41:40.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.998+0000 7f448a7fc700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4478066f30 0x7f44780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:40.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.998+0000 7f448a7fc700 1 -- 172.21.15.29:0/2717958545 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f4484084570 con 0x7f4474004810 2023-10-08T15:41:40.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.998+0000 7f4491d90700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4478066f30 0x7f44780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:40.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:39.998+0000 7f4491d90700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4478066f30 0x7f44780693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f44800091e0 tx=0x7f448001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:40.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.002+0000 7f448a7fc700 1 -- 172.21.15.29:0/2717958545 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44840519c0 con 0x7f4474004810 2023-10-08T15:41:40.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.195+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f448c15af20 con 0x7f4474004810 2023-10-08T15:41:40.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.850+0000 7f448a7fc700 1 -- 172.21.15.29:0/2717958545 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4484054fe0 con 0x7f4474004810 2023-10-08T15:41:40.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.857+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4478066f30 msgr2=0x7f44780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.857+0000 7f4493593700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4478066f30 0x7f44780693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f44800091e0 tx=0x7f448001a000 comp rx=0 tx=0).stop 2023-10-08T15:41:40.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.857+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 msgr2=0x7f448c0c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.857+0000 7f4493593700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f448c0c4fe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4484007fd0 tx=0x7f4484009040 comp rx=0 tx=0).stop 2023-10-08T15:41:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.859+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 shutdown_connections 2023-10-08T15:41:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.859+0000 7f4493593700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4478066f30 0x7f44780693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.859+0000 7f4493593700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f448c15ddf0 0x7f448c15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.859+0000 7f4493593700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4474004810 0x7f448c0c4fe0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.859+0000 7f4493593700 1 --2- 172.21.15.29:0/2717958545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f448c1591f0 0x7f448c0c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.859+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 >> 172.21.15.29:0/2717958545 conn(0x7f448c099f50 msgr2=0x7f448c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:40.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.859+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 shutdown_connections 2023-10-08T15:41:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:40.860+0000 7f4493593700 1 -- 172.21.15.29:0/2717958545 wait complete. 2023-10-08T15:41:40.863 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-08T15:41:40.876 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:41:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.000+0000 7f6d0f27b700 1 Processor -- start 2023-10-08T15:41:41.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.000+0000 7f6d0f27b700 1 -- start start 2023-10-08T15:41:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.001+0000 7f6d0f27b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d0815db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.001+0000 7f6d0f27b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6d080c9390 0x7f6d0815a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.001+0000 7f6d0f27b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d080cae70 con 0x7f6d080cbf10 2023-10-08T15:41:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.001+0000 7f6d0f27b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d080cb150 con 0x7f6d080c9390 2023-10-08T15:41:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.001+0000 7f6d0f27b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080cb430 con 0x7f6d080678b0 2023-10-08T15:41:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.001+0000 7f6d0d017700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d0815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.001+0000 7f6d0d818700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6d080c9390 0x7f6d0815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d0c816700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6d080cbf10 0x7f6d0815e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:47988/0 (socket says 172.21.15.29:47988) 2023-10-08T15:41:41.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d0c816700 1 -- 172.21.15.29:0/2634797136 learned_addr learned my addr 172.21.15.29:0/2634797136 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d07fff700 1 -- 172.21.15.29:0/2634797136 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240562932 0 0) 0x7f6d080cae70 con 0x7f6d080cbf10 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d07fff700 1 -- 172.21.15.29:0/2634797136 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf0003570 con 0x7f6d080cbf10 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d0d017700 1 -- 172.21.15.29:0/2634797136 >> v2:172.21.15.183:3300/0 conn(0x7f6d080c9390 msgr2=0x7f6d0815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d0d017700 1 --2- 172.21.15.29:0/2634797136 >> v2:172.21.15.183:3300/0 conn(0x7f6d080c9390 0x7f6d0815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d0d017700 1 -- 172.21.15.29:0/2634797136 >> v1:172.21.15.183:6789/0 conn(0x7f6d080cbf10 legacy=0x7f6d0815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d0d017700 1 -- 172.21.15.29:0/2634797136 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080cb710 con 0x7f6d080678b0 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d0d818700 1 --2- 172.21.15.29:0/2634797136 >> v2:172.21.15.183:3300/0 conn(0x7f6d080c9390 0x7f6d0815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d0d017700 1 --2- 172.21.15.29:0/2634797136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d0815db80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009e60 tx=0x7f6d00009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef930960fe5120eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d07fff700 1 -- 172.21.15.29:0/2634797136 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000e070 con 0x7f6d080678b0 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d07fff700 1 -- 172.21.15.29:0/2634797136 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000bab0 con 0x7f6d080678b0 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.002+0000 7f6d07fff700 1 -- 172.21.15.29:0/2634797136 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000be30 con 0x7f6d080678b0 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.003+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2634797136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 msgr2=0x7f6d0815db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.003+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2634797136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d0815db80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009e60 tx=0x7f6d00009780 comp rx=0 tx=0).stop 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.003+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2634797136 shutdown_connections 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.003+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2634797136 >> v2:172.21.15.183:3300/0 conn(0x7f6d080c9390 0x7f6d0815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.003+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2634797136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d0815db80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.003+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2634797136 >> 172.21.15.29:0/2634797136 conn(0x7f6d08069870 msgr2=0x7f6d08069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:41.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.003+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2634797136 shutdown_connections 2023-10-08T15:41:41.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.003+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2634797136 wait complete. 2023-10-08T15:41:41.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.004+0000 7f6d0f27b700 1 Processor -- start 2023-10-08T15:41:41.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.004+0000 7f6d0f27b700 1 -- start start 2023-10-08T15:41:41.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0f27b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d080ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0f27b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d080c9390 0x7f6d080cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0f27b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d080cbf10 0x7f6d081507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0f27b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08169fa0 con 0x7f6d080c9390 2023-10-08T15:41:41.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0f27b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c6a30 con 0x7f6d080cbf10 2023-10-08T15:41:41.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0f27b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080cd5d0 con 0x7f6d080678b0 2023-10-08T15:41:41.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0c816700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d080c9390 0x7f6d080cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0c816700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d080c9390 0x7f6d080cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36212/0 (socket says 172.21.15.29:36212) 2023-10-08T15:41:41.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0c816700 1 -- 172.21.15.29:0/2860875253 learned_addr learned my addr 172.21.15.29:0/2860875253 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:41.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0d818700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d080cbf10 0x7f6d081507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.010 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0d017700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d080ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0c816700 1 -- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 msgr2=0x7f6d080ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0c816700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d080ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0c816700 1 -- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d080cbf10 msgr2=0x7f6d081507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0c816700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d080cbf10 0x7f6d081507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.005+0000 7f6d0c816700 1 -- 172.21.15.29:0/2860875253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8009420 con 0x7f6d080c9390 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.006+0000 7f6d0c816700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d080c9390 0x7f6d080cf600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00c590 tx=0x7f6cfc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.006+0000 7f6d057fa700 1 -- 172.21.15.29:0/2860875253 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc005cd0 con 0x7f6d080c9390 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.006+0000 7f6d057fa700 1 -- 172.21.15.29:0/2860875253 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc005e50 con 0x7f6d080c9390 2023-10-08T15:41:41.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.006+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d00009a20 con 0x7f6d080c9390 2023-10-08T15:41:41.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.006+0000 7f6d057fa700 1 -- 172.21.15.29:0/2860875253 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc007320 con 0x7f6d080c9390 2023-10-08T15:41:41.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.006+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0816a180 con 0x7f6d080c9390 2023-10-08T15:41:41.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.007+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0804c3c0 con 0x7f6d080c9390 2023-10-08T15:41:41.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.007+0000 7f6d057fa700 1 -- 172.21.15.29:0/2860875253 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cfc01b3b0 con 0x7f6d080c9390 2023-10-08T15:41:41.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.008+0000 7f6d057fa700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.008+0000 7f6d057fa700 1 -- 172.21.15.29:0/2860875253 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6cfc083b40 con 0x7f6d080c9390 2023-10-08T15:41:41.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.008+0000 7f6d0d017700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.008+0000 7f6d0d017700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6cf4066f30 0x7f6cf40693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d000097c0 tx=0x7f6d00019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.012+0000 7f6d057fa700 1 -- 172.21.15.29:0/2860875253 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cfc050ed0 con 0x7f6d080c9390 2023-10-08T15:41:41.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.250+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6d08068da0 con 0x7f6d080c9390 2023-10-08T15:41:41.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.851+0000 7f6d057fa700 1 -- 172.21.15.29:0/2860875253 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6cfc017020 con 0x7f6d080c9390 2023-10-08T15:41:41.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.854+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6cf4066f30 msgr2=0x7f6cf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.854+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6cf4066f30 0x7f6cf40693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d000097c0 tx=0x7f6d00019000 comp rx=0 tx=0).stop 2023-10-08T15:41:41.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.854+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d080c9390 msgr2=0x7f6d080cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.854+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d080c9390 0x7f6d080cf600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00c590 tx=0x7f6cfc007e00 comp rx=0 tx=0).stop 2023-10-08T15:41:41.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.857+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 shutdown_connections 2023-10-08T15:41:41.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.857+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6cf4066f30 0x7f6cf40693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.857+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d080cbf10 0x7f6d081507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.857+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d080678b0 0x7f6d080ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.857+0000 7f6d0f27b700 1 --2- 172.21.15.29:0/2860875253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d080c9390 0x7f6d080cf600 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.857+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 >> 172.21.15.29:0/2860875253 conn(0x7f6d08069870 msgr2=0x7f6d080b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:41.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.857+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 shutdown_connections 2023-10-08T15:41:41.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.857+0000 7f6d0f27b700 1 -- 172.21.15.29:0/2860875253 wait complete. 2023-10-08T15:41:41.858 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 6 and data pool 7 2023-10-08T15:41:41.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:41.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.992+0000 7efc2a642700 1 Processor -- start 2023-10-08T15:41:41.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.992+0000 7efc2a642700 1 -- start start 2023-10-08T15:41:41.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.993+0000 7efc2a642700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc241523e0 0x7efc2406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.993+0000 7efc2a642700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2406c010 con 0x7efc24152010 2023-10-08T15:41:41.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.993+0000 7efc2a642700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2406bd10 con 0x7efc24158e50 2023-10-08T15:41:41.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.993+0000 7efc2a642700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2415c060 con 0x7efc241523e0 2023-10-08T15:41:41.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.993+0000 7efc23fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efc24152010 0x7efc2415b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37570/0 (socket says 172.21.15.29:37570) 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.993+0000 7efc23fff700 1 -- 172.21.15.29:0/1445802329 learned_addr learned my addr 172.21.15.29:0/1445802329 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc237fe700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc241523e0 0x7efc2406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646450362 0 0) 0x7efc2406c010 con 0x7efc24152010 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc10003570 con 0x7efc24152010 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476179562 0 0) 0x7efc2406bd10 con 0x7efc24158e50 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc2406c010 con 0x7efc24158e50 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448325282 0 0) 0x7efc10003570 con 0x7efc24152010 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc241523e0 msgr2=0x7efc2406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc241523e0 0x7efc2406c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 >> v1:172.21.15.183:6789/0 conn(0x7efc24158e50 legacy=0x7efc240cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2415c340 con 0x7efc24152010 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7efc0c001470 con 0x7efc24152010 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 >> v1:172.21.15.29:6789/0 conn(0x7efc24152010 legacy=0x7efc2415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc241523e0 0x7efc10003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004180 0x7efc10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc10004d50 0x7efc100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2415c060 con 0x7efc10004d50 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1000bba0 con 0x7efc10004180 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1000bd60 con 0x7efc241523e0 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc28bdf700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc10004d50 0x7efc100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc23fff700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc241523e0 0x7efc10003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.994+0000 7efc237fe700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004180 0x7efc10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:41.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc28bdf700 1 -- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc241523e0 msgr2=0x7efc10003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc28bdf700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc241523e0 0x7efc10003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc28bdf700 1 -- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004180 msgr2=0x7efc10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc28bdf700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004180 0x7efc10004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc28bdf700 1 -- 172.21.15.29:0/1445802329 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10003570 con 0x7efc10004d50 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc28bdf700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc10004d50 0x7efc100051c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efc1c002120 tx=0x7efc1c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6959a4ca533eb4b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c001ab0 con 0x7efc10004d50 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c00c980 con 0x7efc10004d50 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc22ffd700 1 -- 172.21.15.29:0/1445802329 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c00cd20 con 0x7efc10004d50 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc2a642700 1 -- 172.21.15.29:0/1445802329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc10004d50 msgr2=0x7efc100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc2a642700 1 --2- 172.21.15.29:0/1445802329 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc10004d50 0x7efc100051c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efc1c002120 tx=0x7efc1c0017a0 comp rx=0 tx=0).stop 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc28bdf700 1 -- 172.21.15.29:0/1445802329 reap_dead start 2023-10-08T15:41:41.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc2a642700 1 -- 172.21.15.29:0/1445802329 shutdown_connections 2023-10-08T15:41:42.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.995+0000 7efc2a642700 1 -- 172.21.15.29:0/1445802329 >> 172.21.15.29:0/1445802329 conn(0x7efc24069870 msgr2=0x7efc24069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.996+0000 7efc2a642700 1 -- 172.21.15.29:0/1445802329 shutdown_connections 2023-10-08T15:41:42.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.996+0000 7efc2a642700 1 -- 172.21.15.29:0/1445802329 wait complete. 2023-10-08T15:41:42.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.997+0000 7efc2a642700 1 Processor -- start 2023-10-08T15:41:42.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.997+0000 7efc2a642700 1 -- start start 2023-10-08T15:41:42.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.997+0000 7efc2a642700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004d50 0x7efc24150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.997+0000 7efc2a642700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc240c6770 0x7efc240c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.997+0000 7efc2a642700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc240b2660 0x7efc240b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.997+0000 7efc2a642700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc240c7d90 con 0x7efc240c6770 2023-10-08T15:41:42.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.997+0000 7efc2a642700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc240b1ea0 con 0x7efc10004d50 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.997+0000 7efc2a642700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc240c74f0 con 0x7efc240b2660 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc240c6770 0x7efc240c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc240c6770 0x7efc240c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36222/0 (socket says 172.21.15.29:36222) 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 -- 172.21.15.29:0/1838992948 learned_addr learned my addr 172.21.15.29:0/1838992948 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc28bdf700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc240b2660 0x7efc240b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc23fff700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004d50 0x7efc24150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 -- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc240b2660 msgr2=0x7efc240b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc240b2660 0x7efc240b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 -- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004d50 msgr2=0x7efc24150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004d50 0x7efc24150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 -- 172.21.15.29:0/1838992948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc240c77d0 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc237fe700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc240c6770 0x7efc240c6be0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efc14011b40 tx=0x7efc140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc1bfff700 1 -- 172.21.15.29:0/1838992948 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1400f940 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc1bfff700 1 -- 172.21.15.29:0/1838992948 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1400faa0 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc240c7ab0 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc1bfff700 1 -- 172.21.15.29:0/1838992948 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1400fe20 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.998+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc240c7120 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:41.999+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2404c3c0 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.000+0000 7efc1bfff700 1 -- 172.21.15.29:0/1838992948 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc14014650 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.000+0000 7efc1bfff700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc04066f30 0x7efc040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.000+0000 7efc1bfff700 1 -- 172.21.15.29:0/1838992948 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc14018030 con 0x7efc240c6770 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.000+0000 7efc23fff700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc04066f30 0x7efc040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.001+0000 7efc23fff700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc04066f30 0x7efc040693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc0c001200 tx=0x7efc0c001df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.004+0000 7efc1bfff700 1 -- 172.21.15.29:0/1838992948 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc140b65a0 con 0x7efc240c6770 2023-10-08T15:41:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.198+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc240b24b0 con 0x7efc240c6770 2023-10-08T15:41:42.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.199+0000 7efc1bfff700 1 -- 172.21.15.29:0/1838992948 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15363 (secure 0 0 0) 0x7efc14022090 con 0x7efc240c6770 2023-10-08T15:41:42.200 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:42.200 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":44,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:41.251538+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:39.312324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:40.225704+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc04066f30 msgr2=0x7efc040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc04066f30 0x7efc040693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc0c001200 tx=0x7efc0c001df0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc240c6770 msgr2=0x7efc240c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc240c6770 0x7efc240c6be0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efc14011b40 tx=0x7efc140091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 shutdown_connections 2023-10-08T15:41:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc04066f30 0x7efc040693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.202 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc240b2660 0x7efc240b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc10004d50 0x7efc24150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 --2- 172.21.15.29:0/1838992948 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc240c6770 0x7efc240c6be0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 >> 172.21.15.29:0/1838992948 conn(0x7efc24069870 msgr2=0x7efc240ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 shutdown_connections 2023-10-08T15:41:42.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.201+0000 7efc2a642700 1 -- 172.21.15.29:0/1838992948 wait complete. 2023-10-08T15:41:42.214 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:42.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.332+0000 7fee66873700 1 Processor -- start 2023-10-08T15:41:42.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.332+0000 7fee66873700 1 -- start start 2023-10-08T15:41:42.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee66873700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee60156ea0 0x7fee600c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee66873700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fee60157270 0x7fee6006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee66873700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee6006e2b0 0x7fee6006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee66873700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6006ec70 con 0x7fee6006e2b0 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee66873700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee600c42b0 con 0x7fee60157270 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee66873700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee600c36a0 con 0x7fee60156ea0 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee64e10700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee6006e2b0 0x7fee6006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee64e10700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fee6006e2b0 0x7fee6006e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36230/0 (socket says 172.21.15.29:36230) 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee64e10700 1 -- 172.21.15.29:0/3680322961 learned_addr learned my addr 172.21.15.29:0/3680322961 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee5f7fe700 1 --2- 172.21.15.29:0/3680322961 >> v2:172.21.15.183:3300/0 conn(0x7fee60157270 0x7fee6006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.333+0000 7fee5ffff700 1 --2- 172.21.15.29:0/3680322961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee60156ea0 0x7fee600c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee64e10700 1 -- 172.21.15.29:0/3680322961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee60156ea0 msgr2=0x7fee600c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee64e10700 1 --2- 172.21.15.29:0/3680322961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee60156ea0 0x7fee600c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee64e10700 1 -- 172.21.15.29:0/3680322961 >> v2:172.21.15.183:3300/0 conn(0x7fee60157270 msgr2=0x7fee6006f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee64e10700 1 --2- 172.21.15.29:0/3680322961 >> v2:172.21.15.183:3300/0 conn(0x7fee60157270 0x7fee6006f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee64e10700 1 -- 172.21.15.29:0/3680322961 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600c3980 con 0x7fee6006e2b0 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee64e10700 1 --2- 172.21.15.29:0/3680322961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6006e2b0 0x7fee6006e730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fee6006d140 tx=0x7fee58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6694a71eb87e9bc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee5effd700 1 -- 172.21.15.29:0/3680322961 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5800e070 con 0x7fee6006e2b0 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee5effd700 1 -- 172.21.15.29:0/3680322961 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5800b970 con 0x7fee6006e2b0 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.334+0000 7fee5effd700 1 -- 172.21.15.29:0/3680322961 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580092e0 con 0x7fee6006e2b0 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 -- 172.21.15.29:0/3680322961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6006e2b0 msgr2=0x7fee6006e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 --2- 172.21.15.29:0/3680322961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6006e2b0 0x7fee6006e730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fee6006d140 tx=0x7fee58009840 comp rx=0 tx=0).stop 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 -- 172.21.15.29:0/3680322961 shutdown_connections 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 --2- 172.21.15.29:0/3680322961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee6006e2b0 0x7fee6006e730 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 --2- 172.21.15.29:0/3680322961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee60156ea0 0x7fee600c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 --2- 172.21.15.29:0/3680322961 >> v2:172.21.15.183:3300/0 conn(0x7fee60157270 0x7fee6006f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 -- 172.21.15.29:0/3680322961 >> 172.21.15.29:0/3680322961 conn(0x7fee600ca4f0 msgr2=0x7fee600ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 -- 172.21.15.29:0/3680322961 shutdown_connections 2023-10-08T15:41:42.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.335+0000 7fee66873700 1 -- 172.21.15.29:0/3680322961 wait complete. 2023-10-08T15:41:42.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.336+0000 7fee66873700 1 Processor -- start 2023-10-08T15:41:42.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.336+0000 7fee66873700 1 -- start start 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee66873700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee6006e2b0 0x7fee600c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee66873700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee60156ea0 0x7fee60143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee66873700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee60157270 0x7fee600c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee66873700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6016cc20 con 0x7fee60157270 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee66873700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee60168630 con 0x7fee60156ea0 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee66873700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6016c0a0 con 0x7fee6006e2b0 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee60157270 0x7fee600c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee60157270 0x7fee600c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36234/0 (socket says 172.21.15.29:36234) 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 -- 172.21.15.29:0/3663096908 learned_addr learned my addr 172.21.15.29:0/3663096908 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee5ffff700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee6006e2b0 0x7fee600c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee5f7fe700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee60156ea0 0x7fee60143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 -- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee6006e2b0 msgr2=0x7fee600c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee6006e2b0 0x7fee600c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 -- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee60156ea0 msgr2=0x7fee60143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee60156ea0 0x7fee60143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 -- 172.21.15.29:0/3663096908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58009ae0 con 0x7fee60157270 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee64e10700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee60157270 0x7fee600c9110 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee58009880 tx=0x7fee58018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee47fff700 1 -- 172.21.15.29:0/3663096908 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58008b10 con 0x7fee60157270 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee47fff700 1 -- 172.21.15.29:0/3663096908 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee58008c70 con 0x7fee60157270 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6016c380 con 0x7fee60157270 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.337+0000 7fee47fff700 1 -- 172.21.15.29:0/3663096908 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58026460 con 0x7fee60157270 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.338+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6016c940 con 0x7fee60157270 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.339+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6004c3c0 con 0x7fee60157270 2023-10-08T15:41:42.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.339+0000 7fee47fff700 1 -- 172.21.15.29:0/3663096908 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee58003040 con 0x7fee60157270 2023-10-08T15:41:42.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.339+0000 7fee47fff700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee4c066f60 0x7fee4c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.339+0000 7fee47fff700 1 -- 172.21.15.29:0/3663096908 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee58086360 con 0x7fee60157270 2023-10-08T15:41:42.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.339+0000 7fee5ffff700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee4c066f60 0x7fee4c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.340+0000 7fee5ffff700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee4c066f60 0x7fee4c069410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee60068da0 tx=0x7fee500091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.343+0000 7fee47fff700 1 -- 172.21.15.29:0/3663096908 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee580535d0 con 0x7fee60157270 2023-10-08T15:41:42.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.537+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee600b38b0 con 0x7fee60157270 2023-10-08T15:41:42.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.538+0000 7fee47fff700 1 -- 172.21.15.29:0/3663096908 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fee58056bf0 con 0x7fee60157270 2023-10-08T15:41:42.539 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:42.539 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":45,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:42.477224+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:39.312324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:40.225704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:42.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee4c066f60 msgr2=0x7fee4c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee4c066f60 0x7fee4c069410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee60068da0 tx=0x7fee500091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee60157270 msgr2=0x7fee600c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee60157270 0x7fee600c9110 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee58009880 tx=0x7fee58018000 comp rx=0 tx=0).stop 2023-10-08T15:41:42.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 shutdown_connections 2023-10-08T15:41:42.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fee4c066f60 0x7fee4c069410 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee60157270 0x7fee600c9110 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee6006e2b0 0x7fee600c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 --2- 172.21.15.29:0/3663096908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee60156ea0 0x7fee60143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.540+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 >> 172.21.15.29:0/3663096908 conn(0x7fee600ca4f0 msgr2=0x7fee600cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.541+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 shutdown_connections 2023-10-08T15:41:42.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.541+0000 7fee66873700 1 -- 172.21.15.29:0/3663096908 wait complete. 2023-10-08T15:41:42.553 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:41:42.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.675+0000 7ff0e20f4700 1 Processor -- start 2023-10-08T15:41:42.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.675+0000 7ff0e20f4700 1 -- start start 2023-10-08T15:41:42.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0e20f4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 0x7ff0dc0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0e20f4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0dc15a290 0x7ff0dc0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0e20f4700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff0dc06a5a0 0x7ff0dc06aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0e20f4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc06af60 con 0x7ff0dc15a290 2023-10-08T15:41:42.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0e20f4700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b0790 con 0x7ff0dc06a5a0 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0e20f4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0ce1f0 con 0x7ff0dc159ec0 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0daffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0dc15a290 0x7ff0dc0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0daffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0dc15a290 0x7ff0dc0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36246/0 (socket says 172.21.15.29:36246) 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0daffd700 1 -- 172.21.15.29:0/1175970910 learned_addr learned my addr 172.21.15.29:0/1175970910 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0dbfff700 1 --2- 172.21.15.29:0/1175970910 >> v2:172.21.15.183:3300/0 conn(0x7ff0dc06a5a0 0x7ff0dc06aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.676+0000 7ff0db7fe700 1 --2- 172.21.15.29:0/1175970910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 0x7ff0dc0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0daffd700 1 -- 172.21.15.29:0/1175970910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 msgr2=0x7ff0dc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0daffd700 1 --2- 172.21.15.29:0/1175970910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 0x7ff0dc0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0daffd700 1 -- 172.21.15.29:0/1175970910 >> v2:172.21.15.183:3300/0 conn(0x7ff0dc06a5a0 msgr2=0x7ff0dc06aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0daffd700 1 --2- 172.21.15.29:0/1175970910 >> v2:172.21.15.183:3300/0 conn(0x7ff0dc06a5a0 0x7ff0dc06aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0daffd700 1 -- 172.21.15.29:0/1175970910 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0b0b20 con 0x7ff0dc15a290 2023-10-08T15:41:42.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0daffd700 1 --2- 172.21.15.29:0/1175970910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0afe80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0b03c0 tx=0x7ff0d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd888e33aa6159b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0da7fc700 1 -- 172.21.15.29:0/1175970910 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000b860 con 0x7ff0dc15a290 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0da7fc700 1 -- 172.21.15.29:0/1175970910 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000b9c0 con 0x7ff0dc15a290 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0da7fc700 1 -- 172.21.15.29:0/1175970910 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000bd60 con 0x7ff0dc15a290 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 -- 172.21.15.29:0/1175970910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 msgr2=0x7ff0dc0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/1175970910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0afe80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0b03c0 tx=0x7ff0d0009250 comp rx=0 tx=0).stop 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 -- 172.21.15.29:0/1175970910 shutdown_connections 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/1175970910 >> v2:172.21.15.183:3300/0 conn(0x7ff0dc06a5a0 0x7ff0dc06aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/1175970910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 0x7ff0dc0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/1175970910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0afe80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 -- 172.21.15.29:0/1175970910 >> 172.21.15.29:0/1175970910 conn(0x7ff0dc0d1880 msgr2=0x7ff0dc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:42.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 -- 172.21.15.29:0/1175970910 shutdown_connections 2023-10-08T15:41:42.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.677+0000 7ff0e20f4700 1 -- 172.21.15.29:0/1175970910 wait complete. 2023-10-08T15:41:42.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.679+0000 7ff0e20f4700 1 Processor -- start 2023-10-08T15:41:42.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.679+0000 7ff0e20f4700 1 -- start start 2023-10-08T15:41:42.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.679+0000 7ff0e20f4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0dc06a5a0 0x7ff0dc157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.679+0000 7ff0e20f4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 0x7ff0dc16a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.679+0000 7ff0e20f4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.679+0000 7ff0e20f4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0cbd10 con 0x7ff0dc15a290 2023-10-08T15:41:42.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.679+0000 7ff0e20f4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc158220 con 0x7ff0dc06a5a0 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.679+0000 7ff0e20f4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc15e140 con 0x7ff0dc159ec0 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36260/0 (socket says 172.21.15.29:36260) 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 -- 172.21.15.29:0/18160400 learned_addr learned my addr 172.21.15.29:0/18160400 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0db7fe700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0dc06a5a0 0x7ff0dc157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0daffd700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 0x7ff0dc16a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 -- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 msgr2=0x7ff0dc16a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 0x7ff0dc16a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 -- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0dc06a5a0 msgr2=0x7ff0dc157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0dc06a5a0 0x7ff0dc157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 -- 172.21.15.29:0/18160400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00094f0 con 0x7ff0dc15a290 2023-10-08T15:41:42.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0dbfff700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0c7e60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009fa0 tx=0x7ff0d4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0c37fe700 1 -- 172.21.15.29:0/18160400 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400eb60 con 0x7ff0dc15a290 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0c37fe700 1 -- 172.21.15.29:0/18160400 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400ecc0 con 0x7ff0dc15a290 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0cb4b0 con 0x7ff0dc15a290 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0c37fe700 1 -- 172.21.15.29:0/18160400 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4014670 con 0x7ff0dc15a290 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.680+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc0cba30 con 0x7ff0dc15a290 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.681+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc04c3c0 con 0x7ff0dc15a290 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.682+0000 7ff0c37fe700 1 -- 172.21.15.29:0/18160400 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0d40149e0 con 0x7ff0dc15a290 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.682+0000 7ff0c37fe700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.682+0000 7ff0c37fe700 1 -- 172.21.15.29:0/18160400 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0d4084ae0 con 0x7ff0dc15a290 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.682+0000 7ff0db7fe700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:42.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.683+0000 7ff0db7fe700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff0c8066f30 0x7ff0c80693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc006fd0 tx=0x7ff0cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:42.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.686+0000 7ff0c37fe700 1 -- 172.21.15.29:0/18160400 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0d4051d50 con 0x7ff0dc15a290 2023-10-08T15:41:42.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:42.926+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0dc0b04b0 con 0x7ff0dc15a290 2023-10-08T15:41:43.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.868+0000 7ff0c37fe700 1 -- 172.21.15.29:0/18160400 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff0d4055370 con 0x7ff0dc15a290 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff0c8066f30 msgr2=0x7ff0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff0c8066f30 0x7ff0c80693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc006fd0 tx=0x7ff0cc008040 comp rx=0 tx=0).stop 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 msgr2=0x7ff0dc0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0c7e60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009fa0 tx=0x7ff0d4009900 comp rx=0 tx=0).stop 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 shutdown_connections 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff0c8066f30 0x7ff0c80693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0dc15a290 0x7ff0dc0c7e60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0dc06a5a0 0x7ff0dc157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 --2- 172.21.15.29:0/18160400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0dc159ec0 0x7ff0dc16a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:43.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 >> 172.21.15.29:0/18160400 conn(0x7ff0dc0d1880 msgr2=0x7ff0dc158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:43.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 shutdown_connections 2023-10-08T15:41:43.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:43.871+0000 7ff0e20f4700 1 -- 172.21.15.29:0/18160400 wait complete. 2023-10-08T15:41:43.885 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:41:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.011+0000 7f801c82e700 1 Processor -- start 2023-10-08T15:41:44.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.011+0000 7f801c82e700 1 -- start start 2023-10-08T15:41:44.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f801c82e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f801815a300 0x7f801815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f801c82e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 0x7f80180cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f801c82e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f80180cb970 0x7f801815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f801c82e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80180cc760 con 0x7f80180cb970 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f801c82e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801815b460 con 0x7f801815a300 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f801c82e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801815ba20 con 0x7f801815ac10 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f8017fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f80180cb970 0x7f801815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f8017fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f80180cb970 0x7f801815beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36266/0 (socket says 172.21.15.29:36266) 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f8017fff700 1 -- 172.21.15.29:0/735238531 learned_addr learned my addr 172.21.15.29:0/735238531 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f80177fe700 1 --2- 172.21.15.29:0/735238531 >> v2:172.21.15.183:3300/0 conn(0x7f801815a300 0x7f801815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f8017fff700 1 -- 172.21.15.29:0/735238531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 msgr2=0x7f80180cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.012+0000 7f8016ffd700 1 --2- 172.21.15.29:0/735238531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 0x7f80180cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f8017fff700 1 --2- 172.21.15.29:0/735238531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 0x7f80180cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f8017fff700 1 -- 172.21.15.29:0/735238531 >> v2:172.21.15.183:3300/0 conn(0x7f801815a300 msgr2=0x7f801815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f8017fff700 1 --2- 172.21.15.29:0/735238531 >> v2:172.21.15.183:3300/0 conn(0x7f801815a300 0x7f801815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f8017fff700 1 -- 172.21.15.29:0/735238531 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180cc1a0 con 0x7f80180cb970 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f8017fff700 1 --2- 172.21.15.29:0/735238531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80180cb970 0x7f801815beb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8018064440 tx=0x7f8010009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df47ff026251b57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f80167fc700 1 -- 172.21.15.29:0/735238531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000e070 con 0x7f80180cb970 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f80167fc700 1 -- 172.21.15.29:0/735238531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801000ba50 con 0x7f80180cb970 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f80167fc700 1 -- 172.21.15.29:0/735238531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80100092e0 con 0x7f80180cb970 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 -- 172.21.15.29:0/735238531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80180cb970 msgr2=0x7f801815beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 --2- 172.21.15.29:0/735238531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80180cb970 0x7f801815beb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8018064440 tx=0x7f8010009840 comp rx=0 tx=0).stop 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 -- 172.21.15.29:0/735238531 shutdown_connections 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 --2- 172.21.15.29:0/735238531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80180cb970 0x7f801815beb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 --2- 172.21.15.29:0/735238531 >> v2:172.21.15.183:3300/0 conn(0x7f801815a300 0x7f801815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 --2- 172.21.15.29:0/735238531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 0x7f80180cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 -- 172.21.15.29:0/735238531 >> 172.21.15.29:0/735238531 conn(0x7f8018099f50 msgr2=0x7f8018067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 -- 172.21.15.29:0/735238531 shutdown_connections 2023-10-08T15:41:44.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.013+0000 7f801c82e700 1 -- 172.21.15.29:0/735238531 wait complete. 2023-10-08T15:41:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f801c82e700 1 Processor -- start 2023-10-08T15:41:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f801c82e700 1 -- start start 2023-10-08T15:41:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f801c82e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80180cb970 0x7f801814f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f801c82e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f801815a300 0x7f801815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f801c82e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 0x7f80180695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f801c82e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180d02b0 con 0x7f801815a300 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f801c82e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801815bfe0 con 0x7f80180cb970 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f801c82e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80180c61f0 con 0x7f801815ac10 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.015+0000 7f8016ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f801815a300 0x7f801815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8016ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f801815a300 0x7f801815c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36268/0 (socket says 172.21.15.29:36268) 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8016ffd700 1 -- 172.21.15.29:0/2756485833 learned_addr learned my addr 172.21.15.29:0/2756485833 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8017fff700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 0x7f80180695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f80177fe700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80180cb970 0x7f801814f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8016ffd700 1 -- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 msgr2=0x7f80180695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8016ffd700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 0x7f80180695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8016ffd700 1 -- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80180cb970 msgr2=0x7f801814f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8016ffd700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80180cb970 0x7f801814f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8016ffd700 1 -- 172.21.15.29:0/2756485833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8010009ae0 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f8016ffd700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f801815a300 0x7f801815c470 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c7d0 tx=0x7f800c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f7fff7fe700 1 -- 172.21.15.29:0/2756485833 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c011600 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f7fff7fe700 1 -- 172.21.15.29:0/2756485833 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c011760 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80180c64d0 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f7fff7fe700 1 -- 172.21.15.29:0/2756485833 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c011b20 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.016+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80180c6b10 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.017+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801815c190 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.018+0000 7f7fff7fe700 1 -- 172.21.15.29:0/2756485833 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f800c0193f0 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.018+0000 7f7fff7fe700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8004066f30 0x7f80040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.018+0000 7f7fff7fe700 1 -- 172.21.15.29:0/2756485833 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f800c0847f0 con 0x7f801815a300 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.018+0000 7f80177fe700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8004066f30 0x7f80040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:44.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.019+0000 7f80177fe700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8004066f30 0x7f80040693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8008006fd0 tx=0x7f8008008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:44.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.022+0000 7f7fff7fe700 1 -- 172.21.15.29:0/2756485833 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f801815c190 con 0x7f801815a300 2023-10-08T15:41:44.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.261+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f801815c150 con 0x7f801815a300 2023-10-08T15:41:44.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.873+0000 7f7fff7fe700 1 -- 172.21.15.29:0/2756485833 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f800c051a60 con 0x7f801815a300 2023-10-08T15:41:44.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8004066f30 msgr2=0x7f80040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8004066f30 0x7f80040693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8008006fd0 tx=0x7f8008008040 comp rx=0 tx=0).stop 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f801815a300 msgr2=0x7f801815c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f801815a300 0x7f801815c470 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c7d0 tx=0x7f800c008040 comp rx=0 tx=0).stop 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 shutdown_connections 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8004066f30 0x7f80040693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f801815ac10 0x7f80180695e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80180cb970 0x7f801814f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 --2- 172.21.15.29:0/2756485833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f801815a300 0x7f801815c470 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 >> 172.21.15.29:0/2756485833 conn(0x7f8018099f50 msgr2=0x7f80181502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 shutdown_connections 2023-10-08T15:41:44.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:44.876+0000 7f801c82e700 1 -- 172.21.15.29:0/2756485833 wait complete. 2023-10-08T15:41:44.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:45.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.013+0000 7f1a9f561700 1 Processor -- start 2023-10-08T15:41:45.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.014+0000 7f1a9f561700 1 -- start start 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.014+0000 7f1a9f561700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a98158e50 0x7f1a980cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.014+0000 7f1a9f561700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9806c010 con 0x7f1a981523e0 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.014+0000 7f1a9f561700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9806bd10 con 0x7f1a98152010 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.014+0000 7f1a9f561700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9815c060 con 0x7f1a98158e50 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a9dafe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a98158e50 0x7f1a980cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a9cafc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1a981523e0 0x7f1a9806c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37572/0 (socket says 172.21.15.29:37572) 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a9cafc700 1 -- 172.21.15.29:0/3076384397 learned_addr learned my addr 172.21.15.29:0/3076384397 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a9dafe700 1 -- 172.21.15.29:0/3076384397 >> v1:172.21.15.183:6789/0 conn(0x7f1a98152010 legacy=0x7f1a9815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a9dafe700 1 -- 172.21.15.29:0/3076384397 >> v1:172.21.15.29:6789/0 conn(0x7f1a981523e0 legacy=0x7f1a9806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a9dafe700 1 -- 172.21.15.29:0/3076384397 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9815c340 con 0x7f1a98158e50 2023-10-08T15:41:45.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a9dafe700 1 --2- 172.21.15.29:0/3076384397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98158e50 0x7f1a980cb750 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009e60 tx=0x7f1a88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef72f77f0be821a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a97fff700 1 -- 172.21.15.29:0/3076384397 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800e070 con 0x7f1a98158e50 2023-10-08T15:41:45.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a97fff700 1 -- 172.21.15.29:0/3076384397 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800bc30 con 0x7f1a98158e50 2023-10-08T15:41:45.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.015+0000 7f1a97fff700 1 -- 172.21.15.29:0/3076384397 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88012430 con 0x7f1a98158e50 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.016+0000 7f1a9f561700 1 -- 172.21.15.29:0/3076384397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98158e50 msgr2=0x7f1a980cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.016+0000 7f1a9f561700 1 --2- 172.21.15.29:0/3076384397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98158e50 0x7f1a980cb750 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009e60 tx=0x7f1a88009780 comp rx=0 tx=0).stop 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.016+0000 7f1a9f561700 1 -- 172.21.15.29:0/3076384397 shutdown_connections 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.016+0000 7f1a9f561700 1 --2- 172.21.15.29:0/3076384397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98158e50 0x7f1a980cb750 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.016+0000 7f1a9f561700 1 -- 172.21.15.29:0/3076384397 >> 172.21.15.29:0/3076384397 conn(0x7f1a98069870 msgr2=0x7f1a98069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.016+0000 7f1a9f561700 1 -- 172.21.15.29:0/3076384397 shutdown_connections 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.016+0000 7f1a9f561700 1 -- 172.21.15.29:0/3076384397 wait complete. 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.017+0000 7f1a9f561700 1 Processor -- start 2023-10-08T15:41:45.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.017+0000 7f1a9f561700 1 -- start start 2023-10-08T15:41:45.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9f561700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98152010 0x7f1a9814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9f561700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a981523e0 0x7f1a98159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9f561700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a98158e50 0x7f1a9815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9f561700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9815b170 con 0x7f1a98152010 2023-10-08T15:41:45.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9f561700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980b2e40 con 0x7f1a98158e50 2023-10-08T15:41:45.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9f561700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980b3120 con 0x7f1a981523e0 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9d2fd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98152010 0x7f1a9814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9d2fd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98152010 0x7f1a9814e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36286/0 (socket says 172.21.15.29:36286) 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9d2fd700 1 -- 172.21.15.29:0/3885421417 learned_addr learned my addr 172.21.15.29:0/3885421417 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9d2fd700 1 -- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a981523e0 msgr2=0x7f1a98159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9d2fd700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a981523e0 0x7f1a98159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9d2fd700 1 -- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a98158e50 msgr2=0x7f1a9815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9dafe700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a98158e50 0x7f1a9815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9d2fd700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a98158e50 0x7f1a9815a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.018+0000 7f1a9d2fd700 1 -- 172.21.15.29:0/3885421417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009a20 con 0x7f1a98152010 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.019+0000 7f1a9d2fd700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98152010 0x7f1a9814e3b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c790 tx=0x7f1a90007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.019+0000 7f1a957fa700 1 -- 172.21.15.29:0/3885421417 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011590 con 0x7f1a98152010 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.019+0000 7f1a957fa700 1 -- 172.21.15.29:0/3885421417 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90011710 con 0x7f1a98152010 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.019+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a980b3400 con 0x7f1a98152010 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.019+0000 7f1a957fa700 1 -- 172.21.15.29:0/3885421417 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011ad0 con 0x7f1a98152010 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.019+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a980c5f80 con 0x7f1a98152010 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.020+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a980c6200 con 0x7f1a98152010 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.020+0000 7f1a957fa700 1 -- 172.21.15.29:0/3885421417 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a9001b3b0 con 0x7f1a98152010 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.021+0000 7f1a957fa700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a84066f30 0x7f1a840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.021+0000 7f1a957fa700 1 -- 172.21.15.29:0/3885421417 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a90083a50 con 0x7f1a98152010 2023-10-08T15:41:45.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.021+0000 7f1a9cafc700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a84066f30 0x7f1a840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.021+0000 7f1a9cafc700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a84066f30 0x7f1a840693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c007fd0 tx=0x7f1a8c007b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.025+0000 7f1a957fa700 1 -- 172.21.15.29:0/3885421417 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a90050cc0 con 0x7f1a98152010 2023-10-08T15:41:45.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.262+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a9804c3c0 con 0x7f1a98152010 2023-10-08T15:41:45.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.262+0000 7f1a957fa700 1 -- 172.21.15.29:0/3885421417 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f1a90017070 con 0x7f1a98152010 2023-10-08T15:41:45.263 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:45.263 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a84066f30 msgr2=0x7f1a840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a84066f30 0x7f1a840693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c007fd0 tx=0x7f1a8c007b00 comp rx=0 tx=0).stop 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98152010 msgr2=0x7f1a9814e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98152010 0x7f1a9814e3b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c790 tx=0x7f1a90007f40 comp rx=0 tx=0).stop 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 shutdown_connections 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a84066f30 0x7f1a840693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a98158e50 0x7f1a9815a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a98152010 0x7f1a9814e3b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 --2- 172.21.15.29:0/3885421417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a981523e0 0x7f1a98159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 >> 172.21.15.29:0/3885421417 conn(0x7f1a98069870 msgr2=0x7f1a98151320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:45.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 shutdown_connections 2023-10-08T15:41:45.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.264+0000 7f1a9f561700 1 -- 172.21.15.29:0/3885421417 wait complete. 2023-10-08T15:41:45.266 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:41:45.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:41:45.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.395+0000 7f363ddd1700 1 Processor -- start 2023-10-08T15:41:45.396 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.395+0000 7f363ddd1700 1 -- start start 2023-10-08T15:41:45.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f363ddd1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36380b0890 0x7f36380cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f363ddd1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 0x7f3638067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f363ddd1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f363806c630 0x7f3638067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f363ddd1700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36380cb370 con 0x7f36380b0890 2023-10-08T15:41:45.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f363ddd1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36380b0c60 con 0x7f363806c630 2023-10-08T15:41:45.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f363ddd1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363806a1e0 con 0x7f36380cbd40 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f36377fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36380b0890 0x7f36380cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f36377fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f36380b0890 0x7f36380cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36300/0 (socket says 172.21.15.29:36300) 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f36377fe700 1 -- 172.21.15.29:0/3647163725 learned_addr learned my addr 172.21.15.29:0/3647163725 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f36377fe700 1 -- 172.21.15.29:0/3647163725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 msgr2=0x7f3638067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f36377fe700 1 --2- 172.21.15.29:0/3647163725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 0x7f3638067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f36377fe700 1 -- 172.21.15.29:0/3647163725 >> v2:172.21.15.183:3300/0 conn(0x7f363806c630 msgr2=0x7f3638067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f3637fff700 1 --2- 172.21.15.29:0/3647163725 >> v2:172.21.15.183:3300/0 conn(0x7f363806c630 0x7f3638067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f36377fe700 1 --2- 172.21.15.29:0/3647163725 >> v2:172.21.15.183:3300/0 conn(0x7f363806c630 0x7f3638067ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.399 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.396+0000 7f36377fe700 1 -- 172.21.15.29:0/3647163725 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363806cb80 con 0x7f36380b0890 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f36377fe700 1 --2- 172.21.15.29:0/3647163725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380cb800 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3638071430 tx=0x7f3628009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa55a78f1183583f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f36367fc700 1 -- 172.21.15.29:0/3647163725 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800b860 con 0x7f36380b0890 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f36367fc700 1 -- 172.21.15.29:0/3647163725 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362800b9c0 con 0x7f36380b0890 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f36367fc700 1 -- 172.21.15.29:0/3647163725 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800bd60 con 0x7f36380b0890 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 -- 172.21.15.29:0/3647163725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 msgr2=0x7f36380cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3647163725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380cb800 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3638071430 tx=0x7f3628009250 comp rx=0 tx=0).stop 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 -- 172.21.15.29:0/3647163725 shutdown_connections 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3647163725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380cb800 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3647163725 >> v2:172.21.15.183:3300/0 conn(0x7f363806c630 0x7f3638067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3647163725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 0x7f3638067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 -- 172.21.15.29:0/3647163725 >> 172.21.15.29:0/3647163725 conn(0x7f363806fe50 msgr2=0x7f3638069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:45.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 -- 172.21.15.29:0/3647163725 shutdown_connections 2023-10-08T15:41:45.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.397+0000 7f363ddd1700 1 -- 172.21.15.29:0/3647163725 wait complete. 2023-10-08T15:41:45.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f363ddd1700 1 Processor -- start 2023-10-08T15:41:45.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f363ddd1700 1 -- start start 2023-10-08T15:41:45.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f363ddd1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363806c630 0x7f36380c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f363ddd1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.403 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f363ddd1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 0x7f36380c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f363ddd1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36380c2f90 con 0x7f36380b0890 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f363ddd1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36380c8840 con 0x7f363806c630 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f363ddd1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36380c31e0 con 0x7f36380cbd40 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f3636ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f3636ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36302/0 (socket says 172.21.15.29:36302) 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.399+0000 7f3636ffd700 1 -- 172.21.15.29:0/3074665995 learned_addr learned my addr 172.21.15.29:0/3074665995 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f3637fff700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 0x7f36380c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f36377fe700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363806c630 0x7f36380c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f3636ffd700 1 -- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 msgr2=0x7f36380c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f3636ffd700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 0x7f36380c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.404 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f3636ffd700 1 -- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363806c630 msgr2=0x7f36380c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f3636ffd700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363806c630 0x7f36380c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f3636ffd700 1 -- 172.21.15.29:0/3074665995 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280094f0 con 0x7f36380b0890 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f3636ffd700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380c3fa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f362c00b5e0 tx=0x7f362c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f361f7fe700 1 -- 172.21.15.29:0/3074665995 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00f510 con 0x7f36380b0890 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f361f7fe700 1 -- 172.21.15.29:0/3074665995 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c00f670 con 0x7f36380b0890 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f361f7fe700 1 -- 172.21.15.29:0/3074665995 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c00fa30 con 0x7f36380b0890 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36380c34c0 con 0x7f36380b0890 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.400+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36380c3a80 con 0x7f36380b0890 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.401+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363804c3c0 con 0x7f36380b0890 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.401+0000 7f361f7fe700 1 -- 172.21.15.29:0/3074665995 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f362c01a400 con 0x7f36380b0890 2023-10-08T15:41:45.405 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.402+0000 7f361f7fe700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3624066f30 0x7f36240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.402+0000 7f361f7fe700 1 -- 172.21.15.29:0/3074665995 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f362c083e30 con 0x7f36380b0890 2023-10-08T15:41:45.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.402+0000 7f36377fe700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3624066f30 0x7f36240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.403+0000 7f36377fe700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3624066f30 0x7f36240693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3638071430 tx=0x7f3628017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.406+0000 7f361f7fe700 1 -- 172.21.15.29:0/3074665995 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f362c051120 con 0x7f36380b0890 2023-10-08T15:41:45.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.599+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f363806cdc0 con 0x7f36380b0890 2023-10-08T15:41:45.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.599+0000 7f361f7fe700 1 -- 172.21.15.29:0/3074665995 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f362c054740 con 0x7f36380b0890 2023-10-08T15:41:45.600 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:45.600 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":45,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:41:42.477224+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:39.312324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:40.225704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:41:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.601+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3624066f30 msgr2=0x7f36240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.601+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3624066f30 0x7f36240693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3638071430 tx=0x7f3628017000 comp rx=0 tx=0).stop 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.601+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 msgr2=0x7f36380c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.601+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380c3fa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f362c00b5e0 tx=0x7f362c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.602+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 shutdown_connections 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.602+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3624066f30 0x7f36240693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.602+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36380cbd40 0x7f36380c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.602+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f363806c630 0x7f36380c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.602+0000 7f363ddd1700 1 --2- 172.21.15.29:0/3074665995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36380b0890 0x7f36380c3fa0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.602+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 >> 172.21.15.29:0/3074665995 conn(0x7f363806fe50 msgr2=0x7f3638067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.602+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 shutdown_connections 2023-10-08T15:41:45.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.602+0000 7f363ddd1700 1 -- 172.21.15.29:0/3074665995 wait complete. 2023-10-08T15:41:45.614 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:41:45.615 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:41:45.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.733+0000 7f96634c1700 1 Processor -- start 2023-10-08T15:41:45.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.733+0000 7f96634c1700 1 -- start start 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96634c1700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f965c0cbfa0 0x7f965c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96634c1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f965c0cc370 0x7f965c06a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96634c1700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c068340 con 0x7f965c06a5a0 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96634c1700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c06abd0 con 0x7f965c0cbfa0 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96634c1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c06f040 con 0x7f965c0cc370 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96624bf700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f965c0cbfa0 0x7f965c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96624bf700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f965c0cbfa0 0x7f965c0687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36316/0 (socket says 172.21.15.29:36316) 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96624bf700 1 -- 172.21.15.29:0/2959875891 learned_addr learned my addr 172.21.15.29:0/2959875891 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:45.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f9661cbe700 1 --2- 172.21.15.29:0/2959875891 >> v2:172.21.15.183:3300/0 conn(0x7f965c0cc370 0x7f965c06a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96624bf700 1 -- 172.21.15.29:0/2959875891 >> v2:172.21.15.183:3300/0 conn(0x7f965c0cc370 msgr2=0x7f965c06a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96624bf700 1 --2- 172.21.15.29:0/2959875891 >> v2:172.21.15.183:3300/0 conn(0x7f965c0cc370 0x7f965c06a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96624bf700 1 -- 172.21.15.29:0/2959875891 >> v1:172.21.15.183:6789/0 conn(0x7f965c06a5a0 legacy=0x7f965c156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.734+0000 7f96624bf700 1 -- 172.21.15.29:0/2959875891 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c067a10 con 0x7f965c0cbfa0 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96624bf700 1 --2- 172.21.15.29:0/2959875891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c0cbfa0 0x7f965c0687d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f965c06f6a0 tx=0x7f9654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2a799ad68237cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96614bd700 1 -- 172.21.15.29:0/2959875891 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654009e70 con 0x7f965c0cbfa0 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96614bd700 1 -- 172.21.15.29:0/2959875891 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965400b860 con 0x7f965c0cbfa0 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96614bd700 1 -- 172.21.15.29:0/2959875891 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965400bc00 con 0x7f965c0cbfa0 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96634c1700 1 -- 172.21.15.29:0/2959875891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c0cbfa0 msgr2=0x7f965c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96634c1700 1 --2- 172.21.15.29:0/2959875891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c0cbfa0 0x7f965c0687d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f965c06f6a0 tx=0x7f9654009250 comp rx=0 tx=0).stop 2023-10-08T15:41:45.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96634c1700 1 -- 172.21.15.29:0/2959875891 shutdown_connections 2023-10-08T15:41:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96634c1700 1 --2- 172.21.15.29:0/2959875891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c0cbfa0 0x7f965c0687d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96634c1700 1 --2- 172.21.15.29:0/2959875891 >> v2:172.21.15.183:3300/0 conn(0x7f965c0cc370 0x7f965c06a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96634c1700 1 -- 172.21.15.29:0/2959875891 >> 172.21.15.29:0/2959875891 conn(0x7f965c0cd8f0 msgr2=0x7f965c0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96634c1700 1 -- 172.21.15.29:0/2959875891 shutdown_connections 2023-10-08T15:41:45.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.735+0000 7f96634c1700 1 -- 172.21.15.29:0/2959875891 wait complete. 2023-10-08T15:41:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.736+0000 7f96634c1700 1 Processor -- start 2023-10-08T15:41:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96634c1700 1 -- start start 2023-10-08T15:41:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96634c1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c06a5a0 0x7f965c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96634c1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f965c0cbfa0 0x7f965c156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96634c1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f965c0cc370 0x7f965c166f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96634c1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c152f60 con 0x7f965c06a5a0 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96634c1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c158590 con 0x7f965c0cc370 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96634c1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c159110 con 0x7f965c0cbfa0 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96624bf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c06a5a0 0x7f965c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96624bf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c06a5a0 0x7f965c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36320/0 (socket says 172.21.15.29:36320) 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f96624bf700 1 -- 172.21.15.29:0/400894168 learned_addr learned my addr 172.21.15.29:0/400894168 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f9661cbe700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f965c0cbfa0 0x7f965c156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.737+0000 7f9662cc0700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f965c0cc370 0x7f965c166f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f96624bf700 1 -- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f965c0cbfa0 msgr2=0x7f965c156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f96624bf700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f965c0cbfa0 0x7f965c156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f96624bf700 1 -- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f965c0cc370 msgr2=0x7f965c166f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f96624bf700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f965c0cc370 0x7f965c166f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f96624bf700 1 -- 172.21.15.29:0/400894168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540094f0 con 0x7f965c06a5a0 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f9661cbe700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f965c0cbfa0 0x7f965c156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f9662cc0700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f965c0cc370 0x7f965c166f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f96624bf700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c06a5a0 0x7f965c157770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9654006fd0 tx=0x7f9654017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f965a7fc700 1 -- 172.21.15.29:0/400894168 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654011420 con 0x7f965c06a5a0 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f965a7fc700 1 -- 172.21.15.29:0/400894168 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96540115a0 con 0x7f965c06a5a0 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c156850 con 0x7f965c06a5a0 2023-10-08T15:41:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f965a7fc700 1 -- 172.21.15.29:0/400894168 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654011960 con 0x7f965c06a5a0 2023-10-08T15:41:45.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.738+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c158ac0 con 0x7f965c06a5a0 2023-10-08T15:41:45.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.739+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c06d5d0 con 0x7f965c06a5a0 2023-10-08T15:41:45.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.739+0000 7f965a7fc700 1 -- 172.21.15.29:0/400894168 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96540253f0 con 0x7f965c06a5a0 2023-10-08T15:41:45.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.740+0000 7f965a7fc700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9648066f30 0x7f96480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:45.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.740+0000 7f965a7fc700 1 -- 172.21.15.29:0/400894168 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9654085da0 con 0x7f965c06a5a0 2023-10-08T15:41:45.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.740+0000 7f9661cbe700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9648066f30 0x7f96480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:45.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.741+0000 7f9661cbe700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9648066f30 0x7f96480693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f965c0b2b40 tx=0x7f9650008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:45.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.744+0000 7f965a7fc700 1 -- 172.21.15.29:0/400894168 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9654053010 con 0x7f965c06a5a0 2023-10-08T15:41:45.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.933+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f965c159250 con 0x7f9648066f30 2023-10-08T15:41:45.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.942+0000 7f965a7fc700 1 -- 172.21.15.29:0/400894168 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284875 (secure 0 0 0) 0x7f9650009aa0 con 0x7f9648066f30 2023-10-08T15:41:45.946 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:45.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9648066f30 msgr2=0x7f96480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9648066f30 0x7f96480693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f965c0b2b40 tx=0x7f9650008040 comp rx=0 tx=0).stop 2023-10-08T15:41:45.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c06a5a0 msgr2=0x7f965c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:45.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c06a5a0 0x7f965c157770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9654006fd0 tx=0x7f9654017000 comp rx=0 tx=0).stop 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 shutdown_connections 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9648066f30 0x7f96480693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f965c0cc370 0x7f965c166f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f965c06a5a0 0x7f965c157770 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 --2- 172.21.15.29:0/400894168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f965c0cbfa0 0x7f965c156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 >> 172.21.15.29:0/400894168 conn(0x7f965c0cd8f0 msgr2=0x7f965c153ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 shutdown_connections 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:45.945+0000 7f96634c1700 1 -- 172.21.15.29:0/400894168 wait complete. 2023-10-08T15:41:45.949 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:41:45.958 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-08T15:41:44.320434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2814,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559685,"statfs":{"total":1600000000,"available":1597117540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.473226"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492730+0000","last_change":"2023-10-08T15:41:41.492632+0000","last_active":"2023-10-08T15:41:41.492730+0000","last_peered":"2023-10-08T15:41:41.492730+0000","last_clean":"2023-10-08T15:41:41.492730+0000","last_became_active":"2023-10-08T15:41:41.492389+0000","last_became_peered":"2023-10-08T15:41:41.492389+0000","last_unstale":"2023-10-08T15:41:41.492730+0000","last_undegraded":"2023-10-08T15:41:41.492730+0000","last_fullsized":"2023-10-08T15:41:41.492730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492935+0000","last_change":"2023-10-08T15:41:41.492865+0000","last_active":"2023-10-08T15:41:41.492935+0000","last_peered":"2023-10-08T15:41:41.492935+0000","last_clean":"2023-10-08T15:41:41.492935+0000","last_became_active":"2023-10-08T15:41:41.492478+0000","last_became_peered":"2023-10-08T15:41:41.492478+0000","last_unstale":"2023-10-08T15:41:41.492935+0000","last_undegraded":"2023-10-08T15:41:41.492935+0000","last_fullsized":"2023-10-08T15:41:41.492935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:53:30.269214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494117+0000","last_change":"2023-10-08T15:41:41.493062+0000","last_active":"2023-10-08T15:41:41.494117+0000","last_peered":"2023-10-08T15:41:41.494117+0000","last_clean":"2023-10-08T15:41:41.494117+0000","last_became_active":"2023-10-08T15:41:41.492309+0000","last_became_peered":"2023-10-08T15:41:41.492309+0000","last_unstale":"2023-10-08T15:41:41.494117+0000","last_undegraded":"2023-10-08T15:41:41.494117+0000","last_fullsized":"2023-10-08T15:41:41.494117+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:06.428214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492308+0000","last_change":"2023-10-08T15:41:41.490189+0000","last_active":"2023-10-08T15:41:41.492308+0000","last_peered":"2023-10-08T15:41:41.492308+0000","last_clean":"2023-10-08T15:41:41.492308+0000","last_became_active":"2023-10-08T15:41:41.489797+0000","last_became_peered":"2023-10-08T15:41:41.489797+0000","last_unstale":"2023-10-08T15:41:41.492308+0000","last_undegraded":"2023-10-08T15:41:41.492308+0000","last_fullsized":"2023-10-08T15:41:41.492308+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:48.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494754+0000","last_change":"2023-10-08T15:41:41.494690+0000","last_active":"2023-10-08T15:41:41.494754+0000","last_peered":"2023-10-08T15:41:41.494754+0000","last_clean":"2023-10-08T15:41:41.494754+0000","last_became_active":"2023-10-08T15:41:41.494425+0000","last_became_peered":"2023-10-08T15:41:41.494425+0000","last_unstale":"2023-10-08T15:41:41.494754+0000","last_undegraded":"2023-10-08T15:41:41.494754+0000","last_fullsized":"2023-10-08T15:41:41.494754+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.493761+0000","last_change":"2023-10-08T15:41:41.492888+0000","last_active":"2023-10-08T15:41:41.493761+0000","last_peered":"2023-10-08T15:41:41.493761+0000","last_clean":"2023-10-08T15:41:41.493761+0000","last_became_active":"2023-10-08T15:41:41.492517+0000","last_became_peered":"2023-10-08T15:41:41.492517+0000","last_unstale":"2023-10-08T15:41:41.493761+0000","last_undegraded":"2023-10-08T15:41:41.493761+0000","last_fullsized":"2023-10-08T15:41:41.493761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:57.929963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487788+0000","last_change":"2023-10-08T15:41:41.487722+0000","last_active":"2023-10-08T15:41:41.487788+0000","last_peered":"2023-10-08T15:41:41.487788+0000","last_clean":"2023-10-08T15:41:41.487788+0000","last_became_active":"2023-10-08T15:41:41.487478+0000","last_became_peered":"2023-10-08T15:41:41.487478+0000","last_unstale":"2023-10-08T15:41:41.487788+0000","last_undegraded":"2023-10-08T15:41:41.487788+0000","last_fullsized":"2023-10-08T15:41:41.487788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:34:37.318279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494184+0000","last_change":"2023-10-08T15:41:41.493311+0000","last_active":"2023-10-08T15:41:41.494184+0000","last_peered":"2023-10-08T15:41:41.494184+0000","last_clean":"2023-10-08T15:41:41.494184+0000","last_became_active":"2023-10-08T15:41:41.493095+0000","last_became_peered":"2023-10-08T15:41:41.493095+0000","last_unstale":"2023-10-08T15:41:41.494184+0000","last_undegraded":"2023-10-08T15:41:41.494184+0000","last_fullsized":"2023-10-08T15:41:41.494184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.509283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494167+0000","last_change":"2023-10-08T15:41:41.493251+0000","last_active":"2023-10-08T15:41:41.494167+0000","last_peered":"2023-10-08T15:41:41.494167+0000","last_clean":"2023-10-08T15:41:41.494167+0000","last_became_active":"2023-10-08T15:41:41.492301+0000","last_became_peered":"2023-10-08T15:41:41.492301+0000","last_unstale":"2023-10-08T15:41:41.494167+0000","last_undegraded":"2023-10-08T15:41:41.494167+0000","last_fullsized":"2023-10-08T15:41:41.494167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:36.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494229+0000","last_change":"2023-10-08T15:41:41.494101+0000","last_active":"2023-10-08T15:41:41.494229+0000","last_peered":"2023-10-08T15:41:41.494229+0000","last_clean":"2023-10-08T15:41:41.494229+0000","last_became_active":"2023-10-08T15:41:41.493597+0000","last_became_peered":"2023-10-08T15:41:41.493597+0000","last_unstale":"2023-10-08T15:41:41.494229+0000","last_undegraded":"2023-10-08T15:41:41.494229+0000","last_fullsized":"2023-10-08T15:41:41.494229+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:35.429197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492367+0000","last_change":"2023-10-08T15:41:41.492298+0000","last_active":"2023-10-08T15:41:41.492367+0000","last_peered":"2023-10-08T15:41:41.492367+0000","last_clean":"2023-10-08T15:41:41.492367+0000","last_became_active":"2023-10-08T15:41:41.491971+0000","last_became_peered":"2023-10-08T15:41:41.491971+0000","last_unstale":"2023-10-08T15:41:41.492367+0000","last_undegraded":"2023-10-08T15:41:41.492367+0000","last_fullsized":"2023-10-08T15:41:41.492367+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:06.428214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487959+0000","last_change":"2023-10-08T15:41:41.487313+0000","last_active":"2023-10-08T15:41:41.487959+0000","last_peered":"2023-10-08T15:41:41.487959+0000","last_clean":"2023-10-08T15:41:41.487959+0000","last_became_active":"2023-10-08T15:41:41.487003+0000","last_became_peered":"2023-10-08T15:41:41.487003+0000","last_unstale":"2023-10-08T15:41:41.487959+0000","last_undegraded":"2023-10-08T15:41:41.487959+0000","last_fullsized":"2023-10-08T15:41:41.487959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:03.026140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.481926+0000","last_change":"2023-10-08T15:41:41.481792+0000","last_active":"2023-10-08T15:41:41.481926+0000","last_peered":"2023-10-08T15:41:41.481926+0000","last_clean":"2023-10-08T15:41:41.481926+0000","last_became_active":"2023-10-08T15:41:41.481585+0000","last_became_peered":"2023-10-08T15:41:41.481585+0000","last_unstale":"2023-10-08T15:41:41.481926+0000","last_undegraded":"2023-10-08T15:41:41.481926+0000","last_fullsized":"2023-10-08T15:41:41.481926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:59.711982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494153+0000","last_change":"2023-10-08T15:41:41.493104+0000","last_active":"2023-10-08T15:41:41.494153+0000","last_peered":"2023-10-08T15:41:41.494153+0000","last_clean":"2023-10-08T15:41:41.494153+0000","last_became_active":"2023-10-08T15:41:41.492115+0000","last_became_peered":"2023-10-08T15:41:41.492115+0000","last_unstale":"2023-10-08T15:41:41.494153+0000","last_undegraded":"2023-10-08T15:41:41.494153+0000","last_fullsized":"2023-10-08T15:41:41.494153+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.483960+0000","last_change":"2023-10-08T15:41:41.483862+0000","last_active":"2023-10-08T15:41:41.483960+0000","last_peered":"2023-10-08T15:41:41.483960+0000","last_clean":"2023-10-08T15:41:41.483960+0000","last_became_active":"2023-10-08T15:41:41.483621+0000","last_became_peered":"2023-10-08T15:41:41.483621+0000","last_unstale":"2023-10-08T15:41:41.483960+0000","last_undegraded":"2023-10-08T15:41:41.483960+0000","last_fullsized":"2023-10-08T15:41:41.483960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:34:37.318279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494093+0000","last_change":"2023-10-08T15:41:41.494033+0000","last_active":"2023-10-08T15:41:41.494093+0000","last_peered":"2023-10-08T15:41:41.494093+0000","last_clean":"2023-10-08T15:41:41.494093+0000","last_became_active":"2023-10-08T15:41:41.493678+0000","last_became_peered":"2023-10-08T15:41:41.493678+0000","last_unstale":"2023-10-08T15:41:41.494093+0000","last_undegraded":"2023-10-08T15:41:41.494093+0000","last_fullsized":"2023-10-08T15:41:41.494093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:21.427885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492439+0000","last_change":"2023-10-08T15:41:41.492238+0000","last_active":"2023-10-08T15:41:41.492439+0000","last_peered":"2023-10-08T15:41:41.492439+0000","last_clean":"2023-10-08T15:41:41.492439+0000","last_became_active":"2023-10-08T15:41:41.491667+0000","last_became_peered":"2023-10-08T15:41:41.491667+0000","last_unstale":"2023-10-08T15:41:41.492439+0000","last_undegraded":"2023-10-08T15:41:41.492439+0000","last_fullsized":"2023-10-08T15:41:41.492439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.509283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494324+0000","last_change":"2023-10-08T15:41:41.494225+0000","last_active":"2023-10-08T15:41:41.494324+0000","last_peered":"2023-10-08T15:41:41.494324+0000","last_clean":"2023-10-08T15:41:41.494324+0000","last_became_active":"2023-10-08T15:41:41.493861+0000","last_became_peered":"2023-10-08T15:41:41.493861+0000","last_unstale":"2023-10-08T15:41:41.494324+0000","last_undegraded":"2023-10-08T15:41:41.494324+0000","last_fullsized":"2023-10-08T15:41:41.494324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.493671+0000","last_change":"2023-10-08T15:41:41.493587+0000","last_active":"2023-10-08T15:41:41.493671+0000","last_peered":"2023-10-08T15:41:41.493671+0000","last_clean":"2023-10-08T15:41:41.493671+0000","last_became_active":"2023-10-08T15:41:41.493253+0000","last_became_peered":"2023-10-08T15:41:41.493253+0000","last_unstale":"2023-10-08T15:41:41.493671+0000","last_undegraded":"2023-10-08T15:41:41.493671+0000","last_fullsized":"2023-10-08T15:41:41.493671+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:00.603058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494051+0000","last_change":"2023-10-08T15:41:41.494010+0000","last_active":"2023-10-08T15:41:41.494051+0000","last_peered":"2023-10-08T15:41:41.494051+0000","last_clean":"2023-10-08T15:41:41.494051+0000","last_became_active":"2023-10-08T15:41:41.493816+0000","last_became_peered":"2023-10-08T15:41:41.493816+0000","last_unstale":"2023-10-08T15:41:41.494051+0000","last_undegraded":"2023-10-08T15:41:41.494051+0000","last_fullsized":"2023-10-08T15:41:41.494051+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:29.505306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484461+0000","last_change":"2023-10-08T15:41:41.484407+0000","last_active":"2023-10-08T15:41:41.484461+0000","last_peered":"2023-10-08T15:41:41.484461+0000","last_clean":"2023-10-08T15:41:41.484461+0000","last_became_active":"2023-10-08T15:41:41.484033+0000","last_became_peered":"2023-10-08T15:41:41.484033+0000","last_unstale":"2023-10-08T15:41:41.484461+0000","last_undegraded":"2023-10-08T15:41:41.484461+0000","last_fullsized":"2023-10-08T15:41:41.484461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:43.976680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494143+0000","last_change":"2023-10-08T15:41:41.493102+0000","last_active":"2023-10-08T15:41:41.494143+0000","last_peered":"2023-10-08T15:41:41.494143+0000","last_clean":"2023-10-08T15:41:41.494143+0000","last_became_active":"2023-10-08T15:41:41.492550+0000","last_became_peered":"2023-10-08T15:41:41.492550+0000","last_unstale":"2023-10-08T15:41:41.494143+0000","last_undegraded":"2023-10-08T15:41:41.494143+0000","last_fullsized":"2023-10-08T15:41:41.494143+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:53:30.269214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489211+0000","last_change":"2023-10-08T15:41:41.489149+0000","last_active":"2023-10-08T15:41:41.489211+0000","last_peered":"2023-10-08T15:41:41.489211+0000","last_clean":"2023-10-08T15:41:41.489211+0000","last_became_active":"2023-10-08T15:41:41.488762+0000","last_became_peered":"2023-10-08T15:41:41.488762+0000","last_unstale":"2023-10-08T15:41:41.489211+0000","last_undegraded":"2023-10-08T15:41:41.489211+0000","last_fullsized":"2023-10-08T15:41:41.489211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:37.428453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489786+0000","last_change":"2023-10-08T15:41:41.489613+0000","last_active":"2023-10-08T15:41:41.489786+0000","last_peered":"2023-10-08T15:41:41.489786+0000","last_clean":"2023-10-08T15:41:41.489786+0000","last_became_active":"2023-10-08T15:41:41.489160+0000","last_became_peered":"2023-10-08T15:41:41.489160+0000","last_unstale":"2023-10-08T15:41:41.489786+0000","last_undegraded":"2023-10-08T15:41:41.489786+0000","last_fullsized":"2023-10-08T15:41:41.489786+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:04:26.890835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489227+0000","last_change":"2023-10-08T15:41:41.489165+0000","last_active":"2023-10-08T15:41:41.489227+0000","last_peered":"2023-10-08T15:41:41.489227+0000","last_clean":"2023-10-08T15:41:41.489227+0000","last_became_active":"2023-10-08T15:41:41.488777+0000","last_became_peered":"2023-10-08T15:41:41.488777+0000","last_unstale":"2023-10-08T15:41:41.489227+0000","last_undegraded":"2023-10-08T15:41:41.489227+0000","last_fullsized":"2023-10-08T15:41:41.489227+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:24.764033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.483114+0000","last_change":"2023-10-08T15:41:41.483050+0000","last_active":"2023-10-08T15:41:41.483114+0000","last_peered":"2023-10-08T15:41:41.483114+0000","last_clean":"2023-10-08T15:41:41.483114+0000","last_became_active":"2023-10-08T15:41:41.482758+0000","last_became_peered":"2023-10-08T15:41:41.482758+0000","last_unstale":"2023-10-08T15:41:41.483114+0000","last_undegraded":"2023-10-08T15:41:41.483114+0000","last_fullsized":"2023-10-08T15:41:41.483114+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:30.947121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492455+0000","last_change":"2023-10-08T15:41:41.492369+0000","last_active":"2023-10-08T15:41:41.492455+0000","last_peered":"2023-10-08T15:41:41.492455+0000","last_clean":"2023-10-08T15:41:41.492455+0000","last_became_active":"2023-10-08T15:41:41.492006+0000","last_became_peered":"2023-10-08T15:41:41.492006+0000","last_unstale":"2023-10-08T15:41:41.492455+0000","last_undegraded":"2023-10-08T15:41:41.492455+0000","last_fullsized":"2023-10-08T15:41:41.492455+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:03.026140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486899+0000","last_change":"2023-10-08T15:41:41.486774+0000","last_active":"2023-10-08T15:41:41.486899+0000","last_peered":"2023-10-08T15:41:41.486899+0000","last_clean":"2023-10-08T15:41:41.486899+0000","last_became_active":"2023-10-08T15:41:41.486332+0000","last_became_peered":"2023-10-08T15:41:41.486332+0000","last_unstale":"2023-10-08T15:41:41.486899+0000","last_undegraded":"2023-10-08T15:41:41.486899+0000","last_fullsized":"2023-10-08T15:41:41.486899+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:15.262018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486312+0000","last_change":"2023-10-08T15:41:41.486197+0000","last_active":"2023-10-08T15:41:41.486312+0000","last_peered":"2023-10-08T15:41:41.486312+0000","last_clean":"2023-10-08T15:41:41.486312+0000","last_became_active":"2023-10-08T15:41:41.485978+0000","last_became_peered":"2023-10-08T15:41:41.485978+0000","last_unstale":"2023-10-08T15:41:41.486312+0000","last_undegraded":"2023-10-08T15:41:41.486312+0000","last_fullsized":"2023-10-08T15:41:41.486312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:20.071526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494174+0000","last_change":"2023-10-08T15:41:41.494123+0000","last_active":"2023-10-08T15:41:41.494174+0000","last_peered":"2023-10-08T15:41:41.494174+0000","last_clean":"2023-10-08T15:41:41.494174+0000","last_became_active":"2023-10-08T15:41:41.493444+0000","last_became_peered":"2023-10-08T15:41:41.493444+0000","last_unstale":"2023-10-08T15:41:41.494174+0000","last_undegraded":"2023-10-08T15:41:41.494174+0000","last_fullsized":"2023-10-08T15:41:41.494174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:50.020144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492798+0000","last_change":"2023-10-08T15:41:41.492738+0000","last_active":"2023-10-08T15:41:41.492798+0000","last_peered":"2023-10-08T15:41:41.492798+0000","last_clean":"2023-10-08T15:41:41.492798+0000","last_became_active":"2023-10-08T15:41:41.492030+0000","last_became_peered":"2023-10-08T15:41:41.492030+0000","last_unstale":"2023-10-08T15:41:41.492798+0000","last_undegraded":"2023-10-08T15:41:41.492798+0000","last_fullsized":"2023-10-08T15:41:41.492798+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:18.864780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.482121+0000","last_change":"2023-10-08T15:41:41.482065+0000","last_active":"2023-10-08T15:41:41.482121+0000","last_peered":"2023-10-08T15:41:41.482121+0000","last_clean":"2023-10-08T15:41:41.482121+0000","last_became_active":"2023-10-08T15:41:41.481885+0000","last_became_peered":"2023-10-08T15:41:41.481885+0000","last_unstale":"2023-10-08T15:41:41.482121+0000","last_undegraded":"2023-10-08T15:41:41.482121+0000","last_fullsized":"2023-10-08T15:41:41.482121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:08.087172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484448+0000","last_change":"2023-10-08T15:41:41.484362+0000","last_active":"2023-10-08T15:41:41.484448+0000","last_peered":"2023-10-08T15:41:41.484448+0000","last_clean":"2023-10-08T15:41:41.484448+0000","last_became_active":"2023-10-08T15:41:41.484156+0000","last_became_peered":"2023-10-08T15:41:41.484156+0000","last_unstale":"2023-10-08T15:41:41.484448+0000","last_undegraded":"2023-10-08T15:41:41.484448+0000","last_fullsized":"2023-10-08T15:41:41.484448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:43.495228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856980+0000","last_change":"2023-10-08T15:41:40.860743+0000","last_active":"2023-10-08T15:41:41.856980+0000","last_peered":"2023-10-08T15:41:41.856980+0000","last_clean":"2023-10-08T15:41:41.856980+0000","last_became_active":"2023-10-08T15:41:40.860483+0000","last_became_peered":"2023-10-08T15:41:40.860483+0000","last_unstale":"2023-10-08T15:41:41.856980+0000","last_undegraded":"2023-10-08T15:41:41.856980+0000","last_fullsized":"2023-10-08T15:41:41.856980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:50.504964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489192+0000","last_change":"2023-10-08T15:41:41.488999+0000","last_active":"2023-10-08T15:41:41.489192+0000","last_peered":"2023-10-08T15:41:41.489192+0000","last_clean":"2023-10-08T15:41:41.489192+0000","last_became_active":"2023-10-08T15:41:41.488431+0000","last_became_peered":"2023-10-08T15:41:41.488431+0000","last_unstale":"2023-10-08T15:41:41.489192+0000","last_undegraded":"2023-10-08T15:41:41.489192+0000","last_fullsized":"2023-10-08T15:41:41.489192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:21.609878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857521+0000","last_change":"2023-10-08T15:41:40.860046+0000","last_active":"2023-10-08T15:41:41.857521+0000","last_peered":"2023-10-08T15:41:41.857521+0000","last_clean":"2023-10-08T15:41:41.857521+0000","last_became_active":"2023-10-08T15:41:40.859789+0000","last_became_peered":"2023-10-08T15:41:40.859789+0000","last_unstale":"2023-10-08T15:41:41.857521+0000","last_undegraded":"2023-10-08T15:41:41.857521+0000","last_fullsized":"2023-10-08T15:41:41.857521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:01.575067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487972+0000","last_change":"2023-10-08T15:41:41.487332+0000","last_active":"2023-10-08T15:41:41.487972+0000","last_peered":"2023-10-08T15:41:41.487972+0000","last_clean":"2023-10-08T15:41:41.487972+0000","last_became_active":"2023-10-08T15:41:41.487054+0000","last_became_peered":"2023-10-08T15:41:41.487054+0000","last_unstale":"2023-10-08T15:41:41.487972+0000","last_undegraded":"2023-10-08T15:41:41.487972+0000","last_fullsized":"2023-10-08T15:41:41.487972+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:36.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856892+0000","last_change":"2023-10-08T15:41:40.860339+0000","last_active":"2023-10-08T15:41:41.856892+0000","last_peered":"2023-10-08T15:41:41.856892+0000","last_clean":"2023-10-08T15:41:41.856892+0000","last_became_active":"2023-10-08T15:41:40.859744+0000","last_became_peered":"2023-10-08T15:41:40.859744+0000","last_unstale":"2023-10-08T15:41:41.856892+0000","last_undegraded":"2023-10-08T15:41:41.856892+0000","last_fullsized":"2023-10-08T15:41:41.856892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:53:13.002038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487627+0000","last_change":"2023-10-08T15:41:41.487572+0000","last_active":"2023-10-08T15:41:41.487627+0000","last_peered":"2023-10-08T15:41:41.487627+0000","last_clean":"2023-10-08T15:41:41.487627+0000","last_became_active":"2023-10-08T15:41:41.487315+0000","last_became_peered":"2023-10-08T15:41:41.487315+0000","last_unstale":"2023-10-08T15:41:41.487627+0000","last_undegraded":"2023-10-08T15:41:41.487627+0000","last_fullsized":"2023-10-08T15:41:41.487627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:21.427885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857206+0000","last_change":"2023-10-08T15:41:40.861351+0000","last_active":"2023-10-08T15:41:41.857206+0000","last_peered":"2023-10-08T15:41:41.857206+0000","last_clean":"2023-10-08T15:41:41.857206+0000","last_became_active":"2023-10-08T15:41:40.860560+0000","last_became_peered":"2023-10-08T15:41:40.860560+0000","last_unstale":"2023-10-08T15:41:41.857206+0000","last_undegraded":"2023-10-08T15:41:41.857206+0000","last_fullsized":"2023-10-08T15:41:41.857206+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:06.410668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494158+0000","last_change":"2023-10-08T15:41:41.494083+0000","last_active":"2023-10-08T15:41:41.494158+0000","last_peered":"2023-10-08T15:41:41.494158+0000","last_clean":"2023-10-08T15:41:41.494158+0000","last_became_active":"2023-10-08T15:41:41.492617+0000","last_became_peered":"2023-10-08T15:41:41.492617+0000","last_unstale":"2023-10-08T15:41:41.494158+0000","last_undegraded":"2023-10-08T15:41:41.494158+0000","last_fullsized":"2023-10-08T15:41:41.494158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:15.262018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856793+0000","last_change":"2023-10-08T15:41:40.861057+0000","last_active":"2023-10-08T15:41:41.856793+0000","last_peered":"2023-10-08T15:41:41.856793+0000","last_clean":"2023-10-08T15:41:41.856793+0000","last_became_active":"2023-10-08T15:41:40.860806+0000","last_became_peered":"2023-10-08T15:41:40.860806+0000","last_unstale":"2023-10-08T15:41:41.856793+0000","last_undegraded":"2023-10-08T15:41:41.856793+0000","last_fullsized":"2023-10-08T15:41:41.856793+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:06.410668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494651+0000","last_change":"2023-10-08T15:41:41.494593+0000","last_active":"2023-10-08T15:41:41.494651+0000","last_peered":"2023-10-08T15:41:41.494651+0000","last_clean":"2023-10-08T15:41:41.494651+0000","last_became_active":"2023-10-08T15:41:41.492793+0000","last_became_peered":"2023-10-08T15:41:41.492793+0000","last_unstale":"2023-10-08T15:41:41.494651+0000","last_undegraded":"2023-10-08T15:41:41.494651+0000","last_fullsized":"2023-10-08T15:41:41.494651+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:07.414987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857073+0000","last_change":"2023-10-08T15:41:40.855400+0000","last_active":"2023-10-08T15:41:41.857073+0000","last_peered":"2023-10-08T15:41:41.857073+0000","last_clean":"2023-10-08T15:41:41.857073+0000","last_became_active":"2023-10-08T15:41:40.855182+0000","last_became_peered":"2023-10-08T15:41:40.855182+0000","last_unstale":"2023-10-08T15:41:41.857073+0000","last_undegraded":"2023-10-08T15:41:41.857073+0000","last_fullsized":"2023-10-08T15:41:41.857073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:19.067208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494214+0000","last_change":"2023-10-08T15:41:41.493985+0000","last_active":"2023-10-08T15:41:41.494214+0000","last_peered":"2023-10-08T15:41:41.494214+0000","last_clean":"2023-10-08T15:41:41.494214+0000","last_became_active":"2023-10-08T15:41:41.493304+0000","last_became_peered":"2023-10-08T15:41:41.493304+0000","last_unstale":"2023-10-08T15:41:41.494214+0000","last_undegraded":"2023-10-08T15:41:41.494214+0000","last_fullsized":"2023-10-08T15:41:41.494214+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:22.869094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484891+0000","last_change":"2023-10-08T15:41:40.858282+0000","last_active":"2023-10-08T15:41:41.484891+0000","last_peered":"2023-10-08T15:41:41.484891+0000","last_clean":"2023-10-08T15:41:41.484891+0000","last_became_active":"2023-10-08T15:41:40.858047+0000","last_became_peered":"2023-10-08T15:41:40.858047+0000","last_unstale":"2023-10-08T15:41:41.484891+0000","last_undegraded":"2023-10-08T15:41:41.484891+0000","last_fullsized":"2023-10-08T15:41:41.484891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:59.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489768+0000","last_change":"2023-10-08T15:41:41.489478+0000","last_active":"2023-10-08T15:41:41.489768+0000","last_peered":"2023-10-08T15:41:41.489768+0000","last_clean":"2023-10-08T15:41:41.489768+0000","last_became_active":"2023-10-08T15:41:41.488852+0000","last_became_peered":"2023-10-08T15:41:41.488852+0000","last_unstale":"2023-10-08T15:41:41.489768+0000","last_undegraded":"2023-10-08T15:41:41.489768+0000","last_fullsized":"2023-10-08T15:41:41.489768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:41.202414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.491540+0000","last_change":"2023-10-08T15:41:40.863326+0000","last_active":"2023-10-08T15:41:41.491540+0000","last_peered":"2023-10-08T15:41:41.491540+0000","last_clean":"2023-10-08T15:41:41.491540+0000","last_became_active":"2023-10-08T15:41:40.862486+0000","last_became_peered":"2023-10-08T15:41:40.862486+0000","last_unstale":"2023-10-08T15:41:41.491540+0000","last_undegraded":"2023-10-08T15:41:41.491540+0000","last_fullsized":"2023-10-08T15:41:41.491540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:48.569840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494143+0000","last_change":"2023-10-08T15:41:41.494076+0000","last_active":"2023-10-08T15:41:41.494143+0000","last_peered":"2023-10-08T15:41:41.494143+0000","last_clean":"2023-10-08T15:41:41.494143+0000","last_became_active":"2023-10-08T15:41:41.493782+0000","last_became_peered":"2023-10-08T15:41:41.493782+0000","last_unstale":"2023-10-08T15:41:41.494143+0000","last_undegraded":"2023-10-08T15:41:41.494143+0000","last_fullsized":"2023-10-08T15:41:41.494143+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:36.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.481859+0000","last_change":"2023-10-08T15:41:40.859077+0000","last_active":"2023-10-08T15:41:41.481859+0000","last_peered":"2023-10-08T15:41:41.481859+0000","last_clean":"2023-10-08T15:41:41.481859+0000","last_became_active":"2023-10-08T15:41:40.858766+0000","last_became_peered":"2023-10-08T15:41:40.858766+0000","last_unstale":"2023-10-08T15:41:41.481859+0000","last_undegraded":"2023-10-08T15:41:41.481859+0000","last_fullsized":"2023-10-08T15:41:41.481859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:01.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489255+0000","last_change":"2023-10-08T15:41:41.489094+0000","last_active":"2023-10-08T15:41:41.489255+0000","last_peered":"2023-10-08T15:41:41.489255+0000","last_clean":"2023-10-08T15:41:41.489255+0000","last_became_active":"2023-10-08T15:41:41.488870+0000","last_became_peered":"2023-10-08T15:41:41.488870+0000","last_unstale":"2023-10-08T15:41:41.489255+0000","last_undegraded":"2023-10-08T15:41:41.489255+0000","last_fullsized":"2023-10-08T15:41:41.489255+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:48.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489556+0000","last_change":"2023-10-08T15:41:40.860436+0000","last_active":"2023-10-08T15:41:41.489556+0000","last_peered":"2023-10-08T15:41:41.489556+0000","last_clean":"2023-10-08T15:41:41.489556+0000","last_became_active":"2023-10-08T15:41:40.860010+0000","last_became_peered":"2023-10-08T15:41:40.860010+0000","last_unstale":"2023-10-08T15:41:41.489556+0000","last_undegraded":"2023-10-08T15:41:41.489556+0000","last_fullsized":"2023-10-08T15:41:41.489556+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:23.759714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484405+0000","last_change":"2023-10-08T15:41:41.484324+0000","last_active":"2023-10-08T15:41:41.484405+0000","last_peered":"2023-10-08T15:41:41.484405+0000","last_clean":"2023-10-08T15:41:41.484405+0000","last_became_active":"2023-10-08T15:41:41.483791+0000","last_became_peered":"2023-10-08T15:41:41.483791+0000","last_unstale":"2023-10-08T15:41:41.484405+0000","last_undegraded":"2023-10-08T15:41:41.484405+0000","last_fullsized":"2023-10-08T15:41:41.484405+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:43:31.955693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857304+0000","last_change":"2023-10-08T15:41:40.860722+0000","last_active":"2023-10-08T15:41:41.857304+0000","last_peered":"2023-10-08T15:41:41.857304+0000","last_clean":"2023-10-08T15:41:41.857304+0000","last_became_active":"2023-10-08T15:41:40.859917+0000","last_became_peered":"2023-10-08T15:41:40.859917+0000","last_unstale":"2023-10-08T15:41:41.857304+0000","last_undegraded":"2023-10-08T15:41:41.857304+0000","last_fullsized":"2023-10-08T15:41:41.857304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:48.579255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.490841+0000","last_change":"2023-10-08T15:41:41.490609+0000","last_active":"2023-10-08T15:41:41.490841+0000","last_peered":"2023-10-08T15:41:41.490841+0000","last_clean":"2023-10-08T15:41:41.490841+0000","last_became_active":"2023-10-08T15:41:41.489691+0000","last_became_peered":"2023-10-08T15:41:41.489691+0000","last_unstale":"2023-10-08T15:41:41.490841+0000","last_undegraded":"2023-10-08T15:41:41.490841+0000","last_fullsized":"2023-10-08T15:41:41.490841+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:25.532240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.858831+0000","last_change":"2023-10-08T15:41:40.850824+0000","last_active":"2023-10-08T15:41:41.858831+0000","last_peered":"2023-10-08T15:41:41.858831+0000","last_clean":"2023-10-08T15:41:41.858831+0000","last_became_active":"2023-10-08T15:41:40.850596+0000","last_became_peered":"2023-10-08T15:41:40.850596+0000","last_unstale":"2023-10-08T15:41:41.858831+0000","last_undegraded":"2023-10-08T15:41:41.858831+0000","last_fullsized":"2023-10-08T15:41:41.858831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:37.626905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494013+0000","last_change":"2023-10-08T15:41:41.493899+0000","last_active":"2023-10-08T15:41:41.494013+0000","last_peered":"2023-10-08T15:41:41.494013+0000","last_clean":"2023-10-08T15:41:41.494013+0000","last_became_active":"2023-10-08T15:41:41.493393+0000","last_became_peered":"2023-10-08T15:41:41.493393+0000","last_unstale":"2023-10-08T15:41:41.494013+0000","last_undegraded":"2023-10-08T15:41:41.494013+0000","last_fullsized":"2023-10-08T15:41:41.494013+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:02.127434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856150+0000","last_change":"2023-10-08T15:41:40.861865+0000","last_active":"2023-10-08T15:41:41.856150+0000","last_peered":"2023-10-08T15:41:41.856150+0000","last_clean":"2023-10-08T15:41:41.856150+0000","last_became_active":"2023-10-08T15:41:40.861660+0000","last_became_peered":"2023-10-08T15:41:40.861660+0000","last_unstale":"2023-10-08T15:41:41.856150+0000","last_undegraded":"2023-10-08T15:41:41.856150+0000","last_fullsized":"2023-10-08T15:41:41.856150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:02.021821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494134+0000","last_change":"2023-10-08T15:41:41.493078+0000","last_active":"2023-10-08T15:41:41.494134+0000","last_peered":"2023-10-08T15:41:41.494134+0000","last_clean":"2023-10-08T15:41:41.494134+0000","last_became_active":"2023-10-08T15:41:41.492459+0000","last_became_peered":"2023-10-08T15:41:41.492459+0000","last_unstale":"2023-10-08T15:41:41.494134+0000","last_undegraded":"2023-10-08T15:41:41.494134+0000","last_fullsized":"2023-10-08T15:41:41.494134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:02.127434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487671+0000","last_change":"2023-10-08T15:41:40.861078+0000","last_active":"2023-10-08T15:41:41.487671+0000","last_peered":"2023-10-08T15:41:41.487671+0000","last_clean":"2023-10-08T15:41:41.487671+0000","last_became_active":"2023-10-08T15:41:40.859713+0000","last_became_peered":"2023-10-08T15:41:40.859713+0000","last_unstale":"2023-10-08T15:41:41.487671+0000","last_undegraded":"2023-10-08T15:41:41.487671+0000","last_fullsized":"2023-10-08T15:41:41.487671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:19.651900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.482707+0000","last_change":"2023-10-08T15:41:41.482641+0000","last_active":"2023-10-08T15:41:41.482707+0000","last_peered":"2023-10-08T15:41:41.482707+0000","last_clean":"2023-10-08T15:41:41.482707+0000","last_became_active":"2023-10-08T15:41:41.482405+0000","last_became_peered":"2023-10-08T15:41:41.482405+0000","last_unstale":"2023-10-08T15:41:41.482707+0000","last_undegraded":"2023-10-08T15:41:41.482707+0000","last_fullsized":"2023-10-08T15:41:41.482707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:32.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.480697+0000","last_change":"2023-10-08T15:41:40.862062+0000","last_active":"2023-10-08T15:41:41.480697+0000","last_peered":"2023-10-08T15:41:41.480697+0000","last_clean":"2023-10-08T15:41:41.480697+0000","last_became_active":"2023-10-08T15:41:40.861906+0000","last_became_peered":"2023-10-08T15:41:40.861906+0000","last_unstale":"2023-10-08T15:41:41.480697+0000","last_undegraded":"2023-10-08T15:41:41.480697+0000","last_fullsized":"2023-10-08T15:41:41.480697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:05.423895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.490861+0000","last_change":"2023-10-08T15:41:41.490641+0000","last_active":"2023-10-08T15:41:41.490861+0000","last_peered":"2023-10-08T15:41:41.490861+0000","last_clean":"2023-10-08T15:41:41.490861+0000","last_became_active":"2023-10-08T15:41:41.490397+0000","last_became_peered":"2023-10-08T15:41:41.490397+0000","last_unstale":"2023-10-08T15:41:41.490861+0000","last_undegraded":"2023-10-08T15:41:41.490861+0000","last_fullsized":"2023-10-08T15:41:41.490861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:16:29.906578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.860379+0000","last_change":"2023-10-08T15:41:40.859785+0000","last_active":"2023-10-08T15:41:41.860379+0000","last_peered":"2023-10-08T15:41:41.860379+0000","last_clean":"2023-10-08T15:41:41.860379+0000","last_became_active":"2023-10-08T15:41:40.859466+0000","last_became_peered":"2023-10-08T15:41:40.859466+0000","last_unstale":"2023-10-08T15:41:41.860379+0000","last_undegraded":"2023-10-08T15:41:41.860379+0000","last_fullsized":"2023-10-08T15:41:41.860379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:36.437706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486062+0000","last_change":"2023-10-08T15:41:41.486003+0000","last_active":"2023-10-08T15:41:41.486062+0000","last_peered":"2023-10-08T15:41:41.486062+0000","last_clean":"2023-10-08T15:41:41.486062+0000","last_became_active":"2023-10-08T15:41:41.485789+0000","last_became_peered":"2023-10-08T15:41:41.485789+0000","last_unstale":"2023-10-08T15:41:41.486062+0000","last_undegraded":"2023-10-08T15:41:41.486062+0000","last_fullsized":"2023-10-08T15:41:41.486062+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:49.574159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856750+0000","last_change":"2023-10-08T15:41:40.856838+0000","last_active":"2023-10-08T15:41:41.856750+0000","last_peered":"2023-10-08T15:41:41.856750+0000","last_clean":"2023-10-08T15:41:41.856750+0000","last_became_active":"2023-10-08T15:41:40.856570+0000","last_became_peered":"2023-10-08T15:41:40.856570+0000","last_unstale":"2023-10-08T15:41:41.856750+0000","last_undegraded":"2023-10-08T15:41:41.856750+0000","last_fullsized":"2023-10-08T15:41:41.856750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:28.834865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492559+0000","last_change":"2023-10-08T15:41:41.492512+0000","last_active":"2023-10-08T15:41:41.492559+0000","last_peered":"2023-10-08T15:41:41.492559+0000","last_clean":"2023-10-08T15:41:41.492559+0000","last_became_active":"2023-10-08T15:41:41.491884+0000","last_became_peered":"2023-10-08T15:41:41.491884+0000","last_unstale":"2023-10-08T15:41:41.492559+0000","last_undegraded":"2023-10-08T15:41:41.492559+0000","last_fullsized":"2023-10-08T15:41:41.492559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:03.026140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857394+0000","last_change":"2023-10-08T15:41:40.857736+0000","last_active":"2023-10-08T15:41:41.857394+0000","last_peered":"2023-10-08T15:41:41.857394+0000","last_clean":"2023-10-08T15:41:41.857394+0000","last_became_active":"2023-10-08T15:41:40.857517+0000","last_became_peered":"2023-10-08T15:41:40.857517+0000","last_unstale":"2023-10-08T15:41:41.857394+0000","last_undegraded":"2023-10-08T15:41:41.857394+0000","last_fullsized":"2023-10-08T15:41:41.857394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:20.605560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.485142+0000","last_change":"2023-10-08T15:41:41.483934+0000","last_active":"2023-10-08T15:41:41.485142+0000","last_peered":"2023-10-08T15:41:41.485142+0000","last_clean":"2023-10-08T15:41:41.485142+0000","last_became_active":"2023-10-08T15:41:41.483689+0000","last_became_peered":"2023-10-08T15:41:41.483689+0000","last_unstale":"2023-10-08T15:41:41.485142+0000","last_undegraded":"2023-10-08T15:41:41.485142+0000","last_fullsized":"2023-10-08T15:41:41.485142+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:02.579386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.855815+0000","last_change":"2023-10-08T15:41:40.859560+0000","last_active":"2023-10-08T15:41:41.855815+0000","last_peered":"2023-10-08T15:41:41.855815+0000","last_clean":"2023-10-08T15:41:41.855815+0000","last_became_active":"2023-10-08T15:41:40.859330+0000","last_became_peered":"2023-10-08T15:41:40.859330+0000","last_unstale":"2023-10-08T15:41:41.855815+0000","last_undegraded":"2023-10-08T15:41:41.855815+0000","last_fullsized":"2023-10-08T15:41:41.855815+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:04:25.886517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.488147+0000","last_change":"2023-10-08T15:41:41.488080+0000","last_active":"2023-10-08T15:41:41.488147+0000","last_peered":"2023-10-08T15:41:41.488147+0000","last_clean":"2023-10-08T15:41:41.488147+0000","last_became_active":"2023-10-08T15:41:41.487847+0000","last_became_peered":"2023-10-08T15:41:41.487847+0000","last_unstale":"2023-10-08T15:41:41.488147+0000","last_undegraded":"2023-10-08T15:41:41.488147+0000","last_fullsized":"2023-10-08T15:41:41.488147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:29.505306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.480787+0000","last_change":"2023-10-08T15:41:40.858139+0000","last_active":"2023-10-08T15:41:41.480787+0000","last_peered":"2023-10-08T15:41:41.480787+0000","last_clean":"2023-10-08T15:41:41.480787+0000","last_became_active":"2023-10-08T15:41:40.857818+0000","last_became_peered":"2023-10-08T15:41:40.857818+0000","last_unstale":"2023-10-08T15:41:41.480787+0000","last_undegraded":"2023-10-08T15:41:41.480787+0000","last_fullsized":"2023-10-08T15:41:41.480787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:19.651900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484186+0000","last_change":"2023-10-08T15:41:41.484022+0000","last_active":"2023-10-08T15:41:41.484186+0000","last_peered":"2023-10-08T15:41:41.484186+0000","last_clean":"2023-10-08T15:41:41.484186+0000","last_became_active":"2023-10-08T15:41:41.483490+0000","last_became_peered":"2023-10-08T15:41:41.483490+0000","last_unstale":"2023-10-08T15:41:41.484186+0000","last_undegraded":"2023-10-08T15:41:41.484186+0000","last_fullsized":"2023-10-08T15:41:41.484186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:38.280994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857294+0000","last_change":"2023-10-08T15:41:40.859775+0000","last_active":"2023-10-08T15:41:41.857294+0000","last_peered":"2023-10-08T15:41:41.857294+0000","last_clean":"2023-10-08T15:41:41.857294+0000","last_became_active":"2023-10-08T15:41:40.859525+0000","last_became_peered":"2023-10-08T15:41:40.859525+0000","last_unstale":"2023-10-08T15:41:41.857294+0000","last_undegraded":"2023-10-08T15:41:41.857294+0000","last_fullsized":"2023-10-08T15:41:41.857294+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:14.257699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486478+0000","last_change":"2023-10-08T15:41:41.485997+0000","last_active":"2023-10-08T15:41:41.486478+0000","last_peered":"2023-10-08T15:41:41.486478+0000","last_clean":"2023-10-08T15:41:41.486478+0000","last_became_active":"2023-10-08T15:41:41.485761+0000","last_became_peered":"2023-10-08T15:41:41.485761+0000","last_unstale":"2023-10-08T15:41:41.486478+0000","last_undegraded":"2023-10-08T15:41:41.486478+0000","last_fullsized":"2023-10-08T15:41:41.486478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:41.202414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484994+0000","last_change":"2023-10-08T15:41:40.860066+0000","last_active":"2023-10-08T15:41:41.484994+0000","last_peered":"2023-10-08T15:41:41.484994+0000","last_clean":"2023-10-08T15:41:41.484994+0000","last_became_active":"2023-10-08T15:41:40.859801+0000","last_became_peered":"2023-10-08T15:41:40.859801+0000","last_unstale":"2023-10-08T15:41:41.484994+0000","last_undegraded":"2023-10-08T15:41:41.484994+0000","last_fullsized":"2023-10-08T15:41:41.484994+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:40.198095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489176+0000","last_change":"2023-10-08T15:41:41.489116+0000","last_active":"2023-10-08T15:41:41.489176+0000","last_peered":"2023-10-08T15:41:41.489176+0000","last_clean":"2023-10-08T15:41:41.489176+0000","last_became_active":"2023-10-08T15:41:41.488893+0000","last_became_peered":"2023-10-08T15:41:41.488893+0000","last_unstale":"2023-10-08T15:41:41.489176+0000","last_undegraded":"2023-10-08T15:41:41.489176+0000","last_fullsized":"2023-10-08T15:41:41.489176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:24.764033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.491458+0000","last_change":"2023-10-08T15:41:40.863462+0000","last_active":"2023-10-08T15:41:41.491458+0000","last_peered":"2023-10-08T15:41:41.491458+0000","last_clean":"2023-10-08T15:41:41.491458+0000","last_became_active":"2023-10-08T15:41:40.862742+0000","last_became_peered":"2023-10-08T15:41:40.862742+0000","last_unstale":"2023-10-08T15:41:41.491458+0000","last_undegraded":"2023-10-08T15:41:41.491458+0000","last_fullsized":"2023-10-08T15:41:41.491458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:07.082853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494199+0000","last_change":"2023-10-08T15:41:41.493818+0000","last_active":"2023-10-08T15:41:41.494199+0000","last_peered":"2023-10-08T15:41:41.494199+0000","last_clean":"2023-10-08T15:41:41.494199+0000","last_became_active":"2023-10-08T15:41:41.492725+0000","last_became_peered":"2023-10-08T15:41:41.492725+0000","last_unstale":"2023-10-08T15:41:41.494199+0000","last_undegraded":"2023-10-08T15:41:41.494199+0000","last_fullsized":"2023-10-08T15:41:41.494199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.763415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487763+0000","last_change":"2023-10-08T15:41:40.861232+0000","last_active":"2023-10-08T15:41:41.487763+0000","last_peered":"2023-10-08T15:41:41.487763+0000","last_clean":"2023-10-08T15:41:41.487763+0000","last_became_active":"2023-10-08T15:41:40.860261+0000","last_became_peered":"2023-10-08T15:41:40.860261+0000","last_unstale":"2023-10-08T15:41:41.487763+0000","last_undegraded":"2023-10-08T15:41:41.487763+0000","last_fullsized":"2023-10-08T15:41:41.487763+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:49.015826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.493993+0000","last_change":"2023-10-08T15:41:41.493877+0000","last_active":"2023-10-08T15:41:41.493993+0000","last_peered":"2023-10-08T15:41:41.493993+0000","last_clean":"2023-10-08T15:41:41.493993+0000","last_became_active":"2023-10-08T15:41:41.493521+0000","last_became_peered":"2023-10-08T15:41:41.493521+0000","last_unstale":"2023-10-08T15:41:41.493993+0000","last_undegraded":"2023-10-08T15:41:41.493993+0000","last_fullsized":"2023-10-08T15:41:41.493993+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:43.495228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.480810+0000","last_change":"2023-10-08T15:41:40.857718+0000","last_active":"2023-10-08T15:41:41.480810+0000","last_peered":"2023-10-08T15:41:41.480810+0000","last_clean":"2023-10-08T15:41:41.480810+0000","last_became_active":"2023-10-08T15:41:40.857232+0000","last_became_peered":"2023-10-08T15:41:40.857232+0000","last_unstale":"2023-10-08T15:41:41.480810+0000","last_undegraded":"2023-10-08T15:41:41.480810+0000","last_fullsized":"2023-10-08T15:41:41.480810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:35.575737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.495258+0000","last_change":"2023-10-08T15:41:41.494841+0000","last_active":"2023-10-08T15:41:41.495258+0000","last_peered":"2023-10-08T15:41:41.495258+0000","last_clean":"2023-10-08T15:41:41.495258+0000","last_became_active":"2023-10-08T15:41:41.494611+0000","last_became_peered":"2023-10-08T15:41:41.494611+0000","last_unstale":"2023-10-08T15:41:41.495258+0000","last_undegraded":"2023-10-08T15:41:41.495258+0000","last_fullsized":"2023-10-08T15:41:41.495258+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:20.656219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486318+0000","last_change":"2023-10-08T15:41:40.861176+0000","last_active":"2023-10-08T15:41:41.486318+0000","last_peered":"2023-10-08T15:41:41.486318+0000","last_clean":"2023-10-08T15:41:41.486318+0000","last_became_active":"2023-10-08T15:41:40.860474+0000","last_became_peered":"2023-10-08T15:41:40.860474+0000","last_unstale":"2023-10-08T15:41:41.486318+0000","last_undegraded":"2023-10-08T15:41:41.486318+0000","last_fullsized":"2023-10-08T15:41:41.486318+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:59.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489833+0000","last_change":"2023-10-08T15:41:41.489625+0000","last_active":"2023-10-08T15:41:41.489833+0000","last_peered":"2023-10-08T15:41:41.489833+0000","last_clean":"2023-10-08T15:41:41.489833+0000","last_became_active":"2023-10-08T15:41:41.489181+0000","last_became_peered":"2023-10-08T15:41:41.489181+0000","last_unstale":"2023-10-08T15:41:41.489833+0000","last_undegraded":"2023-10-08T15:41:41.489833+0000","last_fullsized":"2023-10-08T15:41:41.489833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:49.137097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.481215+0000","last_change":"2023-10-08T15:41:40.860487+0000","last_active":"2023-10-08T15:41:41.481215+0000","last_peered":"2023-10-08T15:41:41.481215+0000","last_clean":"2023-10-08T15:41:41.481215+0000","last_became_active":"2023-10-08T15:41:40.860112+0000","last_became_peered":"2023-10-08T15:41:40.860112+0000","last_unstale":"2023-10-08T15:41:41.481215+0000","last_undegraded":"2023-10-08T15:41:41.481215+0000","last_fullsized":"2023-10-08T15:41:41.481215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:28.500987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.482573+0000","last_change":"2023-10-08T15:41:41.482508+0000","last_active":"2023-10-08T15:41:41.482573+0000","last_peered":"2023-10-08T15:41:41.482573+0000","last_clean":"2023-10-08T15:41:41.482573+0000","last_became_active":"2023-10-08T15:41:41.482295+0000","last_became_peered":"2023-10-08T15:41:41.482295+0000","last_unstale":"2023-10-08T15:41:41.482573+0000","last_undegraded":"2023-10-08T15:41:41.482573+0000","last_fullsized":"2023-10-08T15:41:41.482573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:28:55.278833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.488140+0000","last_change":"2023-10-08T15:41:40.861598+0000","last_active":"2023-10-08T15:41:41.488140+0000","last_peered":"2023-10-08T15:41:41.488140+0000","last_clean":"2023-10-08T15:41:41.488140+0000","last_became_active":"2023-10-08T15:41:40.860886+0000","last_became_peered":"2023-10-08T15:41:40.860886+0000","last_unstale":"2023-10-08T15:41:41.488140+0000","last_undegraded":"2023-10-08T15:41:41.488140+0000","last_fullsized":"2023-10-08T15:41:41.488140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:36.759097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484331+0000","last_change":"2023-10-08T15:41:41.484258+0000","last_active":"2023-10-08T15:41:41.484331+0000","last_peered":"2023-10-08T15:41:41.484331+0000","last_clean":"2023-10-08T15:41:41.484331+0000","last_became_active":"2023-10-08T15:41:41.483646+0000","last_became_peered":"2023-10-08T15:41:41.483646+0000","last_unstale":"2023-10-08T15:41:41.484331+0000","last_undegraded":"2023-10-08T15:41:41.484331+0000","last_fullsized":"2023-10-08T15:41:41.484331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:38.623720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.482870+0000","last_change":"2023-10-08T15:41:40.856487+0000","last_active":"2023-10-08T15:41:41.482870+0000","last_peered":"2023-10-08T15:41:41.482870+0000","last_clean":"2023-10-08T15:41:41.482870+0000","last_became_active":"2023-10-08T15:41:40.856255+0000","last_became_peered":"2023-10-08T15:41:40.856255+0000","last_unstale":"2023-10-08T15:41:41.482870+0000","last_undegraded":"2023-10-08T15:41:41.482870+0000","last_fullsized":"2023-10-08T15:41:41.482870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:42.490910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487996+0000","last_change":"2023-10-08T15:41:41.487617+0000","last_active":"2023-10-08T15:41:41.487996+0000","last_peered":"2023-10-08T15:41:41.487996+0000","last_clean":"2023-10-08T15:41:41.487996+0000","last_became_active":"2023-10-08T15:41:41.487486+0000","last_became_peered":"2023-10-08T15:41:41.487486+0000","last_unstale":"2023-10-08T15:41:41.487996+0000","last_undegraded":"2023-10-08T15:41:41.487996+0000","last_fullsized":"2023-10-08T15:41:41.487996+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.509283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.480665+0000","last_change":"2023-10-08T15:41:40.859594+0000","last_active":"2023-10-08T15:41:41.480665+0000","last_peered":"2023-10-08T15:41:41.480665+0000","last_clean":"2023-10-08T15:41:41.480665+0000","last_became_active":"2023-10-08T15:41:40.859353+0000","last_became_peered":"2023-10-08T15:41:40.859353+0000","last_unstale":"2023-10-08T15:41:41.480665+0000","last_undegraded":"2023-10-08T15:41:41.480665+0000","last_fullsized":"2023-10-08T15:41:41.480665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:20.609281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.491081+0000","last_change":"2023-10-08T15:41:41.490963+0000","last_active":"2023-10-08T15:41:41.491081+0000","last_peered":"2023-10-08T15:41:41.491081+0000","last_clean":"2023-10-08T15:41:41.491081+0000","last_became_active":"2023-10-08T15:41:41.490735+0000","last_became_peered":"2023-10-08T15:41:41.490735+0000","last_unstale":"2023-10-08T15:41:41.491081+0000","last_undegraded":"2023-10-08T15:41:41.491081+0000","last_fullsized":"2023-10-08T15:41:41.491081+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:07.414987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487988+0000","last_change":"2023-10-08T15:41:40.863002+0000","last_active":"2023-10-08T15:41:41.487988+0000","last_peered":"2023-10-08T15:41:41.487988+0000","last_clean":"2023-10-08T15:41:41.487988+0000","last_became_active":"2023-10-08T15:41:40.862500+0000","last_became_peered":"2023-10-08T15:41:40.862500+0000","last_unstale":"2023-10-08T15:41:41.487988+0000","last_undegraded":"2023-10-08T15:41:41.487988+0000","last_fullsized":"2023-10-08T15:41:41.487988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:58.707663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492348+0000","last_change":"2023-10-08T15:41:41.492198+0000","last_active":"2023-10-08T15:41:41.492348+0000","last_peered":"2023-10-08T15:41:41.492348+0000","last_clean":"2023-10-08T15:41:41.492348+0000","last_became_active":"2023-10-08T15:41:41.491953+0000","last_became_peered":"2023-10-08T15:41:41.491953+0000","last_unstale":"2023-10-08T15:41:41.492348+0000","last_undegraded":"2023-10-08T15:41:41.492348+0000","last_fullsized":"2023-10-08T15:41:41.492348+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:15.262018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856422+0000","last_change":"2023-10-08T15:41:40.857523+0000","last_active":"2023-10-08T15:41:41.856422+0000","last_peered":"2023-10-08T15:41:41.856422+0000","last_clean":"2023-10-08T15:41:41.856422+0000","last_became_active":"2023-10-08T15:41:40.857044+0000","last_became_peered":"2023-10-08T15:41:40.857044+0000","last_unstale":"2023-10-08T15:41:41.856422+0000","last_undegraded":"2023-10-08T15:41:41.856422+0000","last_fullsized":"2023-10-08T15:41:41.856422+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:48.579255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486406+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:41:41.486406+0000","last_peered":"2023-10-08T15:41:41.486406+0000","last_clean":"2023-10-08T15:41:41.486406+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:41:41.486406+0000","last_undegraded":"2023-10-08T15:41:41.486406+0000","last_fullsized":"2023-10-08T15:41:41.486406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195831,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.439}]},{"osd":2,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.61099999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.627},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785645,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.30599999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.43099999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.5}]},{"osd":5,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48199999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.30499999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.41699999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.8260000000000001,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.316},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.30399999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.36899999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.754},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.72599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.38}]},{"osd":1,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.32300000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.28299999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81100000000000005}]},{"osd":5,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.625},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195109,"statfs":{"total":200000000,"available":199791967,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35799999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.372},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.58099999999999996}]},{"osd":6,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.57299999999999995}]},{"osd":7,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195108,"statfs":{"total":200000000,"available":199791041,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.66600000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47099999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.438},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.372},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.438},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.623},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59699999999999998}]}]}],"pool_statfs":[]}} 2023-10-08T15:41:45.965 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:41:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.116+0000 7fe6dc14d700 1 Processor -- start 2023-10-08T15:41:46.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.117+0000 7fe6dc14d700 1 -- start start 2023-10-08T15:41:46.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.117+0000 7fe6dc14d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe6d415a2b0 0x7fe6d40b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.117+0000 7fe6dc14d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d40c5d80 con 0x7fe6d40cfe20 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6dc14d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d40c6060 con 0x7fe6d40d1c30 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6dc14d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d4068470 con 0x7fe6d415a2b0 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d9ee9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe6d415a2b0 0x7fe6d40b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6da6ea700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe6d40cfe20 0x7fe6d40c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37582/0 (socket says 172.21.15.29:37582) 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d9ee9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe6d415a2b0 0x7fe6d40b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36326/0 (socket says 172.21.15.29:36326) 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6da6ea700 1 -- 172.21.15.29:0/2555513479 learned_addr learned my addr 172.21.15.29:0/2555513479 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d9ee9700 1 -- 172.21.15.29:0/2555513479 >> v1:172.21.15.183:6789/0 conn(0x7fe6d40d1c30 legacy=0x7fe6d40cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d9ee9700 1 -- 172.21.15.29:0/2555513479 >> v1:172.21.15.29:6789/0 conn(0x7fe6d40cfe20 legacy=0x7fe6d40c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d9ee9700 1 -- 172.21.15.29:0/2555513479 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d40c6340 con 0x7fe6d415a2b0 2023-10-08T15:41:46.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d9ee9700 1 --2- 172.21.15.29:0/2555513479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d415a2b0 0x7fe6d40b3da0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0098d0 tx=0x7fe6cc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa12d212cb19a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d8ee7700 1 -- 172.21.15.29:0/2555513479 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc009e70 con 0x7fe6d415a2b0 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d8ee7700 1 -- 172.21.15.29:0/2555513479 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc005c10 con 0x7fe6d415a2b0 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.118+0000 7fe6d8ee7700 1 -- 172.21.15.29:0/2555513479 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00b650 con 0x7fe6d415a2b0 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.119+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2555513479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d415a2b0 msgr2=0x7fe6d40b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.119+0000 7fe6dc14d700 1 --2- 172.21.15.29:0/2555513479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d415a2b0 0x7fe6d40b3da0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0098d0 tx=0x7fe6cc009120 comp rx=0 tx=0).stop 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.119+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2555513479 shutdown_connections 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.119+0000 7fe6dc14d700 1 --2- 172.21.15.29:0/2555513479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d415a2b0 0x7fe6d40b3da0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.119+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2555513479 >> 172.21.15.29:0/2555513479 conn(0x7fe6d4067e40 msgr2=0x7fe6d40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.119+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2555513479 shutdown_connections 2023-10-08T15:41:46.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.119+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2555513479 wait complete. 2023-10-08T15:41:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.120+0000 7fe6dc14d700 1 Processor -- start 2023-10-08T15:41:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.120+0000 7fe6dc14d700 1 -- start start 2023-10-08T15:41:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6dc14d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6d40cfe20 0x7fe6d40ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6dc14d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d40d1c30 0x7fe6d4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6dc14d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6d415a2b0 0x7fe6d416b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6dc14d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4155a40 con 0x7fe6d40d1c30 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6dc14d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d40ca540 con 0x7fe6d415a2b0 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6dc14d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4153150 con 0x7fe6d40cfe20 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d40d1c30 0x7fe6d4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d40d1c30 0x7fe6d4152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36340/0 (socket says 172.21.15.29:36340) 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 -- 172.21.15.29:0/2974013514 learned_addr learned my addr 172.21.15.29:0/2974013514 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6da6ea700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6d415a2b0 0x7fe6d416b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d9ee9700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6d40cfe20 0x7fe6d40ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 -- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6d40cfe20 msgr2=0x7fe6d40ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6d40cfe20 0x7fe6d40ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 -- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6d415a2b0 msgr2=0x7fe6d416b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6d415a2b0 0x7fe6d416b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 -- 172.21.15.29:0/2974013514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc0093c0 con 0x7fe6d40d1c30 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6da6ea700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6d415a2b0 0x7fe6d416b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d9ee9700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6d40cfe20 0x7fe6d40ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d96e8700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d40d1c30 0x7fe6d4152c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c590 tx=0x7fe6c8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.121+0000 7fe6d1ffb700 1 -- 172.21.15.29:0/2974013514 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8011590 con 0x7fe6d40d1c30 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.122+0000 7fe6d1ffb700 1 -- 172.21.15.29:0/2974013514 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8011710 con 0x7fe6d40d1c30 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.122+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d416a760 con 0x7fe6d40d1c30 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.122+0000 7fe6d1ffb700 1 -- 172.21.15.29:0/2974013514 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8011ad0 con 0x7fe6d40d1c30 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.122+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d4153950 con 0x7fe6d40d1c30 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.123+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d416a8f0 con 0x7fe6d40d1c30 2023-10-08T15:41:46.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.123+0000 7fe6d1ffb700 1 -- 172.21.15.29:0/2974013514 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6c801b3b0 con 0x7fe6d40d1c30 2023-10-08T15:41:46.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.124+0000 7fe6d1ffb700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6c0066f30 0x7fe6c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.124+0000 7fe6d1ffb700 1 -- 172.21.15.29:0/2974013514 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6c8083a70 con 0x7fe6d40d1c30 2023-10-08T15:41:46.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.124+0000 7fe6d9ee9700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6c0066f30 0x7fe6c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.125+0000 7fe6d9ee9700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6c0066f30 0x7fe6c00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009fd0 tx=0x7fe6cc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.128+0000 7fe6d1ffb700 1 -- 172.21.15.29:0/2974013514 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6c8050c40 con 0x7fe6d40d1c30 2023-10-08T15:41:46.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.322+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6d416a580 con 0x7fe6c0066f30 2023-10-08T15:41:46.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.330+0000 7fe6d1ffb700 1 -- 172.21.15.29:0/2974013514 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284875 (secure 0 0 0) 0x7fe6d416a580 con 0x7fe6c0066f30 2023-10-08T15:41:46.334 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:46.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6c0066f30 msgr2=0x7fe6c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6c0066f30 0x7fe6c00693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009fd0 tx=0x7fe6cc016000 comp rx=0 tx=0).stop 2023-10-08T15:41:46.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d40d1c30 msgr2=0x7fe6d4152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d40d1c30 0x7fe6d4152c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c590 tx=0x7fe6c8007f50 comp rx=0 tx=0).stop 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 shutdown_connections 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe6c0066f30 0x7fe6c00693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6d415a2b0 0x7fe6d416b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6d40cfe20 0x7fe6d40ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 --2- 172.21.15.29:0/2974013514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6d40d1c30 0x7fe6d4152c10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.333+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 >> 172.21.15.29:0/2974013514 conn(0x7fe6d4067e40 msgr2=0x7fe6d40c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.334+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 shutdown_connections 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.334+0000 7fe6dc14d700 1 -- 172.21.15.29:0/2974013514 wait complete. 2023-10-08T15:41:46.337 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:41:46.346 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-10-08T15:41:46.320999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2814,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559685,"statfs":{"total":1600000000,"available":1597117540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001508"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492730+0000","last_change":"2023-10-08T15:41:41.492632+0000","last_active":"2023-10-08T15:41:41.492730+0000","last_peered":"2023-10-08T15:41:41.492730+0000","last_clean":"2023-10-08T15:41:41.492730+0000","last_became_active":"2023-10-08T15:41:41.492389+0000","last_became_peered":"2023-10-08T15:41:41.492389+0000","last_unstale":"2023-10-08T15:41:41.492730+0000","last_undegraded":"2023-10-08T15:41:41.492730+0000","last_fullsized":"2023-10-08T15:41:41.492730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492935+0000","last_change":"2023-10-08T15:41:41.492865+0000","last_active":"2023-10-08T15:41:41.492935+0000","last_peered":"2023-10-08T15:41:41.492935+0000","last_clean":"2023-10-08T15:41:41.492935+0000","last_became_active":"2023-10-08T15:41:41.492478+0000","last_became_peered":"2023-10-08T15:41:41.492478+0000","last_unstale":"2023-10-08T15:41:41.492935+0000","last_undegraded":"2023-10-08T15:41:41.492935+0000","last_fullsized":"2023-10-08T15:41:41.492935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:53:30.269214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494117+0000","last_change":"2023-10-08T15:41:41.493062+0000","last_active":"2023-10-08T15:41:41.494117+0000","last_peered":"2023-10-08T15:41:41.494117+0000","last_clean":"2023-10-08T15:41:41.494117+0000","last_became_active":"2023-10-08T15:41:41.492309+0000","last_became_peered":"2023-10-08T15:41:41.492309+0000","last_unstale":"2023-10-08T15:41:41.494117+0000","last_undegraded":"2023-10-08T15:41:41.494117+0000","last_fullsized":"2023-10-08T15:41:41.494117+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:06.428214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492308+0000","last_change":"2023-10-08T15:41:41.490189+0000","last_active":"2023-10-08T15:41:41.492308+0000","last_peered":"2023-10-08T15:41:41.492308+0000","last_clean":"2023-10-08T15:41:41.492308+0000","last_became_active":"2023-10-08T15:41:41.489797+0000","last_became_peered":"2023-10-08T15:41:41.489797+0000","last_unstale":"2023-10-08T15:41:41.492308+0000","last_undegraded":"2023-10-08T15:41:41.492308+0000","last_fullsized":"2023-10-08T15:41:41.492308+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:48.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494754+0000","last_change":"2023-10-08T15:41:41.494690+0000","last_active":"2023-10-08T15:41:41.494754+0000","last_peered":"2023-10-08T15:41:41.494754+0000","last_clean":"2023-10-08T15:41:41.494754+0000","last_became_active":"2023-10-08T15:41:41.494425+0000","last_became_peered":"2023-10-08T15:41:41.494425+0000","last_unstale":"2023-10-08T15:41:41.494754+0000","last_undegraded":"2023-10-08T15:41:41.494754+0000","last_fullsized":"2023-10-08T15:41:41.494754+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.493761+0000","last_change":"2023-10-08T15:41:41.492888+0000","last_active":"2023-10-08T15:41:41.493761+0000","last_peered":"2023-10-08T15:41:41.493761+0000","last_clean":"2023-10-08T15:41:41.493761+0000","last_became_active":"2023-10-08T15:41:41.492517+0000","last_became_peered":"2023-10-08T15:41:41.492517+0000","last_unstale":"2023-10-08T15:41:41.493761+0000","last_undegraded":"2023-10-08T15:41:41.493761+0000","last_fullsized":"2023-10-08T15:41:41.493761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:57.929963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487788+0000","last_change":"2023-10-08T15:41:41.487722+0000","last_active":"2023-10-08T15:41:41.487788+0000","last_peered":"2023-10-08T15:41:41.487788+0000","last_clean":"2023-10-08T15:41:41.487788+0000","last_became_active":"2023-10-08T15:41:41.487478+0000","last_became_peered":"2023-10-08T15:41:41.487478+0000","last_unstale":"2023-10-08T15:41:41.487788+0000","last_undegraded":"2023-10-08T15:41:41.487788+0000","last_fullsized":"2023-10-08T15:41:41.487788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:34:37.318279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494184+0000","last_change":"2023-10-08T15:41:41.493311+0000","last_active":"2023-10-08T15:41:41.494184+0000","last_peered":"2023-10-08T15:41:41.494184+0000","last_clean":"2023-10-08T15:41:41.494184+0000","last_became_active":"2023-10-08T15:41:41.493095+0000","last_became_peered":"2023-10-08T15:41:41.493095+0000","last_unstale":"2023-10-08T15:41:41.494184+0000","last_undegraded":"2023-10-08T15:41:41.494184+0000","last_fullsized":"2023-10-08T15:41:41.494184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.509283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494167+0000","last_change":"2023-10-08T15:41:41.493251+0000","last_active":"2023-10-08T15:41:41.494167+0000","last_peered":"2023-10-08T15:41:41.494167+0000","last_clean":"2023-10-08T15:41:41.494167+0000","last_became_active":"2023-10-08T15:41:41.492301+0000","last_became_peered":"2023-10-08T15:41:41.492301+0000","last_unstale":"2023-10-08T15:41:41.494167+0000","last_undegraded":"2023-10-08T15:41:41.494167+0000","last_fullsized":"2023-10-08T15:41:41.494167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:36.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494229+0000","last_change":"2023-10-08T15:41:41.494101+0000","last_active":"2023-10-08T15:41:41.494229+0000","last_peered":"2023-10-08T15:41:41.494229+0000","last_clean":"2023-10-08T15:41:41.494229+0000","last_became_active":"2023-10-08T15:41:41.493597+0000","last_became_peered":"2023-10-08T15:41:41.493597+0000","last_unstale":"2023-10-08T15:41:41.494229+0000","last_undegraded":"2023-10-08T15:41:41.494229+0000","last_fullsized":"2023-10-08T15:41:41.494229+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:35.429197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492367+0000","last_change":"2023-10-08T15:41:41.492298+0000","last_active":"2023-10-08T15:41:41.492367+0000","last_peered":"2023-10-08T15:41:41.492367+0000","last_clean":"2023-10-08T15:41:41.492367+0000","last_became_active":"2023-10-08T15:41:41.491971+0000","last_became_peered":"2023-10-08T15:41:41.491971+0000","last_unstale":"2023-10-08T15:41:41.492367+0000","last_undegraded":"2023-10-08T15:41:41.492367+0000","last_fullsized":"2023-10-08T15:41:41.492367+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:06.428214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487959+0000","last_change":"2023-10-08T15:41:41.487313+0000","last_active":"2023-10-08T15:41:41.487959+0000","last_peered":"2023-10-08T15:41:41.487959+0000","last_clean":"2023-10-08T15:41:41.487959+0000","last_became_active":"2023-10-08T15:41:41.487003+0000","last_became_peered":"2023-10-08T15:41:41.487003+0000","last_unstale":"2023-10-08T15:41:41.487959+0000","last_undegraded":"2023-10-08T15:41:41.487959+0000","last_fullsized":"2023-10-08T15:41:41.487959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:03.026140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.481926+0000","last_change":"2023-10-08T15:41:41.481792+0000","last_active":"2023-10-08T15:41:41.481926+0000","last_peered":"2023-10-08T15:41:41.481926+0000","last_clean":"2023-10-08T15:41:41.481926+0000","last_became_active":"2023-10-08T15:41:41.481585+0000","last_became_peered":"2023-10-08T15:41:41.481585+0000","last_unstale":"2023-10-08T15:41:41.481926+0000","last_undegraded":"2023-10-08T15:41:41.481926+0000","last_fullsized":"2023-10-08T15:41:41.481926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:59.711982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494153+0000","last_change":"2023-10-08T15:41:41.493104+0000","last_active":"2023-10-08T15:41:41.494153+0000","last_peered":"2023-10-08T15:41:41.494153+0000","last_clean":"2023-10-08T15:41:41.494153+0000","last_became_active":"2023-10-08T15:41:41.492115+0000","last_became_peered":"2023-10-08T15:41:41.492115+0000","last_unstale":"2023-10-08T15:41:41.494153+0000","last_undegraded":"2023-10-08T15:41:41.494153+0000","last_fullsized":"2023-10-08T15:41:41.494153+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.483960+0000","last_change":"2023-10-08T15:41:41.483862+0000","last_active":"2023-10-08T15:41:41.483960+0000","last_peered":"2023-10-08T15:41:41.483960+0000","last_clean":"2023-10-08T15:41:41.483960+0000","last_became_active":"2023-10-08T15:41:41.483621+0000","last_became_peered":"2023-10-08T15:41:41.483621+0000","last_unstale":"2023-10-08T15:41:41.483960+0000","last_undegraded":"2023-10-08T15:41:41.483960+0000","last_fullsized":"2023-10-08T15:41:41.483960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:34:37.318279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494093+0000","last_change":"2023-10-08T15:41:41.494033+0000","last_active":"2023-10-08T15:41:41.494093+0000","last_peered":"2023-10-08T15:41:41.494093+0000","last_clean":"2023-10-08T15:41:41.494093+0000","last_became_active":"2023-10-08T15:41:41.493678+0000","last_became_peered":"2023-10-08T15:41:41.493678+0000","last_unstale":"2023-10-08T15:41:41.494093+0000","last_undegraded":"2023-10-08T15:41:41.494093+0000","last_fullsized":"2023-10-08T15:41:41.494093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:21.427885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492439+0000","last_change":"2023-10-08T15:41:41.492238+0000","last_active":"2023-10-08T15:41:41.492439+0000","last_peered":"2023-10-08T15:41:41.492439+0000","last_clean":"2023-10-08T15:41:41.492439+0000","last_became_active":"2023-10-08T15:41:41.491667+0000","last_became_peered":"2023-10-08T15:41:41.491667+0000","last_unstale":"2023-10-08T15:41:41.492439+0000","last_undegraded":"2023-10-08T15:41:41.492439+0000","last_fullsized":"2023-10-08T15:41:41.492439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.509283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494324+0000","last_change":"2023-10-08T15:41:41.494225+0000","last_active":"2023-10-08T15:41:41.494324+0000","last_peered":"2023-10-08T15:41:41.494324+0000","last_clean":"2023-10-08T15:41:41.494324+0000","last_became_active":"2023-10-08T15:41:41.493861+0000","last_became_peered":"2023-10-08T15:41:41.493861+0000","last_unstale":"2023-10-08T15:41:41.494324+0000","last_undegraded":"2023-10-08T15:41:41.494324+0000","last_fullsized":"2023-10-08T15:41:41.494324+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:39.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.493671+0000","last_change":"2023-10-08T15:41:41.493587+0000","last_active":"2023-10-08T15:41:41.493671+0000","last_peered":"2023-10-08T15:41:41.493671+0000","last_clean":"2023-10-08T15:41:41.493671+0000","last_became_active":"2023-10-08T15:41:41.493253+0000","last_became_peered":"2023-10-08T15:41:41.493253+0000","last_unstale":"2023-10-08T15:41:41.493671+0000","last_undegraded":"2023-10-08T15:41:41.493671+0000","last_fullsized":"2023-10-08T15:41:41.493671+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:00.603058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494051+0000","last_change":"2023-10-08T15:41:41.494010+0000","last_active":"2023-10-08T15:41:41.494051+0000","last_peered":"2023-10-08T15:41:41.494051+0000","last_clean":"2023-10-08T15:41:41.494051+0000","last_became_active":"2023-10-08T15:41:41.493816+0000","last_became_peered":"2023-10-08T15:41:41.493816+0000","last_unstale":"2023-10-08T15:41:41.494051+0000","last_undegraded":"2023-10-08T15:41:41.494051+0000","last_fullsized":"2023-10-08T15:41:41.494051+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:29.505306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484461+0000","last_change":"2023-10-08T15:41:41.484407+0000","last_active":"2023-10-08T15:41:41.484461+0000","last_peered":"2023-10-08T15:41:41.484461+0000","last_clean":"2023-10-08T15:41:41.484461+0000","last_became_active":"2023-10-08T15:41:41.484033+0000","last_became_peered":"2023-10-08T15:41:41.484033+0000","last_unstale":"2023-10-08T15:41:41.484461+0000","last_undegraded":"2023-10-08T15:41:41.484461+0000","last_fullsized":"2023-10-08T15:41:41.484461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:43.976680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494143+0000","last_change":"2023-10-08T15:41:41.493102+0000","last_active":"2023-10-08T15:41:41.494143+0000","last_peered":"2023-10-08T15:41:41.494143+0000","last_clean":"2023-10-08T15:41:41.494143+0000","last_became_active":"2023-10-08T15:41:41.492550+0000","last_became_peered":"2023-10-08T15:41:41.492550+0000","last_unstale":"2023-10-08T15:41:41.494143+0000","last_undegraded":"2023-10-08T15:41:41.494143+0000","last_fullsized":"2023-10-08T15:41:41.494143+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:53:30.269214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489211+0000","last_change":"2023-10-08T15:41:41.489149+0000","last_active":"2023-10-08T15:41:41.489211+0000","last_peered":"2023-10-08T15:41:41.489211+0000","last_clean":"2023-10-08T15:41:41.489211+0000","last_became_active":"2023-10-08T15:41:41.488762+0000","last_became_peered":"2023-10-08T15:41:41.488762+0000","last_unstale":"2023-10-08T15:41:41.489211+0000","last_undegraded":"2023-10-08T15:41:41.489211+0000","last_fullsized":"2023-10-08T15:41:41.489211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:37.428453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489786+0000","last_change":"2023-10-08T15:41:41.489613+0000","last_active":"2023-10-08T15:41:41.489786+0000","last_peered":"2023-10-08T15:41:41.489786+0000","last_clean":"2023-10-08T15:41:41.489786+0000","last_became_active":"2023-10-08T15:41:41.489160+0000","last_became_peered":"2023-10-08T15:41:41.489160+0000","last_unstale":"2023-10-08T15:41:41.489786+0000","last_undegraded":"2023-10-08T15:41:41.489786+0000","last_fullsized":"2023-10-08T15:41:41.489786+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:04:26.890835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489227+0000","last_change":"2023-10-08T15:41:41.489165+0000","last_active":"2023-10-08T15:41:41.489227+0000","last_peered":"2023-10-08T15:41:41.489227+0000","last_clean":"2023-10-08T15:41:41.489227+0000","last_became_active":"2023-10-08T15:41:41.488777+0000","last_became_peered":"2023-10-08T15:41:41.488777+0000","last_unstale":"2023-10-08T15:41:41.489227+0000","last_undegraded":"2023-10-08T15:41:41.489227+0000","last_fullsized":"2023-10-08T15:41:41.489227+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:24.764033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.483114+0000","last_change":"2023-10-08T15:41:41.483050+0000","last_active":"2023-10-08T15:41:41.483114+0000","last_peered":"2023-10-08T15:41:41.483114+0000","last_clean":"2023-10-08T15:41:41.483114+0000","last_became_active":"2023-10-08T15:41:41.482758+0000","last_became_peered":"2023-10-08T15:41:41.482758+0000","last_unstale":"2023-10-08T15:41:41.483114+0000","last_undegraded":"2023-10-08T15:41:41.483114+0000","last_fullsized":"2023-10-08T15:41:41.483114+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:30.947121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492455+0000","last_change":"2023-10-08T15:41:41.492369+0000","last_active":"2023-10-08T15:41:41.492455+0000","last_peered":"2023-10-08T15:41:41.492455+0000","last_clean":"2023-10-08T15:41:41.492455+0000","last_became_active":"2023-10-08T15:41:41.492006+0000","last_became_peered":"2023-10-08T15:41:41.492006+0000","last_unstale":"2023-10-08T15:41:41.492455+0000","last_undegraded":"2023-10-08T15:41:41.492455+0000","last_fullsized":"2023-10-08T15:41:41.492455+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:03.026140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486899+0000","last_change":"2023-10-08T15:41:41.486774+0000","last_active":"2023-10-08T15:41:41.486899+0000","last_peered":"2023-10-08T15:41:41.486899+0000","last_clean":"2023-10-08T15:41:41.486899+0000","last_became_active":"2023-10-08T15:41:41.486332+0000","last_became_peered":"2023-10-08T15:41:41.486332+0000","last_unstale":"2023-10-08T15:41:41.486899+0000","last_undegraded":"2023-10-08T15:41:41.486899+0000","last_fullsized":"2023-10-08T15:41:41.486899+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:15.262018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486312+0000","last_change":"2023-10-08T15:41:41.486197+0000","last_active":"2023-10-08T15:41:41.486312+0000","last_peered":"2023-10-08T15:41:41.486312+0000","last_clean":"2023-10-08T15:41:41.486312+0000","last_became_active":"2023-10-08T15:41:41.485978+0000","last_became_peered":"2023-10-08T15:41:41.485978+0000","last_unstale":"2023-10-08T15:41:41.486312+0000","last_undegraded":"2023-10-08T15:41:41.486312+0000","last_fullsized":"2023-10-08T15:41:41.486312+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:20.071526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494174+0000","last_change":"2023-10-08T15:41:41.494123+0000","last_active":"2023-10-08T15:41:41.494174+0000","last_peered":"2023-10-08T15:41:41.494174+0000","last_clean":"2023-10-08T15:41:41.494174+0000","last_became_active":"2023-10-08T15:41:41.493444+0000","last_became_peered":"2023-10-08T15:41:41.493444+0000","last_unstale":"2023-10-08T15:41:41.494174+0000","last_undegraded":"2023-10-08T15:41:41.494174+0000","last_fullsized":"2023-10-08T15:41:41.494174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:50.020144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492798+0000","last_change":"2023-10-08T15:41:41.492738+0000","last_active":"2023-10-08T15:41:41.492798+0000","last_peered":"2023-10-08T15:41:41.492798+0000","last_clean":"2023-10-08T15:41:41.492798+0000","last_became_active":"2023-10-08T15:41:41.492030+0000","last_became_peered":"2023-10-08T15:41:41.492030+0000","last_unstale":"2023-10-08T15:41:41.492798+0000","last_undegraded":"2023-10-08T15:41:41.492798+0000","last_fullsized":"2023-10-08T15:41:41.492798+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:18.864780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.482121+0000","last_change":"2023-10-08T15:41:41.482065+0000","last_active":"2023-10-08T15:41:41.482121+0000","last_peered":"2023-10-08T15:41:41.482121+0000","last_clean":"2023-10-08T15:41:41.482121+0000","last_became_active":"2023-10-08T15:41:41.481885+0000","last_became_peered":"2023-10-08T15:41:41.481885+0000","last_unstale":"2023-10-08T15:41:41.482121+0000","last_undegraded":"2023-10-08T15:41:41.482121+0000","last_fullsized":"2023-10-08T15:41:41.482121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:08.087172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484448+0000","last_change":"2023-10-08T15:41:41.484362+0000","last_active":"2023-10-08T15:41:41.484448+0000","last_peered":"2023-10-08T15:41:41.484448+0000","last_clean":"2023-10-08T15:41:41.484448+0000","last_became_active":"2023-10-08T15:41:41.484156+0000","last_became_peered":"2023-10-08T15:41:41.484156+0000","last_unstale":"2023-10-08T15:41:41.484448+0000","last_undegraded":"2023-10-08T15:41:41.484448+0000","last_fullsized":"2023-10-08T15:41:41.484448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:43.495228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856980+0000","last_change":"2023-10-08T15:41:40.860743+0000","last_active":"2023-10-08T15:41:41.856980+0000","last_peered":"2023-10-08T15:41:41.856980+0000","last_clean":"2023-10-08T15:41:41.856980+0000","last_became_active":"2023-10-08T15:41:40.860483+0000","last_became_peered":"2023-10-08T15:41:40.860483+0000","last_unstale":"2023-10-08T15:41:41.856980+0000","last_undegraded":"2023-10-08T15:41:41.856980+0000","last_fullsized":"2023-10-08T15:41:41.856980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:50.504964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489192+0000","last_change":"2023-10-08T15:41:41.488999+0000","last_active":"2023-10-08T15:41:41.489192+0000","last_peered":"2023-10-08T15:41:41.489192+0000","last_clean":"2023-10-08T15:41:41.489192+0000","last_became_active":"2023-10-08T15:41:41.488431+0000","last_became_peered":"2023-10-08T15:41:41.488431+0000","last_unstale":"2023-10-08T15:41:41.489192+0000","last_undegraded":"2023-10-08T15:41:41.489192+0000","last_fullsized":"2023-10-08T15:41:41.489192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:21.609878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857521+0000","last_change":"2023-10-08T15:41:40.860046+0000","last_active":"2023-10-08T15:41:41.857521+0000","last_peered":"2023-10-08T15:41:41.857521+0000","last_clean":"2023-10-08T15:41:41.857521+0000","last_became_active":"2023-10-08T15:41:40.859789+0000","last_became_peered":"2023-10-08T15:41:40.859789+0000","last_unstale":"2023-10-08T15:41:41.857521+0000","last_undegraded":"2023-10-08T15:41:41.857521+0000","last_fullsized":"2023-10-08T15:41:41.857521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:01.575067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487972+0000","last_change":"2023-10-08T15:41:41.487332+0000","last_active":"2023-10-08T15:41:41.487972+0000","last_peered":"2023-10-08T15:41:41.487972+0000","last_clean":"2023-10-08T15:41:41.487972+0000","last_became_active":"2023-10-08T15:41:41.487054+0000","last_became_peered":"2023-10-08T15:41:41.487054+0000","last_unstale":"2023-10-08T15:41:41.487972+0000","last_undegraded":"2023-10-08T15:41:41.487972+0000","last_fullsized":"2023-10-08T15:41:41.487972+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:36.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856892+0000","last_change":"2023-10-08T15:41:40.860339+0000","last_active":"2023-10-08T15:41:41.856892+0000","last_peered":"2023-10-08T15:41:41.856892+0000","last_clean":"2023-10-08T15:41:41.856892+0000","last_became_active":"2023-10-08T15:41:40.859744+0000","last_became_peered":"2023-10-08T15:41:40.859744+0000","last_unstale":"2023-10-08T15:41:41.856892+0000","last_undegraded":"2023-10-08T15:41:41.856892+0000","last_fullsized":"2023-10-08T15:41:41.856892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:53:13.002038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487627+0000","last_change":"2023-10-08T15:41:41.487572+0000","last_active":"2023-10-08T15:41:41.487627+0000","last_peered":"2023-10-08T15:41:41.487627+0000","last_clean":"2023-10-08T15:41:41.487627+0000","last_became_active":"2023-10-08T15:41:41.487315+0000","last_became_peered":"2023-10-08T15:41:41.487315+0000","last_unstale":"2023-10-08T15:41:41.487627+0000","last_undegraded":"2023-10-08T15:41:41.487627+0000","last_fullsized":"2023-10-08T15:41:41.487627+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:21.427885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857206+0000","last_change":"2023-10-08T15:41:40.861351+0000","last_active":"2023-10-08T15:41:41.857206+0000","last_peered":"2023-10-08T15:41:41.857206+0000","last_clean":"2023-10-08T15:41:41.857206+0000","last_became_active":"2023-10-08T15:41:40.860560+0000","last_became_peered":"2023-10-08T15:41:40.860560+0000","last_unstale":"2023-10-08T15:41:41.857206+0000","last_undegraded":"2023-10-08T15:41:41.857206+0000","last_fullsized":"2023-10-08T15:41:41.857206+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:06.410668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494158+0000","last_change":"2023-10-08T15:41:41.494083+0000","last_active":"2023-10-08T15:41:41.494158+0000","last_peered":"2023-10-08T15:41:41.494158+0000","last_clean":"2023-10-08T15:41:41.494158+0000","last_became_active":"2023-10-08T15:41:41.492617+0000","last_became_peered":"2023-10-08T15:41:41.492617+0000","last_unstale":"2023-10-08T15:41:41.494158+0000","last_undegraded":"2023-10-08T15:41:41.494158+0000","last_fullsized":"2023-10-08T15:41:41.494158+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:15.262018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856793+0000","last_change":"2023-10-08T15:41:40.861057+0000","last_active":"2023-10-08T15:41:41.856793+0000","last_peered":"2023-10-08T15:41:41.856793+0000","last_clean":"2023-10-08T15:41:41.856793+0000","last_became_active":"2023-10-08T15:41:40.860806+0000","last_became_peered":"2023-10-08T15:41:40.860806+0000","last_unstale":"2023-10-08T15:41:41.856793+0000","last_undegraded":"2023-10-08T15:41:41.856793+0000","last_fullsized":"2023-10-08T15:41:41.856793+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:06.410668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494651+0000","last_change":"2023-10-08T15:41:41.494593+0000","last_active":"2023-10-08T15:41:41.494651+0000","last_peered":"2023-10-08T15:41:41.494651+0000","last_clean":"2023-10-08T15:41:41.494651+0000","last_became_active":"2023-10-08T15:41:41.492793+0000","last_became_peered":"2023-10-08T15:41:41.492793+0000","last_unstale":"2023-10-08T15:41:41.494651+0000","last_undegraded":"2023-10-08T15:41:41.494651+0000","last_fullsized":"2023-10-08T15:41:41.494651+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:07.414987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857073+0000","last_change":"2023-10-08T15:41:40.855400+0000","last_active":"2023-10-08T15:41:41.857073+0000","last_peered":"2023-10-08T15:41:41.857073+0000","last_clean":"2023-10-08T15:41:41.857073+0000","last_became_active":"2023-10-08T15:41:40.855182+0000","last_became_peered":"2023-10-08T15:41:40.855182+0000","last_unstale":"2023-10-08T15:41:41.857073+0000","last_undegraded":"2023-10-08T15:41:41.857073+0000","last_fullsized":"2023-10-08T15:41:41.857073+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:19.067208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494214+0000","last_change":"2023-10-08T15:41:41.493985+0000","last_active":"2023-10-08T15:41:41.494214+0000","last_peered":"2023-10-08T15:41:41.494214+0000","last_clean":"2023-10-08T15:41:41.494214+0000","last_became_active":"2023-10-08T15:41:41.493304+0000","last_became_peered":"2023-10-08T15:41:41.493304+0000","last_unstale":"2023-10-08T15:41:41.494214+0000","last_undegraded":"2023-10-08T15:41:41.494214+0000","last_fullsized":"2023-10-08T15:41:41.494214+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:22.869094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484891+0000","last_change":"2023-10-08T15:41:40.858282+0000","last_active":"2023-10-08T15:41:41.484891+0000","last_peered":"2023-10-08T15:41:41.484891+0000","last_clean":"2023-10-08T15:41:41.484891+0000","last_became_active":"2023-10-08T15:41:40.858047+0000","last_became_peered":"2023-10-08T15:41:40.858047+0000","last_unstale":"2023-10-08T15:41:41.484891+0000","last_undegraded":"2023-10-08T15:41:41.484891+0000","last_fullsized":"2023-10-08T15:41:41.484891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:59.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489768+0000","last_change":"2023-10-08T15:41:41.489478+0000","last_active":"2023-10-08T15:41:41.489768+0000","last_peered":"2023-10-08T15:41:41.489768+0000","last_clean":"2023-10-08T15:41:41.489768+0000","last_became_active":"2023-10-08T15:41:41.488852+0000","last_became_peered":"2023-10-08T15:41:41.488852+0000","last_unstale":"2023-10-08T15:41:41.489768+0000","last_undegraded":"2023-10-08T15:41:41.489768+0000","last_fullsized":"2023-10-08T15:41:41.489768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:41.202414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.491540+0000","last_change":"2023-10-08T15:41:40.863326+0000","last_active":"2023-10-08T15:41:41.491540+0000","last_peered":"2023-10-08T15:41:41.491540+0000","last_clean":"2023-10-08T15:41:41.491540+0000","last_became_active":"2023-10-08T15:41:40.862486+0000","last_became_peered":"2023-10-08T15:41:40.862486+0000","last_unstale":"2023-10-08T15:41:41.491540+0000","last_undegraded":"2023-10-08T15:41:41.491540+0000","last_fullsized":"2023-10-08T15:41:41.491540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:48.569840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494143+0000","last_change":"2023-10-08T15:41:41.494076+0000","last_active":"2023-10-08T15:41:41.494143+0000","last_peered":"2023-10-08T15:41:41.494143+0000","last_clean":"2023-10-08T15:41:41.494143+0000","last_became_active":"2023-10-08T15:41:41.493782+0000","last_became_peered":"2023-10-08T15:41:41.493782+0000","last_unstale":"2023-10-08T15:41:41.494143+0000","last_undegraded":"2023-10-08T15:41:41.494143+0000","last_fullsized":"2023-10-08T15:41:41.494143+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:36.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.481859+0000","last_change":"2023-10-08T15:41:40.859077+0000","last_active":"2023-10-08T15:41:41.481859+0000","last_peered":"2023-10-08T15:41:41.481859+0000","last_clean":"2023-10-08T15:41:41.481859+0000","last_became_active":"2023-10-08T15:41:40.858766+0000","last_became_peered":"2023-10-08T15:41:40.858766+0000","last_unstale":"2023-10-08T15:41:41.481859+0000","last_undegraded":"2023-10-08T15:41:41.481859+0000","last_fullsized":"2023-10-08T15:41:41.481859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:01.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489255+0000","last_change":"2023-10-08T15:41:41.489094+0000","last_active":"2023-10-08T15:41:41.489255+0000","last_peered":"2023-10-08T15:41:41.489255+0000","last_clean":"2023-10-08T15:41:41.489255+0000","last_became_active":"2023-10-08T15:41:41.488870+0000","last_became_peered":"2023-10-08T15:41:41.488870+0000","last_unstale":"2023-10-08T15:41:41.489255+0000","last_undegraded":"2023-10-08T15:41:41.489255+0000","last_fullsized":"2023-10-08T15:41:41.489255+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:48.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489556+0000","last_change":"2023-10-08T15:41:40.860436+0000","last_active":"2023-10-08T15:41:41.489556+0000","last_peered":"2023-10-08T15:41:41.489556+0000","last_clean":"2023-10-08T15:41:41.489556+0000","last_became_active":"2023-10-08T15:41:40.860010+0000","last_became_peered":"2023-10-08T15:41:40.860010+0000","last_unstale":"2023-10-08T15:41:41.489556+0000","last_undegraded":"2023-10-08T15:41:41.489556+0000","last_fullsized":"2023-10-08T15:41:41.489556+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:23.759714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484405+0000","last_change":"2023-10-08T15:41:41.484324+0000","last_active":"2023-10-08T15:41:41.484405+0000","last_peered":"2023-10-08T15:41:41.484405+0000","last_clean":"2023-10-08T15:41:41.484405+0000","last_became_active":"2023-10-08T15:41:41.483791+0000","last_became_peered":"2023-10-08T15:41:41.483791+0000","last_unstale":"2023-10-08T15:41:41.484405+0000","last_undegraded":"2023-10-08T15:41:41.484405+0000","last_fullsized":"2023-10-08T15:41:41.484405+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:43:31.955693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857304+0000","last_change":"2023-10-08T15:41:40.860722+0000","last_active":"2023-10-08T15:41:41.857304+0000","last_peered":"2023-10-08T15:41:41.857304+0000","last_clean":"2023-10-08T15:41:41.857304+0000","last_became_active":"2023-10-08T15:41:40.859917+0000","last_became_peered":"2023-10-08T15:41:40.859917+0000","last_unstale":"2023-10-08T15:41:41.857304+0000","last_undegraded":"2023-10-08T15:41:41.857304+0000","last_fullsized":"2023-10-08T15:41:41.857304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:48.579255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.490841+0000","last_change":"2023-10-08T15:41:41.490609+0000","last_active":"2023-10-08T15:41:41.490841+0000","last_peered":"2023-10-08T15:41:41.490841+0000","last_clean":"2023-10-08T15:41:41.490841+0000","last_became_active":"2023-10-08T15:41:41.489691+0000","last_became_peered":"2023-10-08T15:41:41.489691+0000","last_unstale":"2023-10-08T15:41:41.490841+0000","last_undegraded":"2023-10-08T15:41:41.490841+0000","last_fullsized":"2023-10-08T15:41:41.490841+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:25.532240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.858831+0000","last_change":"2023-10-08T15:41:40.850824+0000","last_active":"2023-10-08T15:41:41.858831+0000","last_peered":"2023-10-08T15:41:41.858831+0000","last_clean":"2023-10-08T15:41:41.858831+0000","last_became_active":"2023-10-08T15:41:40.850596+0000","last_became_peered":"2023-10-08T15:41:40.850596+0000","last_unstale":"2023-10-08T15:41:41.858831+0000","last_undegraded":"2023-10-08T15:41:41.858831+0000","last_fullsized":"2023-10-08T15:41:41.858831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:35:37.626905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494013+0000","last_change":"2023-10-08T15:41:41.493899+0000","last_active":"2023-10-08T15:41:41.494013+0000","last_peered":"2023-10-08T15:41:41.494013+0000","last_clean":"2023-10-08T15:41:41.494013+0000","last_became_active":"2023-10-08T15:41:41.493393+0000","last_became_peered":"2023-10-08T15:41:41.493393+0000","last_unstale":"2023-10-08T15:41:41.494013+0000","last_undegraded":"2023-10-08T15:41:41.494013+0000","last_fullsized":"2023-10-08T15:41:41.494013+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:02.127434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856150+0000","last_change":"2023-10-08T15:41:40.861865+0000","last_active":"2023-10-08T15:41:41.856150+0000","last_peered":"2023-10-08T15:41:41.856150+0000","last_clean":"2023-10-08T15:41:41.856150+0000","last_became_active":"2023-10-08T15:41:40.861660+0000","last_became_peered":"2023-10-08T15:41:40.861660+0000","last_unstale":"2023-10-08T15:41:41.856150+0000","last_undegraded":"2023-10-08T15:41:41.856150+0000","last_fullsized":"2023-10-08T15:41:41.856150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:02.021821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494134+0000","last_change":"2023-10-08T15:41:41.493078+0000","last_active":"2023-10-08T15:41:41.494134+0000","last_peered":"2023-10-08T15:41:41.494134+0000","last_clean":"2023-10-08T15:41:41.494134+0000","last_became_active":"2023-10-08T15:41:41.492459+0000","last_became_peered":"2023-10-08T15:41:41.492459+0000","last_unstale":"2023-10-08T15:41:41.494134+0000","last_undegraded":"2023-10-08T15:41:41.494134+0000","last_fullsized":"2023-10-08T15:41:41.494134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:02.127434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487671+0000","last_change":"2023-10-08T15:41:40.861078+0000","last_active":"2023-10-08T15:41:41.487671+0000","last_peered":"2023-10-08T15:41:41.487671+0000","last_clean":"2023-10-08T15:41:41.487671+0000","last_became_active":"2023-10-08T15:41:40.859713+0000","last_became_peered":"2023-10-08T15:41:40.859713+0000","last_unstale":"2023-10-08T15:41:41.487671+0000","last_undegraded":"2023-10-08T15:41:41.487671+0000","last_fullsized":"2023-10-08T15:41:41.487671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:19.651900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.482707+0000","last_change":"2023-10-08T15:41:41.482641+0000","last_active":"2023-10-08T15:41:41.482707+0000","last_peered":"2023-10-08T15:41:41.482707+0000","last_clean":"2023-10-08T15:41:41.482707+0000","last_became_active":"2023-10-08T15:41:41.482405+0000","last_became_peered":"2023-10-08T15:41:41.482405+0000","last_unstale":"2023-10-08T15:41:41.482707+0000","last_undegraded":"2023-10-08T15:41:41.482707+0000","last_fullsized":"2023-10-08T15:41:41.482707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:12:32.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.480697+0000","last_change":"2023-10-08T15:41:40.862062+0000","last_active":"2023-10-08T15:41:41.480697+0000","last_peered":"2023-10-08T15:41:41.480697+0000","last_clean":"2023-10-08T15:41:41.480697+0000","last_became_active":"2023-10-08T15:41:40.861906+0000","last_became_peered":"2023-10-08T15:41:40.861906+0000","last_unstale":"2023-10-08T15:41:41.480697+0000","last_undegraded":"2023-10-08T15:41:41.480697+0000","last_fullsized":"2023-10-08T15:41:41.480697+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:05.423895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.490861+0000","last_change":"2023-10-08T15:41:41.490641+0000","last_active":"2023-10-08T15:41:41.490861+0000","last_peered":"2023-10-08T15:41:41.490861+0000","last_clean":"2023-10-08T15:41:41.490861+0000","last_became_active":"2023-10-08T15:41:41.490397+0000","last_became_peered":"2023-10-08T15:41:41.490397+0000","last_unstale":"2023-10-08T15:41:41.490861+0000","last_undegraded":"2023-10-08T15:41:41.490861+0000","last_fullsized":"2023-10-08T15:41:41.490861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:16:29.906578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.860379+0000","last_change":"2023-10-08T15:41:40.859785+0000","last_active":"2023-10-08T15:41:41.860379+0000","last_peered":"2023-10-08T15:41:41.860379+0000","last_clean":"2023-10-08T15:41:41.860379+0000","last_became_active":"2023-10-08T15:41:40.859466+0000","last_became_peered":"2023-10-08T15:41:40.859466+0000","last_unstale":"2023-10-08T15:41:41.860379+0000","last_undegraded":"2023-10-08T15:41:41.860379+0000","last_fullsized":"2023-10-08T15:41:41.860379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:36.437706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486062+0000","last_change":"2023-10-08T15:41:41.486003+0000","last_active":"2023-10-08T15:41:41.486062+0000","last_peered":"2023-10-08T15:41:41.486062+0000","last_clean":"2023-10-08T15:41:41.486062+0000","last_became_active":"2023-10-08T15:41:41.485789+0000","last_became_peered":"2023-10-08T15:41:41.485789+0000","last_unstale":"2023-10-08T15:41:41.486062+0000","last_undegraded":"2023-10-08T15:41:41.486062+0000","last_fullsized":"2023-10-08T15:41:41.486062+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:49.574159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856750+0000","last_change":"2023-10-08T15:41:40.856838+0000","last_active":"2023-10-08T15:41:41.856750+0000","last_peered":"2023-10-08T15:41:41.856750+0000","last_clean":"2023-10-08T15:41:41.856750+0000","last_became_active":"2023-10-08T15:41:40.856570+0000","last_became_peered":"2023-10-08T15:41:40.856570+0000","last_unstale":"2023-10-08T15:41:41.856750+0000","last_undegraded":"2023-10-08T15:41:41.856750+0000","last_fullsized":"2023-10-08T15:41:41.856750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:28.834865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492559+0000","last_change":"2023-10-08T15:41:41.492512+0000","last_active":"2023-10-08T15:41:41.492559+0000","last_peered":"2023-10-08T15:41:41.492559+0000","last_clean":"2023-10-08T15:41:41.492559+0000","last_became_active":"2023-10-08T15:41:41.491884+0000","last_became_peered":"2023-10-08T15:41:41.491884+0000","last_unstale":"2023-10-08T15:41:41.492559+0000","last_undegraded":"2023-10-08T15:41:41.492559+0000","last_fullsized":"2023-10-08T15:41:41.492559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:03.026140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857394+0000","last_change":"2023-10-08T15:41:40.857736+0000","last_active":"2023-10-08T15:41:41.857394+0000","last_peered":"2023-10-08T15:41:41.857394+0000","last_clean":"2023-10-08T15:41:41.857394+0000","last_became_active":"2023-10-08T15:41:40.857517+0000","last_became_peered":"2023-10-08T15:41:40.857517+0000","last_unstale":"2023-10-08T15:41:41.857394+0000","last_undegraded":"2023-10-08T15:41:41.857394+0000","last_fullsized":"2023-10-08T15:41:41.857394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:20.605560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.485142+0000","last_change":"2023-10-08T15:41:41.483934+0000","last_active":"2023-10-08T15:41:41.485142+0000","last_peered":"2023-10-08T15:41:41.485142+0000","last_clean":"2023-10-08T15:41:41.485142+0000","last_became_active":"2023-10-08T15:41:41.483689+0000","last_became_peered":"2023-10-08T15:41:41.483689+0000","last_unstale":"2023-10-08T15:41:41.485142+0000","last_undegraded":"2023-10-08T15:41:41.485142+0000","last_fullsized":"2023-10-08T15:41:41.485142+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:35:02.579386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.855815+0000","last_change":"2023-10-08T15:41:40.859560+0000","last_active":"2023-10-08T15:41:41.855815+0000","last_peered":"2023-10-08T15:41:41.855815+0000","last_clean":"2023-10-08T15:41:41.855815+0000","last_became_active":"2023-10-08T15:41:40.859330+0000","last_became_peered":"2023-10-08T15:41:40.859330+0000","last_unstale":"2023-10-08T15:41:41.855815+0000","last_undegraded":"2023-10-08T15:41:41.855815+0000","last_fullsized":"2023-10-08T15:41:41.855815+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:04:25.886517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.488147+0000","last_change":"2023-10-08T15:41:41.488080+0000","last_active":"2023-10-08T15:41:41.488147+0000","last_peered":"2023-10-08T15:41:41.488147+0000","last_clean":"2023-10-08T15:41:41.488147+0000","last_became_active":"2023-10-08T15:41:41.487847+0000","last_became_peered":"2023-10-08T15:41:41.487847+0000","last_unstale":"2023-10-08T15:41:41.488147+0000","last_undegraded":"2023-10-08T15:41:41.488147+0000","last_fullsized":"2023-10-08T15:41:41.488147+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:29.505306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.480787+0000","last_change":"2023-10-08T15:41:40.858139+0000","last_active":"2023-10-08T15:41:41.480787+0000","last_peered":"2023-10-08T15:41:41.480787+0000","last_clean":"2023-10-08T15:41:41.480787+0000","last_became_active":"2023-10-08T15:41:40.857818+0000","last_became_peered":"2023-10-08T15:41:40.857818+0000","last_unstale":"2023-10-08T15:41:41.480787+0000","last_undegraded":"2023-10-08T15:41:41.480787+0000","last_fullsized":"2023-10-08T15:41:41.480787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:19.651900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484186+0000","last_change":"2023-10-08T15:41:41.484022+0000","last_active":"2023-10-08T15:41:41.484186+0000","last_peered":"2023-10-08T15:41:41.484186+0000","last_clean":"2023-10-08T15:41:41.484186+0000","last_became_active":"2023-10-08T15:41:41.483490+0000","last_became_peered":"2023-10-08T15:41:41.483490+0000","last_unstale":"2023-10-08T15:41:41.484186+0000","last_undegraded":"2023-10-08T15:41:41.484186+0000","last_fullsized":"2023-10-08T15:41:41.484186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:38.280994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.857294+0000","last_change":"2023-10-08T15:41:40.859775+0000","last_active":"2023-10-08T15:41:41.857294+0000","last_peered":"2023-10-08T15:41:41.857294+0000","last_clean":"2023-10-08T15:41:41.857294+0000","last_became_active":"2023-10-08T15:41:40.859525+0000","last_became_peered":"2023-10-08T15:41:40.859525+0000","last_unstale":"2023-10-08T15:41:41.857294+0000","last_undegraded":"2023-10-08T15:41:41.857294+0000","last_fullsized":"2023-10-08T15:41:41.857294+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:14.257699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486478+0000","last_change":"2023-10-08T15:41:41.485997+0000","last_active":"2023-10-08T15:41:41.486478+0000","last_peered":"2023-10-08T15:41:41.486478+0000","last_clean":"2023-10-08T15:41:41.486478+0000","last_became_active":"2023-10-08T15:41:41.485761+0000","last_became_peered":"2023-10-08T15:41:41.485761+0000","last_unstale":"2023-10-08T15:41:41.486478+0000","last_undegraded":"2023-10-08T15:41:41.486478+0000","last_fullsized":"2023-10-08T15:41:41.486478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:41.202414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484994+0000","last_change":"2023-10-08T15:41:40.860066+0000","last_active":"2023-10-08T15:41:41.484994+0000","last_peered":"2023-10-08T15:41:41.484994+0000","last_clean":"2023-10-08T15:41:41.484994+0000","last_became_active":"2023-10-08T15:41:40.859801+0000","last_became_peered":"2023-10-08T15:41:40.859801+0000","last_unstale":"2023-10-08T15:41:41.484994+0000","last_undegraded":"2023-10-08T15:41:41.484994+0000","last_fullsized":"2023-10-08T15:41:41.484994+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:40.198095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489176+0000","last_change":"2023-10-08T15:41:41.489116+0000","last_active":"2023-10-08T15:41:41.489176+0000","last_peered":"2023-10-08T15:41:41.489176+0000","last_clean":"2023-10-08T15:41:41.489176+0000","last_became_active":"2023-10-08T15:41:41.488893+0000","last_became_peered":"2023-10-08T15:41:41.488893+0000","last_unstale":"2023-10-08T15:41:41.489176+0000","last_undegraded":"2023-10-08T15:41:41.489176+0000","last_fullsized":"2023-10-08T15:41:41.489176+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:24.764033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.491458+0000","last_change":"2023-10-08T15:41:40.863462+0000","last_active":"2023-10-08T15:41:41.491458+0000","last_peered":"2023-10-08T15:41:41.491458+0000","last_clean":"2023-10-08T15:41:41.491458+0000","last_became_active":"2023-10-08T15:41:40.862742+0000","last_became_peered":"2023-10-08T15:41:40.862742+0000","last_unstale":"2023-10-08T15:41:41.491458+0000","last_undegraded":"2023-10-08T15:41:41.491458+0000","last_fullsized":"2023-10-08T15:41:41.491458+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:07.082853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.494199+0000","last_change":"2023-10-08T15:41:41.493818+0000","last_active":"2023-10-08T15:41:41.494199+0000","last_peered":"2023-10-08T15:41:41.494199+0000","last_clean":"2023-10-08T15:41:41.494199+0000","last_became_active":"2023-10-08T15:41:41.492725+0000","last_became_peered":"2023-10-08T15:41:41.492725+0000","last_unstale":"2023-10-08T15:41:41.494199+0000","last_undegraded":"2023-10-08T15:41:41.494199+0000","last_fullsized":"2023-10-08T15:41:41.494199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.763415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487763+0000","last_change":"2023-10-08T15:41:40.861232+0000","last_active":"2023-10-08T15:41:41.487763+0000","last_peered":"2023-10-08T15:41:41.487763+0000","last_clean":"2023-10-08T15:41:41.487763+0000","last_became_active":"2023-10-08T15:41:40.860261+0000","last_became_peered":"2023-10-08T15:41:40.860261+0000","last_unstale":"2023-10-08T15:41:41.487763+0000","last_undegraded":"2023-10-08T15:41:41.487763+0000","last_fullsized":"2023-10-08T15:41:41.487763+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:49.015826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.493993+0000","last_change":"2023-10-08T15:41:41.493877+0000","last_active":"2023-10-08T15:41:41.493993+0000","last_peered":"2023-10-08T15:41:41.493993+0000","last_clean":"2023-10-08T15:41:41.493993+0000","last_became_active":"2023-10-08T15:41:41.493521+0000","last_became_peered":"2023-10-08T15:41:41.493521+0000","last_unstale":"2023-10-08T15:41:41.493993+0000","last_undegraded":"2023-10-08T15:41:41.493993+0000","last_fullsized":"2023-10-08T15:41:41.493993+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:43.495228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.480810+0000","last_change":"2023-10-08T15:41:40.857718+0000","last_active":"2023-10-08T15:41:41.480810+0000","last_peered":"2023-10-08T15:41:41.480810+0000","last_clean":"2023-10-08T15:41:41.480810+0000","last_became_active":"2023-10-08T15:41:40.857232+0000","last_became_peered":"2023-10-08T15:41:40.857232+0000","last_unstale":"2023-10-08T15:41:41.480810+0000","last_undegraded":"2023-10-08T15:41:41.480810+0000","last_fullsized":"2023-10-08T15:41:41.480810+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:14:35.575737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.495258+0000","last_change":"2023-10-08T15:41:41.494841+0000","last_active":"2023-10-08T15:41:41.495258+0000","last_peered":"2023-10-08T15:41:41.495258+0000","last_clean":"2023-10-08T15:41:41.495258+0000","last_became_active":"2023-10-08T15:41:41.494611+0000","last_became_peered":"2023-10-08T15:41:41.494611+0000","last_unstale":"2023-10-08T15:41:41.495258+0000","last_undegraded":"2023-10-08T15:41:41.495258+0000","last_fullsized":"2023-10-08T15:41:41.495258+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:10:20.656219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486318+0000","last_change":"2023-10-08T15:41:40.861176+0000","last_active":"2023-10-08T15:41:41.486318+0000","last_peered":"2023-10-08T15:41:41.486318+0000","last_clean":"2023-10-08T15:41:41.486318+0000","last_became_active":"2023-10-08T15:41:40.860474+0000","last_became_peered":"2023-10-08T15:41:40.860474+0000","last_unstale":"2023-10-08T15:41:41.486318+0000","last_undegraded":"2023-10-08T15:41:41.486318+0000","last_fullsized":"2023-10-08T15:41:41.486318+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:26:59.598740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.489833+0000","last_change":"2023-10-08T15:41:41.489625+0000","last_active":"2023-10-08T15:41:41.489833+0000","last_peered":"2023-10-08T15:41:41.489833+0000","last_clean":"2023-10-08T15:41:41.489833+0000","last_became_active":"2023-10-08T15:41:41.489181+0000","last_became_peered":"2023-10-08T15:41:41.489181+0000","last_unstale":"2023-10-08T15:41:41.489833+0000","last_undegraded":"2023-10-08T15:41:41.489833+0000","last_fullsized":"2023-10-08T15:41:41.489833+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:49.137097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.481215+0000","last_change":"2023-10-08T15:41:40.860487+0000","last_active":"2023-10-08T15:41:41.481215+0000","last_peered":"2023-10-08T15:41:41.481215+0000","last_clean":"2023-10-08T15:41:41.481215+0000","last_became_active":"2023-10-08T15:41:40.860112+0000","last_became_peered":"2023-10-08T15:41:40.860112+0000","last_unstale":"2023-10-08T15:41:41.481215+0000","last_undegraded":"2023-10-08T15:41:41.481215+0000","last_fullsized":"2023-10-08T15:41:41.481215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:28.500987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.482573+0000","last_change":"2023-10-08T15:41:41.482508+0000","last_active":"2023-10-08T15:41:41.482573+0000","last_peered":"2023-10-08T15:41:41.482573+0000","last_clean":"2023-10-08T15:41:41.482573+0000","last_became_active":"2023-10-08T15:41:41.482295+0000","last_became_peered":"2023-10-08T15:41:41.482295+0000","last_unstale":"2023-10-08T15:41:41.482573+0000","last_undegraded":"2023-10-08T15:41:41.482573+0000","last_fullsized":"2023-10-08T15:41:41.482573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:28:55.278833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.488140+0000","last_change":"2023-10-08T15:41:40.861598+0000","last_active":"2023-10-08T15:41:41.488140+0000","last_peered":"2023-10-08T15:41:41.488140+0000","last_clean":"2023-10-08T15:41:41.488140+0000","last_became_active":"2023-10-08T15:41:40.860886+0000","last_became_peered":"2023-10-08T15:41:40.860886+0000","last_unstale":"2023-10-08T15:41:41.488140+0000","last_undegraded":"2023-10-08T15:41:41.488140+0000","last_fullsized":"2023-10-08T15:41:41.488140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:36.759097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.484331+0000","last_change":"2023-10-08T15:41:41.484258+0000","last_active":"2023-10-08T15:41:41.484331+0000","last_peered":"2023-10-08T15:41:41.484331+0000","last_clean":"2023-10-08T15:41:41.484331+0000","last_became_active":"2023-10-08T15:41:41.483646+0000","last_became_peered":"2023-10-08T15:41:41.483646+0000","last_unstale":"2023-10-08T15:41:41.484331+0000","last_undegraded":"2023-10-08T15:41:41.484331+0000","last_fullsized":"2023-10-08T15:41:41.484331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:38.623720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.482870+0000","last_change":"2023-10-08T15:41:40.856487+0000","last_active":"2023-10-08T15:41:41.482870+0000","last_peered":"2023-10-08T15:41:41.482870+0000","last_clean":"2023-10-08T15:41:41.482870+0000","last_became_active":"2023-10-08T15:41:40.856255+0000","last_became_peered":"2023-10-08T15:41:40.856255+0000","last_unstale":"2023-10-08T15:41:41.482870+0000","last_undegraded":"2023-10-08T15:41:41.482870+0000","last_fullsized":"2023-10-08T15:41:41.482870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:42.490910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487996+0000","last_change":"2023-10-08T15:41:41.487617+0000","last_active":"2023-10-08T15:41:41.487996+0000","last_peered":"2023-10-08T15:41:41.487996+0000","last_clean":"2023-10-08T15:41:41.487996+0000","last_became_active":"2023-10-08T15:41:41.487486+0000","last_became_peered":"2023-10-08T15:41:41.487486+0000","last_unstale":"2023-10-08T15:41:41.487996+0000","last_undegraded":"2023-10-08T15:41:41.487996+0000","last_fullsized":"2023-10-08T15:41:41.487996+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.509283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.480665+0000","last_change":"2023-10-08T15:41:40.859594+0000","last_active":"2023-10-08T15:41:41.480665+0000","last_peered":"2023-10-08T15:41:41.480665+0000","last_clean":"2023-10-08T15:41:41.480665+0000","last_became_active":"2023-10-08T15:41:40.859353+0000","last_became_peered":"2023-10-08T15:41:40.859353+0000","last_unstale":"2023-10-08T15:41:41.480665+0000","last_undegraded":"2023-10-08T15:41:41.480665+0000","last_fullsized":"2023-10-08T15:41:41.480665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:20.609281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.491081+0000","last_change":"2023-10-08T15:41:41.490963+0000","last_active":"2023-10-08T15:41:41.491081+0000","last_peered":"2023-10-08T15:41:41.491081+0000","last_clean":"2023-10-08T15:41:41.491081+0000","last_became_active":"2023-10-08T15:41:41.490735+0000","last_became_peered":"2023-10-08T15:41:41.490735+0000","last_unstale":"2023-10-08T15:41:41.491081+0000","last_undegraded":"2023-10-08T15:41:41.491081+0000","last_fullsized":"2023-10-08T15:41:41.491081+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:07.414987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.487988+0000","last_change":"2023-10-08T15:41:40.863002+0000","last_active":"2023-10-08T15:41:41.487988+0000","last_peered":"2023-10-08T15:41:41.487988+0000","last_clean":"2023-10-08T15:41:41.487988+0000","last_became_active":"2023-10-08T15:41:40.862500+0000","last_became_peered":"2023-10-08T15:41:40.862500+0000","last_unstale":"2023-10-08T15:41:41.487988+0000","last_undegraded":"2023-10-08T15:41:41.487988+0000","last_fullsized":"2023-10-08T15:41:41.487988+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:59:58.707663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.492348+0000","last_change":"2023-10-08T15:41:41.492198+0000","last_active":"2023-10-08T15:41:41.492348+0000","last_peered":"2023-10-08T15:41:41.492348+0000","last_clean":"2023-10-08T15:41:41.492348+0000","last_became_active":"2023-10-08T15:41:41.491953+0000","last_became_peered":"2023-10-08T15:41:41.491953+0000","last_unstale":"2023-10-08T15:41:41.492348+0000","last_undegraded":"2023-10-08T15:41:41.492348+0000","last_fullsized":"2023-10-08T15:41:41.492348+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:40.844098+0000","last_clean_scrub_stamp":"2023-10-08T15:41:40.844098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:15.262018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.856422+0000","last_change":"2023-10-08T15:41:40.857523+0000","last_active":"2023-10-08T15:41:41.856422+0000","last_peered":"2023-10-08T15:41:41.856422+0000","last_clean":"2023-10-08T15:41:41.856422+0000","last_became_active":"2023-10-08T15:41:40.857044+0000","last_became_peered":"2023-10-08T15:41:40.857044+0000","last_unstale":"2023-10-08T15:41:41.856422+0000","last_undegraded":"2023-10-08T15:41:41.856422+0000","last_fullsized":"2023-10-08T15:41:41.856422+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:41:39.839780+0000","last_clean_scrub_stamp":"2023-10-08T15:41:39.839780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:04:48.579255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-08T15:41:41.486406+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:41:41.486406+0000","last_peered":"2023-10-08T15:41:41.486406+0000","last_clean":"2023-10-08T15:41:41.486406+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:41:41.486406+0000","last_undegraded":"2023-10-08T15:41:41.486406+0000","last_fullsized":"2023-10-08T15:41:41.486406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195831,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.439}]},{"osd":2,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.61099999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.627},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785645,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.30599999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.43099999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.442},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.5}]},{"osd":5,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48199999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.30499999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.41699999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.8260000000000001,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.316},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.30399999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":0.36899999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.754},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Oct 8 15:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.72599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.38}]},{"osd":1,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.32300000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.28299999999999997}]},{"osd":4,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81100000000000005}]},{"osd":5,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.625},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195109,"statfs":{"total":200000000,"available":199791967,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35799999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.372},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.58099999999999996}]},{"osd":6,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.57299999999999995}]},{"osd":7,"last update":"Sun Oct 8 15:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195108,"statfs":{"total":200000000,"available":199791041,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.66600000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47099999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Sun Oct 8 15:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.438},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.372},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.438},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 15:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.623},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59699999999999998}]}]}],"pool_statfs":[]}} 2023-10-08T15:41:46.352 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T15:41:46.352 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T15:41:46.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.512+0000 7f145919d700 1 Processor -- start 2023-10-08T15:41:46.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.513+0000 7f145919d700 1 -- start start 2023-10-08T15:41:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.513+0000 7f145919d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14540c9390 0x7f1454164f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.513+0000 7f145919d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145415e9a0 con 0x7f14540cbf10 2023-10-08T15:41:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.513+0000 7f145919d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14540cae70 con 0x7f14540678b0 2023-10-08T15:41:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.513+0000 7f145919d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14540cb150 con 0x7f14540c9390 2023-10-08T15:41:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f145259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f14540cbf10 0x7f145415e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37598/0 (socket says 172.21.15.29:37598) 2023-10-08T15:41:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f145259c700 1 -- 172.21.15.29:0/3800312169 learned_addr learned my addr 172.21.15.29:0/3800312169 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800029607 0 0) 0x7f145415e9a0 con 0x7f14540cbf10 2023-10-08T15:41:46.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f145359e700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14540c9390 0x7f1454164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1440003570 con 0x7f14540cbf10 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105006283 0 0) 0x7f1440003570 con 0x7f14540cbf10 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14540c9390 msgr2=0x7f1454164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14540c9390 0x7f1454164f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 >> v1:172.21.15.183:6789/0 conn(0x7f14540678b0 legacy=0x7f145415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14540cb430 con 0x7f14540cbf10 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f143c001470 con 0x7f14540cbf10 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 >> v1:172.21.15.29:6789/0 conn(0x7f14540cbf10 legacy=0x7f145415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440003a90 0x7f1440003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1440004810 0x7f1440004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14540c9390 0x7f14400051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14540cb150 con 0x7f1440003a90 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144000bb90 con 0x7f1440004810 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144000bd50 con 0x7f14540c9390 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f1452d9d700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440003a90 0x7f1440003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f145259c700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1440004810 0x7f1440004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.514+0000 7f145359e700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14540c9390 0x7f14400051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1452d9d700 1 -- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14540c9390 msgr2=0x7f14400051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1452d9d700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14540c9390 0x7f14400051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1452d9d700 1 -- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1440004810 msgr2=0x7f1440004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1452d9d700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1440004810 0x7f1440004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1452d9d700 1 -- 172.21.15.29:0/3800312169 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440003570 con 0x7f1440003a90 2023-10-08T15:41:46.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1452d9d700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440003a90 0x7f1440003ea0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f14440018b0 tx=0x7f1444007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374838896fcf7040 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444012420 con 0x7f1440003a90 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444012580 con 0x7f1440003a90 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f1451d9b700 1 -- 172.21.15.29:0/3800312169 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444012920 con 0x7f1440003a90 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f145919d700 1 -- 172.21.15.29:0/3800312169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440003a90 msgr2=0x7f1440003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f145919d700 1 --2- 172.21.15.29:0/3800312169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440003a90 0x7f1440003ea0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f14440018b0 tx=0x7f1444007d30 comp rx=0 tx=0).stop 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.515+0000 7f145359e700 1 -- 172.21.15.29:0/3800312169 reap_dead start 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.516+0000 7f145919d700 1 -- 172.21.15.29:0/3800312169 shutdown_connections 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.516+0000 7f145919d700 1 -- 172.21.15.29:0/3800312169 >> 172.21.15.29:0/3800312169 conn(0x7f1454069870 msgr2=0x7f1454069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.516+0000 7f145919d700 1 -- 172.21.15.29:0/3800312169 shutdown_connections 2023-10-08T15:41:46.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.516+0000 7f145919d700 1 -- 172.21.15.29:0/3800312169 wait complete. 2023-10-08T15:41:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.517+0000 7f145919d700 1 Processor -- start 2023-10-08T15:41:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.517+0000 7f145919d700 1 -- start start 2023-10-08T15:41:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145919d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1440003a90 0x7f14540c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145919d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145416f370 0x7f1454150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145919d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f145416e1a0 0x7f1454154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145919d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1454150d80 con 0x7f145416f370 2023-10-08T15:41:46.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145919d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14540c7000 con 0x7f145416e1a0 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145919d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14540c72e0 con 0x7f1440003a90 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145416f370 0x7f1454150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145416f370 0x7f1454150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36368/0 (socket says 172.21.15.29:36368) 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 -- 172.21.15.29:0/1882332296 learned_addr learned my addr 172.21.15.29:0/1882332296 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f1452d9d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1440003a90 0x7f14540c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145359e700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f145416e1a0 0x7f1454154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 -- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1440003a90 msgr2=0x7f14540c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1440003a90 0x7f14540c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 -- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f145416e1a0 msgr2=0x7f1454154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f145416e1a0 0x7f1454154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.524 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 -- 172.21.15.29:0/1882332296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145416e9f0 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145259c700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145416f370 0x7f1454150840 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f143c0073c0 tx=0x7f143c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f144affd700 1 -- 172.21.15.29:0/1882332296 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00f5e0 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f144affd700 1 -- 172.21.15.29:0/1882332296 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c00f760 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145416ecd0 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f144affd700 1 -- 172.21.15.29:0/1882332296 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00fb20 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.518+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145416e640 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.519+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145404c3c0 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.520+0000 7f144affd700 1 -- 172.21.15.29:0/1882332296 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f143c01e3b0 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.520+0000 7f144affd700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1434066f30 0x7f14340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.520+0000 7f144affd700 1 -- 172.21.15.29:0/1882332296 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f143c084100 con 0x7f145416f370 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.520+0000 7f1452d9d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1434066f30 0x7f14340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.521+0000 7f1452d9d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1434066f30 0x7f14340693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14540c4100 tx=0x7f1444015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.525+0000 7f144affd700 1 -- 172.21.15.29:0/1882332296 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f143c051370 con 0x7f145416f370 2023-10-08T15:41:46.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.796+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f14540c7420 con 0x7f145416f370 2023-10-08T15:41:46.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.800+0000 7f144affd700 1 -- 172.21.15.29:0/1882332296 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f143c054990 con 0x7f145416f370 2023-10-08T15:41:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1434066f30 msgr2=0x7f14340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1434066f30 0x7f14340693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14540c4100 tx=0x7f1444015000 comp rx=0 tx=0).stop 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145416f370 msgr2=0x7f1454150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145416f370 0x7f1454150840 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f143c0073c0 tx=0x7f143c001e50 comp rx=0 tx=0).stop 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 shutdown_connections 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1434066f30 0x7f14340693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f145416e1a0 0x7f1454154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1440003a90 0x7f14540c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 --2- 172.21.15.29:0/1882332296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145416f370 0x7f1454150840 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 >> 172.21.15.29:0/1882332296 conn(0x7f1454069870 msgr2=0x7f14540b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 shutdown_connections 2023-10-08T15:41:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.802+0000 7f145919d700 1 -- 172.21.15.29:0/1882332296 wait complete. 2023-10-08T15:41:46.804 INFO:teuthology.orchestra.run.smithi029.stderr:updated caps for client.0 2023-10-08T15:41:46.815 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:46.835 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-08T15:41:46.835+0000 7efeee8de700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:41:46.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.933+0000 7f4e033be700 1 Processor -- start 2023-10-08T15:41:46.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.933+0000 7f4e033be700 1 -- start start 2023-10-08T15:41:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e033be700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4dfc15a2b0 0x7f4dfc0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e033be700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4dfc0cfe20 0x7f4dfc0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e033be700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc0c5d80 con 0x7f4dfc0d1c30 2023-10-08T15:41:46.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e033be700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc068470 con 0x7f4dfc15a2b0 2023-10-08T15:41:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e033be700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc0c6060 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e0115a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4dfc15a2b0 0x7f4dfc0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e00959700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4dfc0d1c30 0x7f4dfc0cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37604/0 (socket says 172.21.15.29:37604) 2023-10-08T15:41:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e00959700 1 -- 172.21.15.29:0/3716403302 learned_addr learned my addr 172.21.15.29:0/3716403302 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e0195b700 1 --2- 172.21.15.29:0/3716403302 >> v2:172.21.15.183:3300/0 conn(0x7f4dfc0cfe20 0x7f4dfc0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e0115a700 1 -- 172.21.15.29:0/3716403302 >> v2:172.21.15.183:3300/0 conn(0x7f4dfc0cfe20 msgr2=0x7f4dfc0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e0115a700 1 --2- 172.21.15.29:0/3716403302 >> v2:172.21.15.183:3300/0 conn(0x7f4dfc0cfe20 0x7f4dfc0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e0115a700 1 -- 172.21.15.29:0/3716403302 >> v1:172.21.15.29:6789/0 conn(0x7f4dfc0d1c30 legacy=0x7f4dfc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e0115a700 1 -- 172.21.15.29:0/3716403302 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0c6340 con 0x7f4dfc15a2b0 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4df3fff700 1 -- 172.21.15.29:0/3716403302 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752288542 0 0) 0x7f4dfc0c5d80 con 0x7f4dfc0d1c30 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.934+0000 7f4e0115a700 1 --2- 172.21.15.29:0/3716403302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15a2b0 0x7f4dfc0b3da0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc064970 tx=0x7f4df8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8fe2dca2b28016 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4df3fff700 1 -- 172.21.15.29:0/3716403302 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8005c10 con 0x7f4dfc15a2b0 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4df3fff700 1 -- 172.21.15.29:0/3716403302 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df8005d70 con 0x7f4dfc15a2b0 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4df3fff700 1 -- 172.21.15.29:0/3716403302 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8006260 con 0x7f4dfc15a2b0 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4e033be700 1 -- 172.21.15.29:0/3716403302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15a2b0 msgr2=0x7f4dfc0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4e033be700 1 --2- 172.21.15.29:0/3716403302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15a2b0 0x7f4dfc0b3da0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc064970 tx=0x7f4df8009120 comp rx=0 tx=0).stop 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4e033be700 1 -- 172.21.15.29:0/3716403302 shutdown_connections 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4e033be700 1 --2- 172.21.15.29:0/3716403302 >> v2:172.21.15.183:3300/0 conn(0x7f4dfc0cfe20 0x7f4dfc0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4e033be700 1 --2- 172.21.15.29:0/3716403302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc15a2b0 0x7f4dfc0b3da0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4e033be700 1 -- 172.21.15.29:0/3716403302 >> 172.21.15.29:0/3716403302 conn(0x7f4dfc067e40 msgr2=0x7f4dfc0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4e033be700 1 -- 172.21.15.29:0/3716403302 shutdown_connections 2023-10-08T15:41:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.935+0000 7f4e033be700 1 -- 172.21.15.29:0/3716403302 wait complete. 2023-10-08T15:41:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.936+0000 7f4e033be700 1 Processor -- start 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.936+0000 7f4e033be700 1 -- start start 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e033be700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cfe20 0x7f4dfc16d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e033be700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4dfc0d1c30 0x7f4dfc0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e033be700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dfc15a2b0 0x7f4dfc0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e033be700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc09cc70 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e033be700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc16b630 con 0x7f4dfc15a2b0 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e033be700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc09d4d0 con 0x7f4dfc0d1c30 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e0115a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cfe20 0x7f4dfc16d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e0115a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cfe20 0x7f4dfc16d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36386/0 (socket says 172.21.15.29:36386) 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e0115a700 1 -- 172.21.15.29:0/220625674 learned_addr learned my addr 172.21.15.29:0/220625674 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e0195b700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dfc15a2b0 0x7f4dfc0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.937+0000 7f4e00959700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4dfc0d1c30 0x7f4dfc0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e0115a700 1 -- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4dfc0d1c30 msgr2=0x7f4dfc0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e0115a700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4dfc0d1c30 0x7f4dfc0ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e0115a700 1 -- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dfc15a2b0 msgr2=0x7f4dfc0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e0115a700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dfc15a2b0 0x7f4dfc0ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e0115a700 1 -- 172.21.15.29:0/220625674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80093c0 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e0195b700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dfc15a2b0 0x7f4dfc0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e0115a700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cfe20 0x7f4dfc16d460 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4df800b0e0 tx=0x7f4df8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4df17fa700 1 -- 172.21.15.29:0/220625674 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bdb0 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4df17fa700 1 -- 172.21.15.29:0/220625674 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df8026430 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc158230 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4df17fa700 1 -- 172.21.15.29:0/220625674 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80267d0 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.938+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc09ce80 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.939+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc04c3c0 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.939+0000 7f4df17fa700 1 -- 172.21.15.29:0/220625674 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4df801a420 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.940+0000 7f4df17fa700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4de0066f30 0x7f4de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.940+0000 7f4df17fa700 1 -- 172.21.15.29:0/220625674 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4df8086120 con 0x7f4dfc0cfe20 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.940+0000 7f4e00959700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4de0066f30 0x7f4de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:46.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.941+0000 7f4e00959700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4de0066f30 0x7f4de00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0cd150 tx=0x7f4dec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:46.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:46.944+0000 7f4df17fa700 1 -- 172.21.15.29:0/220625674 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df8053390 con 0x7f4dfc0cfe20 2023-10-08T15:41:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.182+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dfc070a70 con 0x7f4dfc0cfe20 2023-10-08T15:41:47.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.182+0000 7f4df17fa700 1 -- 172.21.15.29:0/220625674 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f4df80569b0 con 0x7f4dfc0cfe20 2023-10-08T15:41:47.183 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:47.183 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:41:47.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.184+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4de0066f30 msgr2=0x7f4de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.184+0000 7f4e033be700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4de0066f30 0x7f4de00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0cd150 tx=0x7f4dec009040 comp rx=0 tx=0).stop 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.184+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cfe20 msgr2=0x7f4dfc16d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.184+0000 7f4e033be700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cfe20 0x7f4dfc16d460 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4df800b0e0 tx=0x7f4df8016000 comp rx=0 tx=0).stop 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.185+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 shutdown_connections 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.185+0000 7f4e033be700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4de0066f30 0x7f4de00693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.185+0000 7f4e033be700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4dfc15a2b0 0x7f4dfc0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.185+0000 7f4e033be700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cfe20 0x7f4dfc16d460 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.185+0000 7f4e033be700 1 --2- 172.21.15.29:0/220625674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4dfc0d1c30 0x7f4dfc0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.185+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 >> 172.21.15.29:0/220625674 conn(0x7f4dfc067e40 msgr2=0x7f4dfc158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.185+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 shutdown_connections 2023-10-08T15:41:47.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.185+0000 7f4e033be700 1 -- 172.21.15.29:0/220625674 wait complete. 2023-10-08T15:41:47.187 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:41:47.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T15:41:41.251854+0000', 'modified': '2023-10-08T15:41:44.868620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5310}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5310': {'gid': 5310, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6834/3946331252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6832', 'nonce': 3946331252}, {'type': 'v1', 'addr': '172.21.15.29:6834', 'nonce': 3946331252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T15:41:47.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T15:41:47.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T15:41:47.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.724+0000 7f9e40e10700 1 Processor -- start 2023-10-08T15:41:47.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.724+0000 7f9e40e10700 1 -- start start 2023-10-08T15:41:47.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e40e10700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9e3c15a620 0x7f9e3c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e40e10700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9e3c15d580 0x7f9e3c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e40e10700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c15cbb0 con 0x7f9e3c157870 2023-10-08T15:41:47.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e40e10700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c15bdb0 con 0x7f9e3c15a620 2023-10-08T15:41:47.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e40e10700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c15bfa0 con 0x7f9e3c15d580 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e39d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9e3c15a620 0x7f9e3c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e3a59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9e3c157870 0x7f9e3c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37618/0 (socket says 172.21.15.29:37618) 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e3a59c700 1 -- 172.21.15.29:0/2580837788 learned_addr learned my addr 172.21.15.29:0/2580837788 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.725+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/2580837788 >> v2:172.21.15.183:3300/0 conn(0x7f9e3c15d580 0x7f9e3c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e39d9b700 1 -- 172.21.15.29:0/2580837788 >> v2:172.21.15.183:3300/0 conn(0x7f9e3c15d580 msgr2=0x7f9e3c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/2580837788 >> v2:172.21.15.183:3300/0 conn(0x7f9e3c15d580 0x7f9e3c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e39d9b700 1 -- 172.21.15.29:0/2580837788 >> v1:172.21.15.29:6789/0 conn(0x7f9e3c157870 legacy=0x7f9e3c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e39d9b700 1 -- 172.21.15.29:0/2580837788 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c15c280 con 0x7f9e3c15a620 2023-10-08T15:41:47.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e3959a700 1 -- 172.21.15.29:0/2580837788 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887803120 0 0) 0x7f9e3c15cbb0 con 0x7f9e3c157870 2023-10-08T15:41:47.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/2580837788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15a620 0x7f9e3c15d040 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c06b4e0 tx=0x7f9e240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7fee86a00b6b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e3959a700 1 -- 172.21.15.29:0/2580837788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400b6b0 con 0x7f9e3c15a620 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e3959a700 1 -- 172.21.15.29:0/2580837788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2400b810 con 0x7f9e3c15a620 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e3959a700 1 -- 172.21.15.29:0/2580837788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2400bbb0 con 0x7f9e3c15a620 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e40e10700 1 -- 172.21.15.29:0/2580837788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15a620 msgr2=0x7f9e3c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.726+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2580837788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15a620 0x7f9e3c15d040 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c06b4e0 tx=0x7f9e240091a0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.727+0000 7f9e40e10700 1 -- 172.21.15.29:0/2580837788 shutdown_connections 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.727+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2580837788 >> v2:172.21.15.183:3300/0 conn(0x7f9e3c15d580 0x7f9e3c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.727+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2580837788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15a620 0x7f9e3c15d040 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.727+0000 7f9e40e10700 1 -- 172.21.15.29:0/2580837788 >> 172.21.15.29:0/2580837788 conn(0x7f9e3c068ce0 msgr2=0x7f9e3c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.727+0000 7f9e40e10700 1 -- 172.21.15.29:0/2580837788 shutdown_connections 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.727+0000 7f9e40e10700 1 -- 172.21.15.29:0/2580837788 wait complete. 2023-10-08T15:41:47.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e40e10700 1 Processor -- start 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e40e10700 1 -- start start 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e40e10700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3c157870 0x7f9e3c150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e40e10700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e3c15a620 0x7f9e3c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e40e10700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15d580 0x7f9e3c14bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e40e10700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c151160 con 0x7f9e3c15d580 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e40e10700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0b06c0 con 0x7f9e3c15a620 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e40e10700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0b09a0 con 0x7f9e3c157870 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.728+0000 7f9e3ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15d580 0x7f9e3c14bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15d580 0x7f9e3c14bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36406/0 (socket says 172.21.15.29:36406) 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/2564141179 learned_addr learned my addr 172.21.15.29:0/2564141179 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e3c15a620 0x7f9e3c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3c157870 0x7f9e3c150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3c157870 msgr2=0x7f9e3c150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3c157870 0x7f9e3c150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e3c15a620 msgr2=0x7f9e3c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e3c15a620 0x7f9e3c0cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/2564141179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24009420 con 0x7f9e3c15d580 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15d580 0x7f9e3c14bbe0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e34007ef0 tx=0x7f9e34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e327fc700 1 -- 172.21.15.29:0/2564141179 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400eb30 con 0x7f9e3c15d580 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e327fc700 1 -- 172.21.15.29:0/2564141179 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3400ec90 con 0x7f9e3c15d580 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e40e10700 1 -- 172.21.15.29:0/2564141179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c0cfb00 con 0x7f9e3c15d580 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e327fc700 1 -- 172.21.15.29:0/2564141179 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34014670 con 0x7f9e3c15d580 2023-10-08T15:41:47.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.729+0000 7f9e40e10700 1 -- 172.21.15.29:0/2564141179 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c0d00c0 con 0x7f9e3c15d580 2023-10-08T15:41:47.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.731+0000 7f9e327fc700 1 -- 172.21.15.29:0/2564141179 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e34014a60 con 0x7f9e3c15d580 2023-10-08T15:41:47.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.731+0000 7f9e327fc700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.731+0000 7f9e327fc700 1 -- 172.21.15.29:0/2564141179 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e34084ad0 con 0x7f9e3c15d580 2023-10-08T15:41:47.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.731+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.732+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c007fd0 tx=0x7f9e2c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.733+0000 7f9e4a108b80 1 Processor -- start 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.733+0000 7f9e4a108b80 1 -- start start 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644343cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x564434322a70 con 0x564434415d00 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x564434320270 con 0x5644343cba50 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443431c060 con 0x5644343f4f60 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343f4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36414/0 (socket says 172.21.15.29:36414) 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 -- 172.21.15.29:0/3105146989 learned_addr learned my addr 172.21.15.29:0/3105146989 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:47.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644343cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 -- 172.21.15.29:0/3105146989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 msgr2=0x5644343c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 -- 172.21.15.29:0/3105146989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 msgr2=0x5644343cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644343cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 -- 172.21.15.29:0/3105146989 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644341b6270 con 0x564434415d00 2023-10-08T15:41:47.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343f4a20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400b0e0 tx=0x7f9e24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcb7961a7f1ae46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e1b7fe700 1 -- 172.21.15.29:0/3105146989 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24021070 con 0x564434415d00 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e1b7fe700 1 -- 172.21.15.29:0/3105146989 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e24000bc0 con 0x564434415d00 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.734+0000 7f9e1b7fe700 1 -- 172.21.15.29:0/3105146989 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2401a420 con 0x564434415d00 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 -- 172.21.15.29:0/3105146989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 msgr2=0x5644343f4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343f4a20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400b0e0 tx=0x7f9e24017000 comp rx=0 tx=0).stop 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 -- 172.21.15.29:0/3105146989 shutdown_connections 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644343cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/3105146989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343f4a20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 -- 172.21.15.29:0/3105146989 >> 172.21.15.29:0/3105146989 conn(0x5644343cd370 msgr2=0x5644343cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 -- 172.21.15.29:0/3105146989 shutdown_connections 2023-10-08T15:41:47.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.735+0000 7f9e4a108b80 1 -- 172.21.15.29:0/3105146989 wait complete. 2023-10-08T15:41:47.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.736+0000 7f9e4a108b80 1 -- start start 2023-10-08T15:41:47.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.736+0000 7f9e4a108b80 1 Processor -- start 2023-10-08T15:41:47.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644344152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5644343f4f60 0x5644343c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564434415d00 0x5644343c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644342c7890 con 0x5644343f4f60 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644342e2ea0 con 0x5644343cba50 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443419ee30 con 0x564434415d00 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e4a108b80 10 client.0 _ll_register_callbacks cb 0x56443438f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5644343f4f60 0x5644343c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5644343f4f60 0x5644343c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36424/0 (socket says 172.21.15.29:36424) 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 -- 172.21.15.29:0/2140176069 learned_addr learned my addr 172.21.15.29:0/2140176069 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644344152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564434415d00 0x5644343c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 -- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564434415d00 msgr2=0x5644343c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564434415d00 0x5644343c7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 -- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 msgr2=0x5644344152c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644344152c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 -- 172.21.15.29:0/2140176069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c15c280 con 0x5644343f4f60 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644344152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5644343f4f60 0x5644343c6c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c010 tx=0x7f9e24021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e2d63a2533f2b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.737+0000 7f9e18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e18ff9700 1 -- 172.21.15.29:0/2140176069 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2401a790 con 0x5644343f4f60 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e18ff9700 1 -- 172.21.15.29:0/2140176069 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e2401a8f0 con 0x5644343f4f60 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 1 -- 172.21.15.29:0/2140176069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644343c0b70 con 0x5644343f4f60 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e18ff9700 1 -- 172.21.15.29:0/2140176069 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e2401acc0 con 0x5644343f4f60 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 10 client.5466 fetch_fsmap learned FSMap version 25 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 1 -- 172.21.15.29:0/2140176069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x564434158fe0 con 0x5644343f4f60 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e18ff9700 1 -- 172.21.15.29:0/2140176069 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5644343c0b70 con 0x5644343f4f60 2023-10-08T15:41:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e18ff9700 1 -- 172.21.15.29:0/2140176069 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9e2402c070 con 0x5644343f4f60 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 10 client.5466 fetch_fsmap finished waiting for FSMap version 25 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 10 client.5466 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 20 client.5466 populate_metadata read hostname 'smithi029' 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] conn(0x56443440fab0 0x56443440fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 4 client.5466 mds_command: new command op to 5310 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e4a108b80 1 -- 172.21.15.29:0/2140176069 --> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56443439daa0 con 0x56443440fab0 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.738+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] conn(0x56443440fab0 0x56443440fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] conn(0x56443440fab0 0x56443440fe80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d57bf55c2476525 server_cookie=5a48fa987155dcca in_seq=0 out_seq=0 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e18ff9700 10 client.5466 ms_handle_connect on v2:172.21.15.29:6832/3946331252 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e18ff9700 1 -- 172.21.15.29:0/2140176069 <== mds.0 v2:172.21.15.29:6832/3946331252 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56443439daa0 con 0x56443440fab0 2023-10-08T15:41:47.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e18ff9700 10 client.5466 handle_command_reply: tid=0 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 client.5466 shutdown 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 -- 172.21.15.29:0/2140176069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5644343f4f60 msgr2=0x5644343c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5644343f4f60 0x5644343c6c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c010 tx=0x7f9e24021000 comp rx=0 tx=0).stop 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 -- 172.21.15.29:0/2140176069 shutdown_connections 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564434415d00 0x5644343c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] conn(0x56443440fab0 0x56443440fe80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644344152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e18ff9700 0 client.5466 ms_handle_reset on v2:172.21.15.29:6832/3946331252 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/2140176069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5644343f4f60 0x5644343c6c20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.739+0000 7f9e4a108b80 1 -- 172.21.15.29:0/2140176069 >> 172.21.15.29:0/2140176069 conn(0x5644343cd370 msgr2=0x564434411550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.740+0000 7f9e4a108b80 1 -- 172.21.15.29:0/2140176069 shutdown_connections 2023-10-08T15:41:47.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.740+0000 7f9e4a108b80 1 -- 172.21.15.29:0/2140176069 wait complete. 2023-10-08T15:41:47.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.740+0000 7f9e4a108b80 20 client.5466 trim_cache size 0 max 16384 2023-10-08T15:41:47.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e4a108b80 1 Processor -- start 2023-10-08T15:41:47.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e4a108b80 1 -- start start 2023-10-08T15:41:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644343c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644343ab510 con 0x564434415d00 2023-10-08T15:41:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644343c65a0 con 0x5644343cba50 2023-10-08T15:41:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644343c6830 con 0x5644343f4f60 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.757+0000 7f9e3ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36440/0 (socket says 172.21.15.29:36440) 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/1368403933 learned_addr learned my addr 172.21.15.29:0/1368403933 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644343c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 msgr2=0x5644343c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 msgr2=0x5644343c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644343c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/1368403933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644342ea780 con 0x564434415d00 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cd740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9e340830a0 tx=0x7f9e34016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3a8756d22d01bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e1bfff700 1 -- 172.21.15.29:0/1368403933 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34055a00 con 0x564434415d00 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e1bfff700 1 -- 172.21.15.29:0/1368403933 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34058c50 con 0x564434415d00 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e1bfff700 1 -- 172.21.15.29:0/1368403933 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3405c9a0 con 0x564434415d00 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e4a108b80 1 -- 172.21.15.29:0/1368403933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 msgr2=0x5644343cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.758+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cd740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9e340830a0 tx=0x7f9e34016040 comp rx=0 tx=0).stop 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 -- 172.21.15.29:0/1368403933 shutdown_connections 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cd740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343cba50 0x5644343c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/1368403933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343f4f60 0x5644343c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 -- 172.21.15.29:0/1368403933 >> 172.21.15.29:0/1368403933 conn(0x5644343cd370 msgr2=0x5644344219f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 -- 172.21.15.29:0/1368403933 shutdown_connections 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 -- 172.21.15.29:0/1368403933 wait complete. 2023-10-08T15:41:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 -- start start 2023-10-08T15:41:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.759+0000 7f9e4a108b80 1 Processor -- start 2023-10-08T15:41:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343cba50 0x564434477990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343f4f60 0x5644343cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e4a108b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644343f9580 con 0x564434415d00 2023-10-08T15:41:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644343cf040 con 0x5644343f4f60 2023-10-08T15:41:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e4a108b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56443442beb0 con 0x5644343cba50 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e4a108b80 10 client.0 _ll_register_callbacks cb 0x56443438f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36446/0 (socket says 172.21.15.29:36446) 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/758782918 learned_addr learned my addr 172.21.15.29:0/758782918 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343f4f60 0x5644343cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343cba50 0x564434477990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343cba50 msgr2=0x564434477990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343cba50 0x564434477990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343f4f60 msgr2=0x5644343cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343f4f60 0x5644343cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e3ad9d700 1 -- 172.21.15.29:0/758782918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c0d00c0 con 0x564434415d00 2023-10-08T15:41:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.760+0000 7f9e39d9b700 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343f4f60 0x5644343cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e3ad9d700 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cdc80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400e6a0 tx=0x7f9e34070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fd823ac2ee46bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2023-10-08T15:41:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e18ff9700 1 -- 172.21.15.29:0/758782918 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400ee00 con 0x564434415d00 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e18ff9700 1 -- 172.21.15.29:0/758782918 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e34054ef0 con 0x564434415d00 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 1 -- 172.21.15.29:0/758782918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e24000bc0 con 0x564434415d00 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e18ff9700 1 -- 172.21.15.29:0/758782918 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e3405c510 con 0x564434415d00 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 10 client.5472 fetch_fsmap learned FSMap version 25 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 1 -- 172.21.15.29:0/758782918 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5644342d1470 con 0x564434415d00 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e18ff9700 1 -- 172.21.15.29:0/758782918 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e24000bc0 con 0x564434415d00 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e18ff9700 1 -- 172.21.15.29:0/758782918 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9e340517f0 con 0x564434415d00 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 10 client.5472 fetch_fsmap finished waiting for FSMap version 25 2023-10-08T15:41:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 10 client.5472 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 20 client.5472 populate_metadata read hostname 'smithi029' 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] conn(0x5644343f8840 0x5644343f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 4 client.5472 mds_command: new command op to 5310 tid=0[{"prefix": "status"}] 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e4a108b80 1 -- 172.21.15.29:0/758782918 --> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5644342bee00 con 0x5644343f8840 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.761+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] conn(0x5644343f8840 0x5644343f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e18ff9700 10 client.5472 ms_handle_connect on v2:172.21.15.29:6832/3946331252 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e3a59c700 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] conn(0x5644343f8840 0x5644343f8c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95ed468d41b332bc server_cookie=75e00a73b81e22b0 in_seq=0 out_seq=0 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e18ff9700 1 -- 172.21.15.29:0/758782918 <== mds.0 v2:172.21.15.29:6832/3946331252 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5644342bee00 con 0x5644343f8840 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e18ff9700 10 client.5472 handle_command_reply: tid=0 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 client.5472 shutdown 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 -- 172.21.15.29:0/758782918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 msgr2=0x5644343cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cdc80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400e6a0 tx=0x7f9e34070000 comp rx=0 tx=0).stop 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 -- 172.21.15.29:0/758782918 shutdown_connections 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564434415d00 0x5644343cdc80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5644343cba50 0x564434477990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.29:6832/3946331252,v1:172.21.15.29:6834/3946331252] conn(0x5644343f8840 0x5644343f8c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 --2- 172.21.15.29:0/758782918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5644343f4f60 0x5644343cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e18ff9700 0 client.5472 ms_handle_reset on v2:172.21.15.29:6832/3946331252 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 -- 172.21.15.29:0/758782918 >> 172.21.15.29:0/758782918 conn(0x5644343cd370 msgr2=0x5644343c44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 -- 172.21.15.29:0/758782918 shutdown_connections 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 1 -- 172.21.15.29:0/758782918 wait complete. 2023-10-08T15:41:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.762+0000 7f9e4a108b80 20 client.5472 trim_cache size 0 max 16384 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 5310, 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 5.9133006159999999, 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 25, 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 45, 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 45, 2023-10-08T15:41:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 11.849793537 2023-10-08T15:41:47.773 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:41:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 -- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e1c066f30 msgr2=0x7f9e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c007fd0 tx=0x7f9e2c007d30 comp rx=0 tx=0).stop 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 -- 172.21.15.29:0/2564141179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15d580 msgr2=0x7f9e3c14bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15d580 0x7f9e3c14bbe0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e34007ef0 tx=0x7f9e34009840 comp rx=0 tx=0).stop 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 -- 172.21.15.29:0/2564141179 shutdown_connections 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e3c15d580 0x7f9e3c14bbe0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3c157870 0x7f9e3c150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 --2- 172.21.15.29:0/2564141179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e3c15a620 0x7f9e3c0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 -- 172.21.15.29:0/2564141179 >> 172.21.15.29:0/2564141179 conn(0x7f9e3c068ce0 msgr2=0x7f9e3c15fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 -- 172.21.15.29:0/2564141179 shutdown_connections 2023-10-08T15:41:47.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.763+0000 7f9e40e10700 1 -- 172.21.15.29:0/2564141179 wait complete. 2023-10-08T15:41:47.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:41:47.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.895+0000 7f45262e6700 1 Processor -- start 2023-10-08T15:41:47.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.895+0000 7f45262e6700 1 -- start start 2023-10-08T15:41:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.895+0000 7f45262e6700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f45200cf1c0 0x7f452015e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.895+0000 7f45262e6700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45200cca20 con 0x7f4520159cf0 2023-10-08T15:41:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.895+0000 7f45262e6700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452015ea40 con 0x7f452015a0c0 2023-10-08T15:41:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.895+0000 7f45262e6700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4520067660 con 0x7f45200cf1c0 2023-10-08T15:41:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4520159cf0 0x7f45200ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:37630/0 (socket says 172.21.15.29:37630) 2023-10-08T15:41:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451ffff700 1 -- 172.21.15.29:0/1202950342 learned_addr learned my addr 172.21.15.29:0/1202950342 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:47.899 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40853981 0 0) 0x7f45200cca20 con 0x7f4520159cf0 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4508003570 con 0x7f4520159cf0 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451f7fe700 1 --2- 172.21.15.29:0/1202950342 >> v2:172.21.15.183:3300/0 conn(0x7f45200cf1c0 0x7f452015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1121570759 0 0) 0x7f4508003570 con 0x7f4520159cf0 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 >> v2:172.21.15.183:3300/0 conn(0x7f45200cf1c0 msgr2=0x7f452015e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 --2- 172.21.15.29:0/1202950342 >> v2:172.21.15.183:3300/0 conn(0x7f45200cf1c0 0x7f452015e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 >> v1:172.21.15.183:6789/0 conn(0x7f452015a0c0 legacy=0x7f4520068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520067f00 con 0x7f4520159cf0 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f4510001470 con 0x7f4520159cf0 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 >> v1:172.21.15.29:6789/0 conn(0x7f4520159cf0 legacy=0x7f45200ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4508003a60 0x7f4508003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4508004810 0x7f4508004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45080051c0 0x7f450800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4520067660 con 0x7f4508003a60 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450800c0d0 con 0x7f45080051c0 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.896+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450800c290 con 0x7f4508004810 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451ffff700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4508003a60 0x7f4508003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451f7fe700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4508004810 0x7f4508004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f4524883700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45080051c0 0x7f450800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451ffff700 1 -- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4508004810 msgr2=0x7f4508004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451ffff700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4508004810 0x7f4508004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451ffff700 1 -- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45080051c0 msgr2=0x7f450800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451ffff700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45080051c0 0x7f450800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451ffff700 1 -- 172.21.15.29:0/1202950342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508003570 con 0x7f4508003a60 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451f7fe700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4508004810 0x7f4508004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f4524883700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45080051c0 0x7f450800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f4524883700 1 -- 172.21.15.29:0/1202950342 reap_dead start 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451ffff700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4508003a60 0x7f4508003e70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f451000c390 tx=0x7f45200cea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb7a9811ed6bf9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000cc60 con 0x7f4508003a60 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451000cdc0 con 0x7f4508003a60 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.897+0000 7f451effd700 1 -- 172.21.15.29:0/1202950342 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510005b70 con 0x7f4508003a60 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.898+0000 7f45262e6700 1 -- 172.21.15.29:0/1202950342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4508003a60 msgr2=0x7f4508003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.902 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.898+0000 7f45262e6700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4508003a60 0x7f4508003e70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f451000c390 tx=0x7f45200cea10 comp rx=0 tx=0).stop 2023-10-08T15:41:47.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.898+0000 7f45262e6700 1 -- 172.21.15.29:0/1202950342 shutdown_connections 2023-10-08T15:41:47.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.898+0000 7f45262e6700 1 --2- 172.21.15.29:0/1202950342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4508003a60 0x7f4508003e70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.898+0000 7f45262e6700 1 -- 172.21.15.29:0/1202950342 >> 172.21.15.29:0/1202950342 conn(0x7f452006c6e0 msgr2=0x7f4520069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:47.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.898+0000 7f45262e6700 1 -- 172.21.15.29:0/1202950342 shutdown_connections 2023-10-08T15:41:47.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.898+0000 7f45262e6700 1 -- 172.21.15.29:0/1202950342 wait complete. 2023-10-08T15:41:47.903 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.899+0000 7f45262e6700 1 Processor -- start 2023-10-08T15:41:47.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.899+0000 7f45262e6700 1 -- start start 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f45262e6700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4508003a60 0x7f45200b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f45262e6700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4520154050 0x7f45201544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f45262e6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4520156140 0x7f45201565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f45262e6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4520156b00 con 0x7f4520156140 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f45262e6700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45200c6e90 con 0x7f4508003a60 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f45262e6700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4520159140 con 0x7f4520154050 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4520156140 0x7f45201565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4520156140 0x7f45201565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36464/0 (socket says 172.21.15.29:36464) 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 -- 172.21.15.29:0/419794811 learned_addr learned my addr 172.21.15.29:0/419794811 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f451f7fe700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4520154050 0x7f45201544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f451ffff700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4508003a60 0x7f45200b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 -- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4520154050 msgr2=0x7f45201544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4520154050 0x7f45201544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 -- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4508003a60 msgr2=0x7f45200b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4508003a60 0x7f45200b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 -- 172.21.15.29:0/419794811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520159420 con 0x7f4520156140 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4524883700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4520156140 0x7f45201565c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f45200cf740 tx=0x7f4518009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4507fff700 1 -- 172.21.15.29:0/419794811 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518012590 con 0x7f4520156140 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.900+0000 7f4507fff700 1 -- 172.21.15.29:0/419794811 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45180126f0 con 0x7f4520156140 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.901+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45200b28c0 con 0x7f4520156140 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.901+0000 7f4507fff700 1 -- 172.21.15.29:0/419794811 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518012a70 con 0x7f4520156140 2023-10-08T15:41:47.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.901+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4520156eb0 con 0x7f4520156140 2023-10-08T15:41:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.901+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45200b2de0 con 0x7f4520156140 2023-10-08T15:41:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.902+0000 7f4507fff700 1 -- 172.21.15.29:0/419794811 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4518003030 con 0x7f4520156140 2023-10-08T15:41:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.902+0000 7f4507fff700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f450c066f30 0x7f450c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.902+0000 7f4507fff700 1 -- 172.21.15.29:0/419794811 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45180841b0 con 0x7f4520156140 2023-10-08T15:41:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.903+0000 7f451ffff700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f450c066f30 0x7f450c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.903+0000 7f451ffff700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f450c066f30 0x7f450c0693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4510007cd0 tx=0x7f4510015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:47.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:47.907+0000 7f4507fff700 1 -- 172.21.15.29:0/419794811 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45200b2de0 con 0x7f4520156140 2023-10-08T15:41:48.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.145+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f452015ea40 con 0x7f4520156140 2023-10-08T15:41:48.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.145+0000 7f4507fff700 1 -- 172.21.15.29:0/419794811 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f452015ea40 con 0x7f4520156140 2023-10-08T15:41:48.153 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:41:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.147+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f450c066f30 msgr2=0x7f450c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.147+0000 7f45262e6700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f450c066f30 0x7f450c0693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4510007cd0 tx=0x7f4510015000 comp rx=0 tx=0).stop 2023-10-08T15:41:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4520156140 msgr2=0x7f45201565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4520156140 0x7f45201565c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f45200cf740 tx=0x7f4518009040 comp rx=0 tx=0).stop 2023-10-08T15:41:48.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 shutdown_connections 2023-10-08T15:41:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f450c066f30 0x7f450c0693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4520156140 0x7f45201565c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4508003a60 0x7f45200b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 --2- 172.21.15.29:0/419794811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4520154050 0x7f45201544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 >> 172.21.15.29:0/419794811 conn(0x7f452006c6e0 msgr2=0x7f45200c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 shutdown_connections 2023-10-08T15:41:48.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.148+0000 7f45262e6700 1 -- 172.21.15.29:0/419794811 wait complete. 2023-10-08T15:41:48.160 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T15:41:48.160 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:41:48.160 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-08T15:41:48.160 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T15:41:48.160 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:48.160 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T15:41:48.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T15:41:48.161 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:41:48.161 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:48.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:48.161 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-08T15:41:48.176 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:41:48.176 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:48.177 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42403sec preferred_lft 42403sec 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2023-10-08T15:41:48.178 INFO:teuthology.orchestra.run.smithi029.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:41:48.179 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 3e:15:f1:4d:13:04 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:48.179 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:41:48.179 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:48.179 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::a0a1:d2ff:feb5:830d/64 scope link 2023-10-08T15:41:48.213 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:48.213 INFO:teuthology.orchestra.run.smithi029.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:48.213 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 3e:15:f1:4d:13:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T15:41:48.213 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::3c15:f1ff:fe4d:1304/64 scope link 2023-10-08T15:41:48.214 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:48.214 INFO:teuthology.orchestra.run.smithi029.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:48.214 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 86:7d:80:d6:2b:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T15:41:48.214 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::847d:80ff:fed6:2b39/64 scope link 2023-10-08T15:41:48.214 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:48.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:48.214 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:41:48.242 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-08T15:41:48.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:48.242 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-08T15:41:48.298 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-08T15:41:48.299 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:41:48.299 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T15:41:48.299 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T15:41:48.299 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:41:48.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:48.299 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T15:41:48.299 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T15:41:48.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T15:41:48.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T15:41:48.300 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T15:41:48.300 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T15:41:48.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:48.402 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T15:41:48.416 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T15:41:48.416 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T15:41:48.417 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:48.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:48.417 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-08T15:41:48.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:48.482 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:48.537 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T15:41:48.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:48.538 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:48.591 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T15:41:48.591 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:41:48.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:48.673 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:48.673 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:48.691 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:48.692 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:48.692 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:41:48.692 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:41:48.692 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:41:48.692 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:41:48.692 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:41:48.692 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:41:48.713 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:48.713 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:48.713 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:41:48.713 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:41:48.714 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:41:48.714 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:41:48.714 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:41:48.714 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:41:48.714 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-10-08T15:41:48.714 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-10-08T15:41:48.714 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=aa16b01f-3858-4fc7-9751-d7cb76fff138" will pass to kernel 2023-10-08T15:41:48.716 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T15:41:48.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:48.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T15:41:48.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T15:41:48.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.941+0000 7fd441971700 1 Processor -- start 2023-10-08T15:41:48.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.941+0000 7fd441971700 1 -- start start 2023-10-08T15:41:48.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.941+0000 7fd441971700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd43c0d1c30 0x7fd43c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.941+0000 7fd441971700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a680 0x7fd43c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.941+0000 7fd441971700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0c5d80 con 0x7fd43c15a2b0 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.941+0000 7fd441971700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c068470 con 0x7fd43c0d1c30 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.941+0000 7fd441971700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0c6060 con 0x7fd43c15a680 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43a7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd43c0d1c30 0x7fd43c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43a7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd43c0d1c30 0x7fd43c0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34432/0 (socket says 172.21.15.29:34432) 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43a7fc700 1 -- 172.21.15.29:0/3282432790 learned_addr learned my addr 172.21.15.29:0/3282432790 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43affd700 1 --1- 172.21.15.29:0/3282432790 >> v1:172.21.15.29:6789/0 conn(0x7fd43c15a2b0 0x7fd43c0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43454/0 (socket says 172.21.15.29:43454) 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43b7fe700 1 --2- 172.21.15.29:0/3282432790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a680 0x7fd43c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43a7fc700 1 -- 172.21.15.29:0/3282432790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a680 msgr2=0x7fd43c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:48.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43a7fc700 1 --2- 172.21.15.29:0/3282432790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a680 0x7fd43c0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43a7fc700 1 -- 172.21.15.29:0/3282432790 >> v1:172.21.15.29:6789/0 conn(0x7fd43c15a2b0 legacy=0x7fd43c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43a7fc700 1 -- 172.21.15.29:0/3282432790 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0c6340 con 0x7fd43c0d1c30 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd439ffb700 1 -- 172.21.15.29:0/3282432790 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136502051 0 0) 0x7fd43c0c5d80 con 0x7fd43c15a2b0 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43b7fe700 1 --2- 172.21.15.29:0/3282432790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a680 0x7fd43c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd43a7fc700 1 --2- 172.21.15.29:0/3282432790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c0d1c30 0x7fd43c0ccdd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd4240099b0 tx=0x7fd424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e872dc0e77d2c843 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd439ffb700 1 -- 172.21.15.29:0/3282432790 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400b860 con 0x7fd43c0d1c30 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd439ffb700 1 -- 172.21.15.29:0/3282432790 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400b9c0 con 0x7fd43c0d1c30 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.942+0000 7fd439ffb700 1 -- 172.21.15.29:0/3282432790 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400bd60 con 0x7fd43c0d1c30 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.943+0000 7fd441971700 1 -- 172.21.15.29:0/3282432790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c0d1c30 msgr2=0x7fd43c0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.943+0000 7fd441971700 1 --2- 172.21.15.29:0/3282432790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c0d1c30 0x7fd43c0ccdd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd4240099b0 tx=0x7fd424009250 comp rx=0 tx=0).stop 2023-10-08T15:41:48.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.943+0000 7fd441971700 1 -- 172.21.15.29:0/3282432790 shutdown_connections 2023-10-08T15:41:48.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.943+0000 7fd441971700 1 --2- 172.21.15.29:0/3282432790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a680 0x7fd43c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.943+0000 7fd441971700 1 --2- 172.21.15.29:0/3282432790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c0d1c30 0x7fd43c0ccdd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.943+0000 7fd441971700 1 -- 172.21.15.29:0/3282432790 >> 172.21.15.29:0/3282432790 conn(0x7fd43c067e40 msgr2=0x7fd43c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:48.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.943+0000 7fd441971700 1 -- 172.21.15.29:0/3282432790 shutdown_connections 2023-10-08T15:41:48.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.943+0000 7fd441971700 1 -- 172.21.15.29:0/3282432790 wait complete. 2023-10-08T15:41:48.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.944+0000 7fd441971700 1 Processor -- start 2023-10-08T15:41:48.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.944+0000 7fd441971700 1 -- start start 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd441971700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43c0d1c30 0x7fd43c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd441971700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a2b0 0x7fd43c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd441971700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c15a680 0x7fd43c15ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd441971700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0ca600 con 0x7fd43c15a680 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd441971700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0c99f0 con 0x7fd43c0d1c30 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd441971700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0c9cd0 con 0x7fd43c15a2b0 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c15a680 0x7fd43c15ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c15a680 0x7fd43c15ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34440/0 (socket says 172.21.15.29:34440) 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 -- 172.21.15.29:0/1727066432 learned_addr learned my addr 172.21.15.29:0/1727066432 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:48.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43affd700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43c0d1c30 0x7fd43c157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43a7fc700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a2b0 0x7fd43c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 -- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a2b0 msgr2=0x7fd43c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a2b0 0x7fd43c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 -- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43c0d1c30 msgr2=0x7fd43c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43c0d1c30 0x7fd43c157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 -- 172.21.15.29:0/1727066432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240094f0 con 0x7fd43c15a680 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd43b7fe700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c15a680 0x7fd43c15ef00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd43400cef0 tx=0x7fd434007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.945+0000 7fd432ffd700 1 -- 172.21.15.29:0/1727066432 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400ae00 con 0x7fd43c15a680 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.946+0000 7fd432ffd700 1 -- 172.21.15.29:0/1727066432 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434016420 con 0x7fd43c15a680 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.946+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c0c9fb0 con 0x7fd43c15a680 2023-10-08T15:41:48.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.946+0000 7fd432ffd700 1 -- 172.21.15.29:0/1727066432 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340167e0 con 0x7fd43c15a680 2023-10-08T15:41:48.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.946+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c0c96e0 con 0x7fd43c15a680 2023-10-08T15:41:48.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.946+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c0ca770 con 0x7fd43c15a680 2023-10-08T15:41:48.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.947+0000 7fd432ffd700 1 -- 172.21.15.29:0/1727066432 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd434016bd0 con 0x7fd43c15a680 2023-10-08T15:41:48.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.947+0000 7fd432ffd700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd41c066f30 0x7fd41c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:48.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.947+0000 7fd432ffd700 1 -- 172.21.15.29:0/1727066432 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd434012070 con 0x7fd43c15a680 2023-10-08T15:41:48.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.947+0000 7fd43affd700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd41c066f30 0x7fd41c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:48.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.948+0000 7fd43affd700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd41c066f30 0x7fd41c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd42c002800 tx=0x7fd42c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:48.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:48.952+0000 7fd432ffd700 1 -- 172.21.15.29:0/1727066432 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd43404e5a0 con 0x7fd43c15a680 2023-10-08T15:41:49.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.190+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd43c04c3c0 con 0x7fd43c15a680 2023-10-08T15:41:49.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.191+0000 7fd432ffd700 1 -- 172.21.15.29:0/1727066432 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd434089070 con 0x7fd43c15a680 2023-10-08T15:41:49.193 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T15:41:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd41c066f30 msgr2=0x7fd41c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd41c066f30 0x7fd41c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd42c002800 tx=0x7fd42c009040 comp rx=0 tx=0).stop 2023-10-08T15:41:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c15a680 msgr2=0x7fd43c15ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c15a680 0x7fd43c15ef00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd43400cef0 tx=0x7fd434007860 comp rx=0 tx=0).stop 2023-10-08T15:41:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 shutdown_connections 2023-10-08T15:41:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fd41c066f30 0x7fd41c0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd43c15a680 0x7fd43c15ef00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43c0d1c30 0x7fd43c157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 --2- 172.21.15.29:0/1727066432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43c15a2b0 0x7fd43c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 >> 172.21.15.29:0/1727066432 conn(0x7fd43c067e40 msgr2=0x7fd43c0b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:49.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 shutdown_connections 2023-10-08T15:41:49.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.193+0000 7fd441971700 1 -- 172.21.15.29:0/1727066432 wait complete. 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T15:41:49.207 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:41:49.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:49.208 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-10-08T15:41:49.226 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T15:41:49.226 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T15:41:49.226 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T15:41:49.226 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T15:41:49.227 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:2f:27:f5:c4:ba brd ff:ff:ff:ff:ff:ff 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T15:41:49.228 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::f8f9:ecff:fe70:2278/64 scope link 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:2f:27:f5:c4:ba brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::2f:27ff:fef5:c4ba/64 scope link 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether ea:2a:e0:41:f8:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::e82a:e0ff:fe41:f881/64 scope link 2023-10-08T15:41:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-10-08T15:41:49.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:49.230 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T15:41:49.293 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-10-08T15:41:49.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:49.295 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-10-08T15:41:49.353 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-10-08T15:41:49.354 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T15:41:49.354 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T15:41:49.354 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T15:41:49.354 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T15:41:49.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:49.354 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-10-08T15:41:49.354 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-10-08T15:41:49.355 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T15:41:49.355 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T15:41:49.355 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T15:41:49.355 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-10-08T15:41:49.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:49.463 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-10-08T15:41:49.478 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T15:41:49.478 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T15:41:49.478 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:41:49.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:49.479 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-10-08T15:41:49.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:49.544 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:49.599 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T15:41:49.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T15:41:49.599 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:49.654 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T15:41:49.654 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T15:41:49.654 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:49.734 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:49.734 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:49.753 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:49.753 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:49.753 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:41:49.753 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with new device syntax: 1@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:41:49.753 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:41:49.754 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:41:49.754 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:41:49.754 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:41:49.775 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with new device syntax: 1@aa16b01f-3858-4fc7-9751-d7cb76fff138.cephfs=/ 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.29:3300/172.21.15.183:3300/172.21.15.183:3301" will pass to kernel 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-10-08T15:41:49.776 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=aa16b01f-3858-4fc7-9751-d7cb76fff138" will pass to kernel 2023-10-08T15:41:49.778 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T15:41:49.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:41:49.778 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T15:41:49.843 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:41:49.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.967+0000 7fa485a17700 1 Processor -- start 2023-10-08T15:41:49.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.967+0000 7fa485a17700 1 -- start start 2023-10-08T15:41:49.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa485a17700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa48015a0f0 0x7fa4800cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa485a17700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4800b13e0 con 0x7fa480159d20 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa485a17700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4800c5880 con 0x7fa48006f940 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa485a17700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa480069570 con 0x7fa48015a0f0 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa484a15700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa480159d20 0x7fa48006f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43464/0 (socket says 172.21.15.29:43464) 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa484a15700 1 -- 172.21.15.29:0/2977761309 learned_addr learned my addr 172.21.15.29:0/2977761309 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387617298 0 0) 0x7fa4800b13e0 con 0x7fa480159d20 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa468003570 con 0x7fa480159d20 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa47ffff700 1 --2- 172.21.15.29:0/2977761309 >> v2:172.21.15.183:3300/0 conn(0x7fa48015a0f0 0x7fa4800cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1016518272 0 0) 0x7fa468003570 con 0x7fa480159d20 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 >> v2:172.21.15.183:3300/0 conn(0x7fa48015a0f0 msgr2=0x7fa4800cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa47f7fe700 1 --2- 172.21.15.29:0/2977761309 >> v2:172.21.15.183:3300/0 conn(0x7fa48015a0f0 0x7fa4800cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 >> v1:172.21.15.183:6789/0 conn(0x7fa48006f940 legacy=0x7fa48015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.968+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800c3a80 con 0x7fa480159d20 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fa4780017f0 con 0x7fa480159d20 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 >> v1:172.21.15.29:6789/0 conn(0x7fa480159d20 legacy=0x7fa48006f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468003a60 0x7fa468003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa468004810 0x7fa468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4680052e0 0x7fa46800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480069570 con 0x7fa468004810 2023-10-08T15:41:49.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800c230 con 0x7fa4680052e0 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800c3f0 con 0x7fa468003a60 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47ffff700 1 --2- 172.21.15.29:0/2977761309 >> v2:172.21.15.183:3300/0 conn(0x7fa48015a0f0 0x7fa4800cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa484a15700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468003a60 0x7fa468003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47ffff700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa468004810 0x7fa468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa485216700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4680052e0 0x7fa46800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47ffff700 1 -- 172.21.15.29:0/2977761309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468003a60 msgr2=0x7fa468003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47ffff700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468003a60 0x7fa468003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47ffff700 1 -- 172.21.15.29:0/2977761309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4680052e0 msgr2=0x7fa46800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47ffff700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4680052e0 0x7fa46800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa485216700 1 -- 172.21.15.29:0/2977761309 reap_dead start 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47ffff700 1 -- 172.21.15.29:0/2977761309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468003570 con 0x7fa468004810 2023-10-08T15:41:49.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47ffff700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa468004810 0x7fa468004c80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa474009ba0 tx=0x7fa474008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e6ffc79da96056 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47400c070 con 0x7fa468004810 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47400e5e0 con 0x7fa468004810 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.969+0000 7fa47f7fe700 1 -- 172.21.15.29:0/2977761309 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47400e770 con 0x7fa468004810 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.970+0000 7fa485a17700 1 -- 172.21.15.29:0/2977761309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa468004810 msgr2=0x7fa468004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.970+0000 7fa485a17700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa468004810 0x7fa468004c80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa474009ba0 tx=0x7fa474008040 comp rx=0 tx=0).stop 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.970+0000 7fa485a17700 1 -- 172.21.15.29:0/2977761309 shutdown_connections 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.970+0000 7fa485a17700 1 --2- 172.21.15.29:0/2977761309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa468004810 0x7fa468004c80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.970+0000 7fa485a17700 1 -- 172.21.15.29:0/2977761309 >> 172.21.15.29:0/2977761309 conn(0x7fa48006c700 msgr2=0x7fa480069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.970+0000 7fa485a17700 1 -- 172.21.15.29:0/2977761309 shutdown_connections 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.970+0000 7fa485a17700 1 -- 172.21.15.29:0/2977761309 wait complete. 2023-10-08T15:41:49.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.971+0000 7fa485a17700 1 Processor -- start 2023-10-08T15:41:49.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.971+0000 7fa485a17700 1 -- start start 2023-10-08T15:41:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa485a17700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468004810 0x7fa4800b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa485a17700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4800c5c90 0x7fa480156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa485a17700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4800c64b0 0x7fa4800c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa485a17700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800c6e60 con 0x7fa4800c5c90 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa485a17700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800b45b0 con 0x7fa4800c64b0 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa485a17700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800b33b0 con 0x7fa468004810 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa47ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4800c5c90 0x7fa480156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa47ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4800c5c90 0x7fa480156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34450/0 (socket says 172.21.15.29:34450) 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa47ffff700 1 -- 172.21.15.29:0/85970074 learned_addr learned my addr 172.21.15.29:0/85970074 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa485216700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4800c64b0 0x7fa4800c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa484a15700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468004810 0x7fa4800b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa47ffff700 1 -- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468004810 msgr2=0x7fa4800b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa47ffff700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468004810 0x7fa4800b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa47ffff700 1 -- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4800c64b0 msgr2=0x7fa4800c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa47ffff700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4800c64b0 0x7fa4800c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:49.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.972+0000 7fa47ffff700 1 -- 172.21.15.29:0/85970074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800b3690 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.973+0000 7fa47ffff700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4800c5c90 0x7fa480156000 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa46800c200 tx=0x7fa47401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.973+0000 7fa47cff9700 1 -- 172.21.15.29:0/85970074 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47400e750 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.973+0000 7fa47cff9700 1 -- 172.21.15.29:0/85970074 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47401c440 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.973+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4800b3970 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.973+0000 7fa47cff9700 1 -- 172.21.15.29:0/85970074 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47401c800 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.973+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa480156540 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.974+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48015dcf0 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.974+0000 7fa47cff9700 1 -- 172.21.15.29:0/85970074 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa47401cb70 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.975+0000 7fa47cff9700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa46c066f30 0x7fa46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.975+0000 7fa47cff9700 1 -- 172.21.15.29:0/85970074 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa474085fd0 con 0x7fa4800c5c90 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.975+0000 7fa484a15700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa46c066f30 0x7fa46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:49.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.975+0000 7fa484a15700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa46c066f30 0x7fa46c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4780011d0 tx=0x7fa478006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:49.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:49.979+0000 7fa47cff9700 1 -- 172.21.15.29:0/85970074 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa474053300 con 0x7fa4800c5c90 2023-10-08T15:41:50.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.212+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4800cc5f0 con 0x7fa4800c5c90 2023-10-08T15:41:50.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.212+0000 7fa47cff9700 1 -- 172.21.15.29:0/85970074 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fa474056920 con 0x7fa4800c5c90 2023-10-08T15:41:50.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:50.215 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:41:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa46c066f30 msgr2=0x7fa46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa46c066f30 0x7fa46c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4780011d0 tx=0x7fa478006040 comp rx=0 tx=0).stop 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4800c5c90 msgr2=0x7fa480156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4800c5c90 0x7fa480156000 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa46800c200 tx=0x7fa47401a000 comp rx=0 tx=0).stop 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 shutdown_connections 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa46c066f30 0x7fa46c0693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa4800c64b0 0x7fa4800c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa468004810 0x7fa4800b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 --2- 172.21.15.29:0/85970074 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4800c5c90 0x7fa480156000 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 >> 172.21.15.29:0/85970074 conn(0x7fa48006c700 msgr2=0x7fa480157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.214+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 shutdown_connections 2023-10-08T15:41:50.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:50.215+0000 7fa485a17700 1 -- 172.21.15.29:0/85970074 wait complete. 2023-10-08T15:41:50.218 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:41:50.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-08T15:41:50.367 INFO:teuthology.orchestra.run.smithi029.stdout:{"cluster_fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","whoami":0,"id":5310,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5081621569999992,"mdsmap_epoch":25,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":14.444656675999999} 2023-10-08T15:41:50.368 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", "fs_name": "cephfs", "id": 5310, "mdsmap_epoch": 25, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 8.508162157, "state": "up:active", "uptime": 14.444656676, "want_state": "up:active", "whoami": 0 } 2023-10-08T15:41:50.368 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-08T15:41:50.502 INFO:teuthology.orchestra.run.smithi029.stdout:{"osd_mon_report_interval":"5"} 2023-10-08T15:41:50.503 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-08T15:41:50.503 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-08T15:41:50.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:50.503 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-08T15:41:51.907 INFO:teuthology.orchestra.run.smithi029.stderr:265+0 records in 2023-10-08T15:41:51.907 INFO:teuthology.orchestra.run.smithi029.stderr:265+0 records out 2023-10-08T15:41:51.907 INFO:teuthology.orchestra.run.smithi029.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.38563 s, 201 MB/s 2023-10-08T15:41:51.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:51.907 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-08T15:41:53.456 INFO:teuthology.orchestra.run.smithi029.stderr:292+0 records in 2023-10-08T15:41:53.456 INFO:teuthology.orchestra.run.smithi029.stderr:292+0 records out 2023-10-08T15:41:53.456 INFO:teuthology.orchestra.run.smithi029.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.53244 s, 200 MB/s 2023-10-08T15:41:53.457 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-08T15:41:53.457 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T15:41:53.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.575+0000 7f857b7e3700 1 Processor -- start 2023-10-08T15:41:53.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.575+0000 7f857b7e3700 1 -- start start 2023-10-08T15:41:53.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.576+0000 7f857b7e3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f857415a2b0 0x7f85740b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:53.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.576+0000 7f857b7e3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85740c5d80 con 0x7f85740cfe20 2023-10-08T15:41:53.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.576+0000 7f857b7e3700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85740c6060 con 0x7f85740d1c30 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.576+0000 7f857b7e3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8574068470 con 0x7f857415a2b0 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.576+0000 7f857957f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f857415a2b0 0x7f85740b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.576+0000 7f8579d80700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f85740cfe20 0x7f85740c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43474/0 (socket says 172.21.15.29:43474) 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.576+0000 7f857957f700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f857415a2b0 0x7f85740b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34452/0 (socket says 172.21.15.29:34452) 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.576+0000 7f8579d80700 1 -- 172.21.15.29:0/1439754225 learned_addr learned my addr 172.21.15.29:0/1439754225 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857957f700 1 -- 172.21.15.29:0/1439754225 >> v1:172.21.15.183:6789/0 conn(0x7f85740d1c30 legacy=0x7f85740cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857957f700 1 -- 172.21.15.29:0/1439754225 >> v1:172.21.15.29:6789/0 conn(0x7f85740cfe20 legacy=0x7f85740c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f8573fff700 1 -- 172.21.15.29:0/1439754225 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092535534 0 0) 0x7f85740c5d80 con 0x7f85740cfe20 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857957f700 1 -- 172.21.15.29:0/1439754225 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85740c6340 con 0x7f857415a2b0 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857957f700 1 --2- 172.21.15.29:0/1439754225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f857415a2b0 0x7f85740b3da0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8564009eb0 tx=0x7f8564009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9982afd63fc40083 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f8573fff700 1 -- 172.21.15.29:0/1439754225 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400e070 con 0x7f857415a2b0 2023-10-08T15:41:53.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f8573fff700 1 -- 172.21.15.29:0/1439754225 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400bc30 con 0x7f857415a2b0 2023-10-08T15:41:53.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f8573fff700 1 -- 172.21.15.29:0/1439754225 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564012430 con 0x7f857415a2b0 2023-10-08T15:41:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857b7e3700 1 -- 172.21.15.29:0/1439754225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f857415a2b0 msgr2=0x7f85740b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857b7e3700 1 --2- 172.21.15.29:0/1439754225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f857415a2b0 0x7f85740b3da0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8564009eb0 tx=0x7f8564009780 comp rx=0 tx=0).stop 2023-10-08T15:41:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857b7e3700 1 -- 172.21.15.29:0/1439754225 shutdown_connections 2023-10-08T15:41:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857b7e3700 1 --2- 172.21.15.29:0/1439754225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f857415a2b0 0x7f85740b3da0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:53.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.577+0000 7f857b7e3700 1 -- 172.21.15.29:0/1439754225 >> 172.21.15.29:0/1439754225 conn(0x7f8574067e40 msgr2=0x7f85740d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.578+0000 7f857b7e3700 1 -- 172.21.15.29:0/1439754225 shutdown_connections 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.578+0000 7f857b7e3700 1 -- 172.21.15.29:0/1439754225 wait complete. 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.579+0000 7f857b7e3700 1 Processor -- start 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.579+0000 7f857b7e3700 1 -- start start 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.579+0000 7f857b7e3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85740cfe20 0x7f857416afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857b7e3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85740d1c30 0x7f8574155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857b7e3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f857415a2b0 0x7f857416d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857b7e3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857416ab50 con 0x7f85740cfe20 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857b7e3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740c8f20 con 0x7f85740d1c30 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857b7e3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857416a540 con 0x7f857415a2b0 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85740cfe20 0x7f857416afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:53.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85740cfe20 0x7f857416afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34468/0 (socket says 172.21.15.29:34468) 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 -- 172.21.15.29:0/3856814911 learned_addr learned my addr 172.21.15.29:0/3856814911 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f8578d7e700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85740d1c30 0x7f8574155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f8579d80700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f857415a2b0 0x7f857416d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 -- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f857415a2b0 msgr2=0x7f857416d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f857415a2b0 0x7f857416d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 -- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85740d1c30 msgr2=0x7f8574155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85740d1c30 0x7f8574155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 -- 172.21.15.29:0/3856814911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009a20 con 0x7f85740cfe20 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857957f700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85740cfe20 0x7f857416afe0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8564013000 tx=0x7f8564017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f85717fa700 1 -- 172.21.15.29:0/3856814911 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856401b420 con 0x7f85740cfe20 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f85717fa700 1 -- 172.21.15.29:0/3856814911 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856401b5a0 con 0x7f85740cfe20 2023-10-08T15:41:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857416e570 con 0x7f85740cfe20 2023-10-08T15:41:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f85717fa700 1 -- 172.21.15.29:0/3856814911 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856401b960 con 0x7f85740cfe20 2023-10-08T15:41:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.580+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857416e850 con 0x7f85740cfe20 2023-10-08T15:41:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.581+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857416ae30 con 0x7f85740cfe20 2023-10-08T15:41:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.582+0000 7f85717fa700 1 -- 172.21.15.29:0/3856814911 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f856401bd50 con 0x7f85740cfe20 2023-10-08T15:41:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.582+0000 7f85717fa700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8560066f30 0x7f85600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.582+0000 7f85717fa700 1 -- 172.21.15.29:0/3856814911 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8564086330 con 0x7f85740cfe20 2023-10-08T15:41:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.582+0000 7f8578d7e700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8560066f30 0x7f85600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:53.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.583+0000 7f8578d7e700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8560066f30 0x7f85600693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f85740d1700 tx=0x7f8568007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.587+0000 7f85717fa700 1 -- 172.21.15.29:0/3856814911 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85640535a0 con 0x7f85740cfe20 2023-10-08T15:41:53.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.782+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f857404c3c0 con 0x7f85740cfe20 2023-10-08T15:41:53.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.783+0000 7f85717fa700 1 -- 172.21.15.29:0/3856814911 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+32260 (secure 0 0 0) 0x7f8564056bc0 con 0x7f85740cfe20 2023-10-08T15:41:53.785 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:53.785 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:41:53.785 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 45, 2023-10-08T15:41:53.785 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:41:53.785 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2023-10-08T15:40:06.698823+0000", 2023-10-08T15:41:53.785 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2023-10-08T15:41:42.477224+0000", 2023-10-08T15:41:53.785 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2023-10-08T15:40:12.124600+0000", 2023-10-08T15:41:53.786 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2023-10-08T15:40:09.117651+0000", 2023-10-08T15:41:53.786 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T15:41:53.786 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2023-10-08T15:41:53.786 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2023-10-08T15:41:53.786 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2023-10-08T15:41:53.786 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2023-10-08T15:41:53.786 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2023-10-08T15:41:53.786 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 7, 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 8, 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "quincy", 2023-10-08T15:41:53.787 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:40:12.381633+0000", 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:53.788 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2023-10-08T15:41:53.789 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "16", 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:53.790 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:53.791 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:53.793 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 6, 2023-10-08T15:41:53.794 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:39.312324+0000", 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:53.795 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:53.796 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "44", 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:53.797 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:53.798 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:53.799 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2023-10-08T15:41:53.800 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 7, 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:40.225704+0000", 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:53.801 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2023-10-08T15:41:53.802 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.803 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "45", 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:53.804 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:53.805 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:53.806 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.807 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.809 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6802", 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.810 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6803", 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6806", 2023-10-08T15:41:53.811 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6807", 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.812 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6804", 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6805", 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.813 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6801/86356", 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6803/86356", 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6807/86356", 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6805/86356", 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:53.814 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.815 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6808", 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6809", 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:53.816 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6810", 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6811", 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.817 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6814", 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6815", 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:53.818 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6812", 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.819 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6813", 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6809/86358", 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6811/86358", 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6815/86358", 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6813/86358", 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:53.820 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:53.821 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6816", 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6817", 2023-10-08T15:41:53.822 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6818", 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.823 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6819", 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6823", 2023-10-08T15:41:53.824 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6825", 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.825 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6820", 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6821", 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6817/86359", 2023-10-08T15:41:53.826 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6819/86359", 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6825/86359", 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6821/86359", 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:53.827 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.828 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6822", 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6824", 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:53.829 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6826", 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6827", 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.830 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6830", 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6831", 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.831 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6828", 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6829", 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:53.832 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6824/86379", 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6827/86379", 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6831/86379", 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6829/86379", 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6819", 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6821", 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6823", 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6826", 2023-10-08T15:41:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6830", 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6831", 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6828", 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6829", 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6821/86587", 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6826/86587", 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6831/86587", 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6829/86587", 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6816", 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6817", 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6818", 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6820", 2023-10-08T15:41:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6825", 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6827", 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6822", 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6824", 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6817/86596", 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6820/86596", 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6827/86596", 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6824/86596", 2023-10-08T15:41:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6800", 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6801", 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6802", 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6803", 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6806", 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6807", 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6804", 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6805", 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6801/86585", 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6803/86585", 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6807/86585", 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6805/86585", 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6808", 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6809", 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6810", 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6811", 2023-10-08T15:41:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6814", 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6815", 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6812", 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6813", 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6809/86586", 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6811/86586", 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6815/86586", 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6813/86586", 2023-10-08T15:41:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.252513+0000", 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.293514+0000", 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.271170+0000", 2023-10-08T15:41:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.272577+0000", 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.317440+0000", 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.309422+0000", 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.276770+0000", 2023-10-08T15:41:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.222500+0000", 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2023-10-08T15:41:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2023-10-08T15:41:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2023-10-08T15:41:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2023-10-08T15:41:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:53.869 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:41:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8560066f30 msgr2=0x7f85600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:53.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8560066f30 0x7f85600693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f85740d1700 tx=0x7f8568007ec0 comp rx=0 tx=0).stop 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85740cfe20 msgr2=0x7f857416afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85740cfe20 0x7f857416afe0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8564013000 tx=0x7f8564017000 comp rx=0 tx=0).stop 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 shutdown_connections 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8560066f30 0x7f85600693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f857415a2b0 0x7f857416d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85740cfe20 0x7f857416afe0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 --2- 172.21.15.29:0/3856814911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85740d1c30 0x7f8574155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 >> 172.21.15.29:0/3856814911 conn(0x7f8574067e40 msgr2=0x7f8574158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 shutdown_connections 2023-10-08T15:41:53.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:53.785+0000 7f857b7e3700 1 -- 172.21.15.29:0/3856814911 wait complete. 2023-10-08T15:41:53.872 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T15:41:54.812 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:54.815 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:41:56.493 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-08T15:41:56.492+0000 7f3b3c216700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-08T15:41:58.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T15:41:59.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.003+0000 7fe732908700 1 Processor -- start 2023-10-08T15:41:59.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.003+0000 7fe732908700 1 -- start start 2023-10-08T15:41:59.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.003+0000 7fe732908700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe72c0a7df0 0x7fe72c0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.003+0000 7fe732908700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe72c1572a0 0x7fe72c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.003+0000 7fe732908700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72c0ae760 con 0x7fe72c0a7a20 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.003+0000 7fe732908700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c0aea40 con 0x7fe72c0a7df0 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe732908700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c0aed20 con 0x7fe72c1572a0 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe72c0a7df0 0x7fe72c0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe72c0a7df0 0x7fe72c0b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35702/0 (socket says 172.21.15.29:35702) 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72b7fe700 1 -- 172.21.15.29:0/1101030435 learned_addr learned my addr 172.21.15.29:0/1101030435 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe730ea5700 1 --2- 172.21.15.29:0/1101030435 >> v2:172.21.15.183:3300/0 conn(0x7fe72c1572a0 0x7fe72c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72b7fe700 1 -- 172.21.15.29:0/1101030435 >> v2:172.21.15.183:3300/0 conn(0x7fe72c1572a0 msgr2=0x7fe72c1576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72b7fe700 1 --2- 172.21.15.29:0/1101030435 >> v2:172.21.15.183:3300/0 conn(0x7fe72c1572a0 0x7fe72c1576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72b7fe700 1 -- 172.21.15.29:0/1101030435 >> v1:172.21.15.183:6789/0 conn(0x7fe72c0a7a20 legacy=0x7fe72c0af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72affd700 1 -- 172.21.15.29:0/1101030435 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044578074 0 0) 0x7fe72c0ae760 con 0x7fe72c0a7a20 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72b7fe700 1 -- 172.21.15.29:0/1101030435 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c0af000 con 0x7fe72c0a7df0 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72b7fe700 1 --2- 172.21.15.29:0/1101030435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c0b29c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe72c071700 tx=0x7fe72000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bf39219186c36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72affd700 1 -- 172.21.15.29:0/1101030435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000dc30 con 0x7fe72c0a7df0 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72affd700 1 -- 172.21.15.29:0/1101030435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72000dd90 con 0x7fe72c0a7df0 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.004+0000 7fe72affd700 1 -- 172.21.15.29:0/1101030435 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7200196d0 con 0x7fe72c0a7df0 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.005+0000 7fe732908700 1 -- 172.21.15.29:0/1101030435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 msgr2=0x7fe72c0b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.005+0000 7fe732908700 1 --2- 172.21.15.29:0/1101030435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c0b29c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe72c071700 tx=0x7fe72000b4f0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.005+0000 7fe732908700 1 -- 172.21.15.29:0/1101030435 shutdown_connections 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.005+0000 7fe732908700 1 --2- 172.21.15.29:0/1101030435 >> v2:172.21.15.183:3300/0 conn(0x7fe72c1572a0 0x7fe72c1576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.005+0000 7fe732908700 1 --2- 172.21.15.29:0/1101030435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c0b29c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.005+0000 7fe732908700 1 -- 172.21.15.29:0/1101030435 >> 172.21.15.29:0/1101030435 conn(0x7fe72c0cd1e0 msgr2=0x7fe72c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.005+0000 7fe732908700 1 -- 172.21.15.29:0/1101030435 shutdown_connections 2023-10-08T15:41:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.005+0000 7fe732908700 1 -- 172.21.15.29:0/1101030435 wait complete. 2023-10-08T15:41:59.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.006+0000 7fe732908700 1 Processor -- start 2023-10-08T15:41:59.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.006+0000 7fe732908700 1 -- start start 2023-10-08T15:41:59.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe732908700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe72c0a7a20 0x7fe72c14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.011 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe732908700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe732908700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe72c1572a0 0x7fe72c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe732908700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c099060 con 0x7fe72c0a7df0 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe732908700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c098450 con 0x7fe72c0a7a20 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe732908700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c098730 con 0x7fe72c1572a0 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe72b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe72b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c1534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35704/0 (socket says 172.21.15.29:35704) 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe72b7fe700 1 -- 172.21.15.29:0/3927977952 learned_addr learned my addr 172.21.15.29:0/3927977952 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe72bfff700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe72c0a7a20 0x7fe72c14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe730ea5700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe72c1572a0 0x7fe72c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.007+0000 7fe72b7fe700 1 -- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe72c1572a0 msgr2=0x7fe72c1576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.012 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe72b7fe700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe72c1572a0 0x7fe72c1576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe72b7fe700 1 -- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe72c0a7a20 msgr2=0x7fe72c14e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe72b7fe700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe72c0a7a20 0x7fe72c14e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe72b7fe700 1 -- 172.21.15.29:0/3927977952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72000b790 con 0x7fe72c0a7df0 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe72bfff700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe72c0a7a20 0x7fe72c14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe72b7fe700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c1534f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe72c072020 tx=0x7fe72001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe713fff700 1 -- 172.21.15.29:0/3927977952 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720010470 con 0x7fe72c0a7df0 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe713fff700 1 -- 172.21.15.29:0/3927977952 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7200105d0 con 0x7fe72c0a7df0 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe713fff700 1 -- 172.21.15.29:0/3927977952 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720010950 con 0x7fe72c0a7df0 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72c098a10 con 0x7fe72c0a7df0 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.008+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72c098120 con 0x7fe72c0a7df0 2023-10-08T15:41:59.013 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.009+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72c0991d0 con 0x7fe72c0a7df0 2023-10-08T15:41:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.009+0000 7fe713fff700 1 -- 172.21.15.29:0/3927977952 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe720022070 con 0x7fe72c0a7df0 2023-10-08T15:41:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.010+0000 7fe713fff700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe718066f30 0x7fe7180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.010+0000 7fe713fff700 1 -- 172.21.15.29:0/3927977952 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe720014070 con 0x7fe72c0a7df0 2023-10-08T15:41:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.010+0000 7fe713fff700 1 -- 172.21.15.29:0/3927977952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7fe71806ea50 con 0x7fe72c0a7df0 2023-10-08T15:41:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.010+0000 7fe72bfff700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe718066f30 0x7fe7180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.010+0000 7fe72bfff700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe718066f30 0x7fe7180693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe72c15cb30 tx=0x7fe71c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:59.015 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.015+0000 7fe713fff700 1 -- 172.21.15.29:0/3927977952 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe720055380 con 0x7fe72c0a7df0 2023-10-08T15:41:59.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.208+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe72c04c3c0 con 0x7fe72c0a7df0 2023-10-08T15:41:59.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.209+0000 7fe713fff700 1 -- 172.21.15.29:0/3927977952 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32403 (secure 0 0 0) 0x7fe720029030 con 0x7fe72c0a7df0 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 49, 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2023-10-08T15:40:06.698823+0000", 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2023-10-08T15:41:58.500209+0000", 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2023-10-08T15:40:12.124600+0000", 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2023-10-08T15:40:09.117651+0000", 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T15:41:59.211 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2023-10-08T15:41:59.212 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 7, 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 8, 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "quincy", 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:40:12.381633+0000", 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:41:59.213 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2023-10-08T15:41:59.214 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:41:59.215 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:59.216 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:59.217 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:59.218 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 6, 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2023-10-08T15:41:59.219 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:39.312324+0000", 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:59.220 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:59.221 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:59.222 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:59.223 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:59.224 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:59.225 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 7, 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:40.225704+0000", 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:59.226 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2023-10-08T15:41:59.227 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:59.228 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:59.229 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:59.230 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:59.231 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2023-10-08T15:41:59.232 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.233 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.234 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.235 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.235 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.235 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.235 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.235 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.235 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.235 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6802", 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6803", 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.236 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6806", 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6807", 2023-10-08T15:41:59.237 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6804", 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.238 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6805", 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6801/86356", 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6803/86356", 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6807/86356", 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6805/86356", 2023-10-08T15:41:59.239 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.240 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6808", 2023-10-08T15:41:59.241 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6809", 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.242 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6810", 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6811", 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.243 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6814", 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6815", 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.244 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6812", 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6813", 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.245 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6809/86358", 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6811/86358", 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6815/86358", 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6813/86358", 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.247 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6816", 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6817", 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.248 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6818", 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6819", 2023-10-08T15:41:59.249 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6823", 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.250 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6825", 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6820", 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.251 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6821", 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6817/86359", 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6819/86359", 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6825/86359", 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6821/86359", 2023-10-08T15:41:59.252 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.253 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6822", 2023-10-08T15:41:59.254 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6824", 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.255 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6826", 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6827", 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6830", 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6831", 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.257 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6828", 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6829", 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.258 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6824/86379", 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6827/86379", 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6831/86379", 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6829/86379", 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull", 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.259 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.260 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6819", 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6821", 2023-10-08T15:41:59.261 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6823", 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.262 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6826", 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6830", 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.263 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6831", 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.264 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6828", 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6829", 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6821/86587", 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6826/86587", 2023-10-08T15:41:59.265 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6831/86587", 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6829/86587", 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.266 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.267 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6816", 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6817", 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.268 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6818", 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6820", 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.269 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6825", 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6827", 2023-10-08T15:41:59.270 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6822", 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.271 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6824", 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6817/86596", 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6820/86596", 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6827/86596", 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6824/86596", 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.272 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.273 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6800", 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.274 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6801", 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.275 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6802", 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6803", 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.276 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6806", 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6807", 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.277 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6804", 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6805", 2023-10-08T15:41:59.278 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6801/86585", 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6803/86585", 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6807/86585", 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6805/86585", 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.279 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.280 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6808", 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.281 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6809", 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6810", 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.282 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6811", 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6814", 2023-10-08T15:41:59.283 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6815", 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.284 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6812", 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6813", 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6809/86586", 2023-10-08T15:41:59.285 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6811/86586", 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6815/86586", 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6813/86586", 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.286 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.252513+0000", 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.287 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.293514+0000", 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.288 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.271170+0000", 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.272577+0000", 2023-10-08T15:41:59.289 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.317440+0000", 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.290 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.291 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.291 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:41:59.291 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.291 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.293 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.293 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.293 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.293 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.309422+0000", 2023-10-08T15:41:59.293 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.293 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.293 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.276770+0000", 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:41:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.222500+0000", 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2023-10-08T15:41:59.295 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.296 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2023-10-08T15:41:59.297 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.298 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:41:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe718066f30 msgr2=0x7fe7180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe718066f30 0x7fe7180693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe72c15cb30 tx=0x7fe71c009040 comp rx=0 tx=0).stop 2023-10-08T15:41:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 msgr2=0x7fe72c1534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c1534f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe72c072020 tx=0x7fe72001b000 comp rx=0 tx=0).stop 2023-10-08T15:41:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 shutdown_connections 2023-10-08T15:41:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fe718066f30 0x7fe7180693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe72c1572a0 0x7fe72c1576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe72c0a7a20 0x7fe72c14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 --2- 172.21.15.29:0/3927977952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe72c0a7df0 0x7fe72c1534f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 >> 172.21.15.29:0/3927977952 conn(0x7fe72c0cd1e0 msgr2=0x7fe72c154840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 shutdown_connections 2023-10-08T15:41:59.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.212+0000 7fe732908700 1 -- 172.21.15.29:0/3927977952 wait complete. 2023-10-08T15:41:59.301 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-08T15:41:59.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:41:59.301 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-08T15:41:59.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:41:59.557 INFO:teuthology.orchestra.run.smithi029.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-08T15:41:59.557 INFO:teuthology.orchestra.run.smithi029.stderr:50+0 records in 2023-10-08T15:41:59.558 INFO:teuthology.orchestra.run.smithi029.stderr:50+0 records out 2023-10-08T15:41:59.558 INFO:teuthology.orchestra.run.smithi029.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.234452 s, 224 MB/s 2023-10-08T15:41:59.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T15:41:59.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.676+0000 7f76843d3700 1 Processor -- start 2023-10-08T15:41:59.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.676+0000 7f76843d3700 1 -- start start 2023-10-08T15:41:59.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f76843d3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 0x7f767c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f76843d3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f767c0d1c30 0x7f767c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f76843d3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c0c5d80 con 0x7f767c15a680 2023-10-08T15:41:59.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f76843d3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c068470 con 0x7f767c0d1c30 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f76843d3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0c6060 con 0x7f767c15a2b0 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f768196e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f767c0d1c30 0x7f767c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f768196e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f767c0d1c30 0x7f767c0cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35706/0 (socket says 172.21.15.29:35706) 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f7682970700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f767c15a680 0x7f767c0c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56442/0 (socket says 172.21.15.29:56442) 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.677+0000 7f768196e700 1 -- 172.21.15.29:0/3623723305 learned_addr learned my addr 172.21.15.29:0/3623723305 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768216f700 1 --2- 172.21.15.29:0/3623723305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 0x7f767c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768196e700 1 -- 172.21.15.29:0/3623723305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 msgr2=0x7f767c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768196e700 1 --2- 172.21.15.29:0/3623723305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 0x7f767c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768196e700 1 -- 172.21.15.29:0/3623723305 >> v1:172.21.15.29:6789/0 conn(0x7f767c15a680 legacy=0x7f767c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768196e700 1 -- 172.21.15.29:0/3623723305 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0c6340 con 0x7f767c0d1c30 2023-10-08T15:41:59.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768116d700 1 -- 172.21.15.29:0/3623723305 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245149827 0 0) 0x7f767c0c5d80 con 0x7f767c15a680 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768196e700 1 --2- 172.21.15.29:0/3623723305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c0cf710 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76700099b0 tx=0x7f7670009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4ec5b17df26c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768116d700 1 -- 172.21.15.29:0/3623723305 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670009ea0 con 0x7f767c0d1c30 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768116d700 1 -- 172.21.15.29:0/3623723305 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767000b860 con 0x7f767c0d1c30 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.678+0000 7f768116d700 1 -- 172.21.15.29:0/3623723305 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767000bc00 con 0x7f767c0d1c30 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.679+0000 7f76843d3700 1 -- 172.21.15.29:0/3623723305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 msgr2=0x7f767c0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.679+0000 7f76843d3700 1 --2- 172.21.15.29:0/3623723305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c0cf710 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76700099b0 tx=0x7f7670009250 comp rx=0 tx=0).stop 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.679+0000 7f76843d3700 1 -- 172.21.15.29:0/3623723305 shutdown_connections 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.679+0000 7f76843d3700 1 --2- 172.21.15.29:0/3623723305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 0x7f767c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.679+0000 7f76843d3700 1 --2- 172.21.15.29:0/3623723305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c0cf710 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.679+0000 7f76843d3700 1 -- 172.21.15.29:0/3623723305 >> 172.21.15.29:0/3623723305 conn(0x7f767c067e40 msgr2=0x7f767c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.679+0000 7f76843d3700 1 -- 172.21.15.29:0/3623723305 shutdown_connections 2023-10-08T15:41:59.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.679+0000 7f76843d3700 1 -- 172.21.15.29:0/3623723305 wait complete. 2023-10-08T15:41:59.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.680+0000 7f76843d3700 1 Processor -- start 2023-10-08T15:41:59.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.680+0000 7f76843d3700 1 -- start start 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f76843d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f76843d3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 0x7f767c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f76843d3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767c15a680 0x7f767c0b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f76843d3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c15f9b0 con 0x7f767c0d1c30 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f76843d3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c1551f0 con 0x7f767c15a680 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f76843d3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c15e910 con 0x7f767c15a2b0 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35716/0 (socket says 172.21.15.29:35716) 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 -- 172.21.15.29:0/2380522387 learned_addr learned my addr 172.21.15.29:0/2380522387 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768196e700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 0x7f767c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f7682970700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767c15a680 0x7f767c0b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 -- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 msgr2=0x7f767c0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 0x7f767c0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 -- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767c15a680 msgr2=0x7f767c0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767c15a680 0x7f767c0b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 -- 172.21.15.29:0/2380522387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76700094f0 con 0x7f767c0d1c30 2023-10-08T15:41:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f7682970700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767c15a680 0x7f767c0b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:41:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f768216f700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c154cb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f766c009ea0 tx=0x7f766c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f767a7fc700 1 -- 172.21.15.29:0/2380522387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c00cc00 con 0x7f767c0d1c30 2023-10-08T15:41:59.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f767a7fc700 1 -- 172.21.15.29:0/2380522387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c00f040 con 0x7f767c0d1c30 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f767a7fc700 1 -- 172.21.15.29:0/2380522387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c014480 con 0x7f767c0d1c30 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c15ebf0 con 0x7f767c0d1c30 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.681+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c15f1b0 con 0x7f767c0d1c30 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.682+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c04c3c0 con 0x7f767c0d1c30 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.683+0000 7f767a7fc700 1 -- 172.21.15.29:0/2380522387 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f766c0147f0 con 0x7f767c0d1c30 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.683+0000 7f767a7fc700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7668066f30 0x7f76680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.683+0000 7f767a7fc700 1 -- 172.21.15.29:0/2380522387 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f766c084d10 con 0x7f767c0d1c30 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.683+0000 7f767a7fc700 1 -- 172.21.15.29:0/2380522387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f766806ea50 con 0x7f767c0d1c30 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.683+0000 7f768196e700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7668066f30 0x7f76680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:41:59.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.684+0000 7f768196e700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7668066f30 0x7f76680693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f76700099b0 tx=0x7f7670017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:41:59.688 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.687+0000 7f767a7fc700 1 -- 172.21.15.29:0/2380522387 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f766c051f80 con 0x7f767c0d1c30 2023-10-08T15:41:59.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.880+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f767c15f800 con 0x7f767c0d1c30 2023-10-08T15:41:59.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.881+0000 7f767a7fc700 1 -- 172.21.15.29:0/2380522387 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32403 (secure 0 0 0) 0x7f766c0555a0 con 0x7f767c0d1c30 2023-10-08T15:41:59.882 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:41:59.882 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:41:59.882 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 49, 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2023-10-08T15:40:06.698823+0000", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2023-10-08T15:41:58.500209+0000", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2023-10-08T15:40:12.124600+0000", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2023-10-08T15:40:09.117651+0000", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2023-10-08T15:41:59.883 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 7, 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 8, 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2023-10-08T15:41:59.884 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "quincy", 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:40:12.381633+0000", 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:59.885 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:59.886 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:59.887 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:59.888 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:59.889 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2023-10-08T15:41:59.890 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 6, 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:39.312324+0000", 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:41:59.891 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2023-10-08T15:41:59.892 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:59.893 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:59.894 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:59.895 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:59.896 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 7, 2023-10-08T15:41:59.897 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:40.225704+0000", 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:41:59.898 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:41:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:41:59.900 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:41:59.901 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:41:59.902 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T15:41:59.903 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.904 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.905 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.906 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6802", 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6803", 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.907 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6806", 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6807", 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.908 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6804", 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6805", 2023-10-08T15:41:59.909 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6801/86356", 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6803/86356", 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6807/86356", 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6805/86356", 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.910 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.911 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6808", 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.912 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6809", 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6810", 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.913 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6811", 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6814", 2023-10-08T15:41:59.914 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6815", 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.915 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6812", 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6813", 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6809/86358", 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6811/86358", 2023-10-08T15:41:59.916 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6815/86358", 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6813/86358", 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.917 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6816", 2023-10-08T15:41:59.918 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6817", 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.919 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6818", 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6819", 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.920 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6823", 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6825", 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.921 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6820", 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6821", 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.922 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6817/86359", 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6819/86359", 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6825/86359", 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6821/86359", 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.923 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.924 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6822", 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6824", 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6826", 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6827", 2023-10-08T15:41:59.926 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6830", 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.927 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6831", 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6828", 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.928 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6829", 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6824/86379", 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6827/86379", 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6831/86379", 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6829/86379", 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.929 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull", 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.930 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6819", 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.931 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6821", 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6823", 2023-10-08T15:41:59.932 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6826", 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.933 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6830", 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6831", 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.934 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6828", 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6829", 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.935 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6821/86587", 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6826/86587", 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6831/86587", 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6829/86587", 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.936 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.937 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6816", 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6817", 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.938 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6818", 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6820", 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.939 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6825", 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6827", 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6822", 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6824", 2023-10-08T15:41:59.941 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6817/86596", 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6820/86596", 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6827/86596", 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6824/86596", 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.942 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.943 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6800", 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6801", 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.944 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6802", 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.945 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6803", 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6806", 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.946 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6807", 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6804", 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.947 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6805", 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6801/86585", 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6803/86585", 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6807/86585", 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6805/86585", 2023-10-08T15:41:59.948 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:41:59.949 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6808", 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.950 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6809", 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.951 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6810", 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6811", 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.952 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6814", 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6815", 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:41:59.953 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6812", 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6813", 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.954 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6809/86586", 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6811/86586", 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6815/86586", 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6813/86586", 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:59.955 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.252513+0000", 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.956 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.293514+0000", 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.957 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.271170+0000", 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.958 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.272577+0000", 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.317440+0000", 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.309422+0000", 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.276770+0000", 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:41:59.961 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.222500+0000", 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2023-10-08T15:41:59.962 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2023-10-08T15:41:59.963 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:41:59.964 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7668066f30 msgr2=0x7f76680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7668066f30 0x7f76680693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f76700099b0 tx=0x7f7670017000 comp rx=0 tx=0).stop 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 msgr2=0x7f767c154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c154cb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f766c009ea0 tx=0x7f766c00b040 comp rx=0 tx=0).stop 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 shutdown_connections 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7668066f30 0x7f76680693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767c15a680 0x7f767c0b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f767c0d1c30 0x7f767c154cb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 --2- 172.21.15.29:0/2380522387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f767c15a2b0 0x7f767c0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:41:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 >> 172.21.15.29:0/2380522387 conn(0x7f767c067e40 msgr2=0x7f767c0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:41:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 shutdown_connections 2023-10-08T15:41:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:41:59.883+0000 7f76843d3700 1 -- 172.21.15.29:0/2380522387 wait complete. 2023-10-08T15:41:59.967 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:00.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.085+0000 7fb880fb0700 1 Processor -- start 2023-10-08T15:42:00.086 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.085+0000 7fb880fb0700 1 -- start start 2023-10-08T15:42:00.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.086+0000 7fb880fb0700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb87c156570 0x7fb87c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.086+0000 7fb880fb0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 0x7fb87c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.086+0000 7fb880fb0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb87c156940 0x7fb87c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.086+0000 7fb880fb0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c157c30 con 0x7fb87c156940 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.086+0000 7fb880fb0700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c1584f0 con 0x7fb87c156570 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.086+0000 7fb880fb0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c157670 con 0x7fb87c15a330 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb87c156940 0x7fb87c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb879d9b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 0x7fb87c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb87c156940 0x7fb87c156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35726/0 (socket says 172.21.15.29:35726) 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 -- 172.21.15.29:0/1885417171 learned_addr learned my addr 172.21.15.29:0/1885417171 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87a59c700 1 --2- 172.21.15.29:0/1885417171 >> v2:172.21.15.183:3300/0 conn(0x7fb87c156570 0x7fb87c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.089 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 -- 172.21.15.29:0/1885417171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 msgr2=0x7fb87c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 --2- 172.21.15.29:0/1885417171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 0x7fb87c06d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 -- 172.21.15.29:0/1885417171 >> v2:172.21.15.183:3300/0 conn(0x7fb87c156570 msgr2=0x7fb87c06d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 --2- 172.21.15.29:0/1885417171 >> v2:172.21.15.183:3300/0 conn(0x7fb87c156570 0x7fb87c06d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 -- 172.21.15.29:0/1885417171 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c157950 con 0x7fb87c156940 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87ad9d700 1 --2- 172.21.15.29:0/1885417171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156940 0x7fb87c156da0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0c9e60 tx=0x7fb86c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657ab933a24093b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87959a700 1 -- 172.21.15.29:0/1885417171 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00b640 con 0x7fb87c156940 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87959a700 1 -- 172.21.15.29:0/1885417171 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c00b7a0 con 0x7fb87c156940 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.087+0000 7fb87959a700 1 -- 172.21.15.29:0/1885417171 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00bb40 con 0x7fb87c156940 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 -- 172.21.15.29:0/1885417171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156940 msgr2=0x7fb87c156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 --2- 172.21.15.29:0/1885417171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156940 0x7fb87c156da0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0c9e60 tx=0x7fb86c009250 comp rx=0 tx=0).stop 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 -- 172.21.15.29:0/1885417171 shutdown_connections 2023-10-08T15:42:00.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 --2- 172.21.15.29:0/1885417171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156940 0x7fb87c156da0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 --2- 172.21.15.29:0/1885417171 >> v2:172.21.15.183:3300/0 conn(0x7fb87c156570 0x7fb87c06d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 --2- 172.21.15.29:0/1885417171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 0x7fb87c06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 -- 172.21.15.29:0/1885417171 >> 172.21.15.29:0/1885417171 conn(0x7fb87c067660 msgr2=0x7fb87c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:00.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 -- 172.21.15.29:0/1885417171 shutdown_connections 2023-10-08T15:42:00.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.088+0000 7fb880fb0700 1 -- 172.21.15.29:0/1885417171 wait complete. 2023-10-08T15:42:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.089+0000 7fb880fb0700 1 Processor -- start 2023-10-08T15:42:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.089+0000 7fb880fb0700 1 -- start start 2023-10-08T15:42:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb880fb0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156570 0x7fb87c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb880fb0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c156940 0x7fb87c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb880fb0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 0x7fb87c1488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb880fb0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0c7210 con 0x7fb87c156570 2023-10-08T15:42:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb880fb0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0c6990 con 0x7fb87c156940 2023-10-08T15:42:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb880fb0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0c39c0 con 0x7fb87c15a330 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156570 0x7fb87c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156570 0x7fb87c0c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35736/0 (socket says 172.21.15.29:35736) 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 -- 172.21.15.29:0/3647902764 learned_addr learned my addr 172.21.15.29:0/3647902764 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87ad9d700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 0x7fb87c1488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb879d9b700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c156940 0x7fb87c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 -- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 msgr2=0x7fb87c1488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 0x7fb87c1488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 -- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c156940 msgr2=0x7fb87c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c156940 0x7fb87c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 -- 172.21.15.29:0/3647902764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0094f0 con 0x7fb87c156570 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb87a59c700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156570 0x7fb87c0c6b80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb874011e70 tx=0x7fb874009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.090+0000 7fb8727fc700 1 -- 172.21.15.29:0/3647902764 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87400f040 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.091+0000 7fb8727fc700 1 -- 172.21.15.29:0/3647902764 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87400fc50 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.091+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c0c3ca0 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.091+0000 7fb8727fc700 1 -- 172.21.15.29:0/3647902764 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874015420 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.091+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c0c4260 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.092+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c0c45d0 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.092+0000 7fb8727fc700 1 -- 172.21.15.29:0/3647902764 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8740157d0 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.092+0000 7fb8727fc700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb85c066f30 0x7fb85c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.093+0000 7fb8727fc700 1 -- 172.21.15.29:0/3647902764 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb874086b00 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.093+0000 7fb8727fc700 1 -- 172.21.15.29:0/3647902764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7fb85c06ea50 con 0x7fb87c156570 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.093+0000 7fb879d9b700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb85c066f30 0x7fb85c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.093+0000 7fb879d9b700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb85c066f30 0x7fb85c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0aed70 tx=0x7fb864008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:00.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.097+0000 7fb8727fc700 1 -- 172.21.15.29:0/3647902764 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb874019060 con 0x7fb87c156570 2023-10-08T15:42:00.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.336+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb87c04c3c0 con 0x7fb87c156570 2023-10-08T15:42:00.337 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.337+0000 7fb8727fc700 1 -- 172.21.15.29:0/3647902764 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fb874023070 con 0x7fb87c156570 2023-10-08T15:42:00.338 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:00.338 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:42:00.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb85c066f30 msgr2=0x7fb85c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb85c066f30 0x7fb85c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0aed70 tx=0x7fb864008040 comp rx=0 tx=0).stop 2023-10-08T15:42:00.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156570 msgr2=0x7fb87c0c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156570 0x7fb87c0c6b80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb874011e70 tx=0x7fb874009740 comp rx=0 tx=0).stop 2023-10-08T15:42:00.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 shutdown_connections 2023-10-08T15:42:00.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb85c066f30 0x7fb85c0693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb87c15a330 0x7fb87c1488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb87c156570 0x7fb87c0c6b80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 --2- 172.21.15.29:0/3647902764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c156940 0x7fb87c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 >> 172.21.15.29:0/3647902764 conn(0x7fb87c067660 msgr2=0x7fb87c155040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:00.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 shutdown_connections 2023-10-08T15:42:00.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.339+0000 7fb880fb0700 1 -- 172.21.15.29:0/3647902764 wait complete. 2023-10-08T15:42:00.342 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:42:00.352 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-08T15:42:00.490 INFO:teuthology.orchestra.run.smithi029.stdout:{"cluster_fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","whoami":0,"id":5310,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.630440950000001,"mdsmap_epoch":25,"osdmap_epoch":49,"osdmap_epoch_barrier":49,"uptime":24.566935751999999} 2023-10-08T15:42:00.490 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", "fs_name": "cephfs", "id": 5310, "mdsmap_epoch": 25, "osdmap_epoch": 49, "osdmap_epoch_barrier": 49, "rank_uptime": 18.63044095, "state": "up:active", "uptime": 24.566935752, "want_state": "up:active", "whoami": 0 } 2023-10-08T15:42:00.490 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T15:42:00.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:42:00.491 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T15:42:00.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:42:00.507 INFO:teuthology.orchestra.run.smithi029.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-08T15:42:00.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:42:00.507 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-08T15:42:00.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:42:00.564 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-08T15:42:00.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T15:42:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.780+0000 7f5573af3700 1 Processor -- start 2023-10-08T15:42:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.780+0000 7f5573af3700 1 -- start start 2023-10-08T15:42:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.781+0000 7f5573af3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f556c0b1220 0x7f556c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.781+0000 7f5573af3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c15de60 con 0x7f556c0b0e50 2023-10-08T15:42:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.781+0000 7f5573af3700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c15e140 con 0x7f556c0cb4f0 2023-10-08T15:42:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.781+0000 7f5573af3700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556c15e420 con 0x7f556c0b1220 2023-10-08T15:42:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.781+0000 7f557188f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f556c0b0e50 0x7f556c06d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56450/0 (socket says 172.21.15.29:56450) 2023-10-08T15:42:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.781+0000 7f557188f700 1 -- 172.21.15.29:0/3260198055 learned_addr learned my addr 172.21.15.29:0/3260198055 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130898024 0 0) 0x7f556c15de60 con 0x7f556c0b0e50 2023-10-08T15:42:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5554003570 con 0x7f556c0b0e50 2023-10-08T15:42:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557108e700 1 --2- 172.21.15.29:0/3260198055 >> v2:172.21.15.183:3300/0 conn(0x7f556c0b1220 0x7f556c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924039300 0 0) 0x7f5554003570 con 0x7f556c0b0e50 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 >> v2:172.21.15.183:3300/0 conn(0x7f556c0b1220 msgr2=0x7f556c0c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 --2- 172.21.15.29:0/3260198055 >> v2:172.21.15.183:3300/0 conn(0x7f556c0b1220 0x7f556c0c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 >> v1:172.21.15.183:6789/0 conn(0x7f556c0cb4f0 legacy=0x7f556c0679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c15e700 con 0x7f556c0b0e50 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f5564001470 con 0x7f556c0b0e50 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 >> v1:172.21.15.29:6789/0 conn(0x7f556c0b0e50 legacy=0x7f556c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5554003ab0 0x7f5554003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554004810 0x7f5554004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5554005290 0x7f555400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c15e420 con 0x7f5554005290 2023-10-08T15:42:00.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555400c250 con 0x7f5554003ab0 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555400c410 con 0x7f5554004810 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f5572090700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5554005290 0x7f555400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557108e700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554004810 0x7f5554004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f557188f700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5554003ab0 0x7f5554003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.782+0000 7f5572090700 1 -- 172.21.15.29:0/3260198055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554004810 msgr2=0x7f5554004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5572090700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554004810 0x7f5554004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5572090700 1 -- 172.21.15.29:0/3260198055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5554003ab0 msgr2=0x7f5554003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5572090700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5554003ab0 0x7f5554003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5572090700 1 -- 172.21.15.29:0/3260198055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5554003570 con 0x7f5554005290 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5572090700 1 -- 172.21.15.29:0/3260198055 reap_dead start 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5572090700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5554005290 0x7f555400ba60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f555c001fc0 tx=0x7f555c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5a4225d5f3f524 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c001950 con 0x7f5554005290 2023-10-08T15:42:00.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c00c8b0 con 0x7f5554005290 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f557088d700 1 -- 172.21.15.29:0/3260198055 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00cc50 con 0x7f5554005290 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5573af3700 1 -- 172.21.15.29:0/3260198055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5554005290 msgr2=0x7f555400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5573af3700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5554005290 0x7f555400ba60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f555c001fc0 tx=0x7f555c001640 comp rx=0 tx=0).stop 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5573af3700 1 -- 172.21.15.29:0/3260198055 shutdown_connections 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5573af3700 1 --2- 172.21.15.29:0/3260198055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5554005290 0x7f555400ba60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5573af3700 1 -- 172.21.15.29:0/3260198055 >> 172.21.15.29:0/3260198055 conn(0x7f556c069870 msgr2=0x7f556c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5573af3700 1 -- 172.21.15.29:0/3260198055 shutdown_connections 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.783+0000 7f5573af3700 1 -- 172.21.15.29:0/3260198055 wait complete. 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.784+0000 7f5573af3700 1 Processor -- start 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.784+0000 7f5573af3700 1 -- start start 2023-10-08T15:42:00.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f5573af3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554005290 0x7f556c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f5573af3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f556c0b42a0 0x7f556c0679d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f5573af3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f556c0b4710 0x7f556c067f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f5573af3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0b3200 con 0x7f556c0b42a0 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f5573af3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0b34e0 con 0x7f556c0b4710 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f5573af3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0b37c0 con 0x7f5554005290 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f557108e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f556c0b42a0 0x7f556c0679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f557108e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f556c0b42a0 0x7f556c0679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35760/0 (socket says 172.21.15.29:35760) 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f557108e700 1 -- 172.21.15.29:0/3127245394 learned_addr learned my addr 172.21.15.29:0/3127245394 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f557188f700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554005290 0x7f556c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.785+0000 7f5572090700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f556c0b4710 0x7f556c067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f557108e700 1 -- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554005290 msgr2=0x7f556c14d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f557108e700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554005290 0x7f556c14d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f557108e700 1 -- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f556c0b4710 msgr2=0x7f556c067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f557108e700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f556c0b4710 0x7f556c067f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f557108e700 1 -- 172.21.15.29:0/3127245394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c0b3aa0 con 0x7f556c0b42a0 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f5572090700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f556c0b4710 0x7f556c067f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f557108e700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f556c0b42a0 0x7f556c0679d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5560009fd0 tx=0x7f55600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f5569ffb700 1 -- 172.21.15.29:0/3127245394 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556000f940 con 0x7f556c0b42a0 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f5569ffb700 1 -- 172.21.15.29:0/3127245394 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556000faa0 con 0x7f556c0b42a0 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556c0b3d80 con 0x7f556c0b42a0 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f5569ffb700 1 -- 172.21.15.29:0/3127245394 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556000fe20 con 0x7f556c0b42a0 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.786+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c0c62d0 con 0x7f556c0b42a0 2023-10-08T15:42:00.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.787+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c0b3fa0 con 0x7f556c0b42a0 2023-10-08T15:42:00.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.787+0000 7f5569ffb700 1 -- 172.21.15.29:0/3127245394 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5560014650 con 0x7f556c0b42a0 2023-10-08T15:42:00.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.788+0000 7f5569ffb700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5558066f60 0x7f5558069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:00.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.788+0000 7f5569ffb700 1 -- 172.21.15.29:0/3127245394 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5560018030 con 0x7f556c0b42a0 2023-10-08T15:42:00.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.788+0000 7f557188f700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5558066f60 0x7f5558069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:00.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.788+0000 7f5569ffb700 1 -- 172.21.15.29:0/3127245394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f555806ea80 con 0x7f556c0b42a0 2023-10-08T15:42:00.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.789+0000 7f557188f700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5558066f60 0x7f5558069410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5564001120 tx=0x7f5564001d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:00.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.792+0000 7f5569ffb700 1 -- 172.21.15.29:0/3127245394 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5560022060 con 0x7f556c0b42a0 2023-10-08T15:42:00.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.988+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f556c04c3c0 con 0x7f556c0b42a0 2023-10-08T15:42:00.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.989+0000 7f5569ffb700 1 -- 172.21.15.29:0/3127245394 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32403 (secure 0 0 0) 0x7f556008a020 con 0x7f556c0b42a0 2023-10-08T15:42:00.989 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 49, 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2023-10-08T15:40:06.698823+0000", 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2023-10-08T15:41:58.500209+0000", 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2023-10-08T15:40:12.124600+0000", 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2023-10-08T15:40:09.117651+0000", 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2023-10-08T15:42:00.990 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 7, 2023-10-08T15:42:00.991 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 8, 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "quincy", 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:40:12.381633+0000", 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:00.992 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2023-10-08T15:42:00.993 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:00.994 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:00.995 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:00.996 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:00.997 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 6, 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2023-10-08T15:42:00.998 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:39.312324+0000", 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:00.999 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:01.000 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:01.001 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:01.002 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:01.003 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:42:01.004 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 7, 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:40.225704+0000", 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:01.005 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2023-10-08T15:42:01.006 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:01.007 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:01.008 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:01.009 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:01.010 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2023-10-08T15:42:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:01.012 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2023-10-08T15:42:01.013 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6802", 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.014 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6803", 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6806", 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.015 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6807", 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6804", 2023-10-08T15:42:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6805", 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6801/86356", 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6803/86356", 2023-10-08T15:42:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6807/86356", 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6805/86356", 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:01.018 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.019 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6808", 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6809", 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:01.020 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6810", 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6811", 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.021 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6814", 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6815", 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6812", 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6813", 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6809/86358", 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6811/86358", 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6815/86358", 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6813/86358", 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:01.024 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:01.025 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6816", 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.026 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6817", 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6818", 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:01.027 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6819", 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.028 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6823", 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6825", 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.029 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6820", 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6821", 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.030 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6817/86359", 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6819/86359", 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6825/86359", 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6821/86359", 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:42:01.031 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:01.032 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6822", 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6824", 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.033 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6826", 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6827", 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.034 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6830", 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6831", 2023-10-08T15:42:01.035 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6828", 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.036 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6829", 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6824/86379", 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6827/86379", 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6831/86379", 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6829/86379", 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull", 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:01.037 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:01.038 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6819", 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.039 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6821", 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6823", 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:01.040 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6826", 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.041 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6830", 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6831", 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.042 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6828", 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6829", 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.043 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6821/86587", 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6826/86587", 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6831/86587", 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6829/86587", 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:01.044 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.045 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6816", 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6817", 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.046 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6818", 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6820", 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.047 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6825", 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6827", 2023-10-08T15:42:01.048 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6822", 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.049 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6824", 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6817/86596", 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6820/86596", 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6827/86596", 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6824/86596", 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:01.050 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:01.051 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6800", 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.052 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6801", 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6802", 2023-10-08T15:42:01.053 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6803", 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.054 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6806", 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6807", 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:01.055 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6804", 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6805", 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.056 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6801/86585", 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6803/86585", 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6807/86585", 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6805/86585", 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.057 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:01.058 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6808", 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6809", 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:01.059 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6810", 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6811", 2023-10-08T15:42:01.060 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6814", 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.061 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6815", 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6812", 2023-10-08T15:42:01.062 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6813", 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6809/86586", 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6811/86586", 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6815/86586", 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6813/86586", 2023-10-08T15:42:01.063 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:01.064 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.252513+0000", 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:01.065 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.293514+0000", 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:01.066 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.271170+0000", 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:01.067 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.272577+0000", 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:01.068 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.317440+0000", 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.309422+0000", 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:01.069 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.276770+0000", 2023-10-08T15:42:01.070 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.222500+0000", 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:01.071 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2023-10-08T15:42:01.072 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2023-10-08T15:42:01.073 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2023-10-08T15:42:01.074 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2023-10-08T15:42:01.074 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2023-10-08T15:42:01.074 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2023-10-08T15:42:01.074 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2023-10-08T15:42:01.074 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:01.074 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5558066f60 msgr2=0x7f5558069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5558066f60 0x7f5558069410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5564001120 tx=0x7f5564001d80 comp rx=0 tx=0).stop 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f556c0b42a0 msgr2=0x7f556c0679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f556c0b42a0 0x7f556c0679d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5560009fd0 tx=0x7f55600091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 shutdown_connections 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5558066f60 0x7f5558069410 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f556c0b4710 0x7f556c067f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5554005290 0x7f556c14d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 --2- 172.21.15.29:0/3127245394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f556c0b42a0 0x7f556c0679d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:01.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 >> 172.21.15.29:0/3127245394 conn(0x7f556c069870 msgr2=0x7f556c0cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:01.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 shutdown_connections 2023-10-08T15:42:01.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:00.991+0000 7f5573af3700 1 -- 172.21.15.29:0/3127245394 wait complete. 2023-10-08T15:42:01.077 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T15:42:06.078 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T15:42:06.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.211+0000 7f77fdc43700 1 Processor -- start 2023-10-08T15:42:06.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.211+0000 7f77fdc43700 1 -- start start 2023-10-08T15:42:06.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.211+0000 7f77fdc43700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f77f8156a50 0x7f77f80c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.211+0000 7f77fdc43700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8156e20 0x7f77f8067b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.211+0000 7f77fdc43700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f80c87d0 con 0x7f77f80c91a0 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.211+0000 7f77fdc43700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f8068d10 con 0x7f77f8156a50 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.211+0000 7f77fdc43700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f806e650 con 0x7f77f8156e20 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f77f80c91a0 0x7f77f80adab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:56464/0 (socket says 172.21.15.29:56464) 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f7fff700 1 -- 172.21.15.29:0/4040585094 learned_addr learned my addr 172.21.15.29:0/4040585094 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f77fe700 1 --2- 172.21.15.29:0/4040585094 >> v2:172.21.15.183:3300/0 conn(0x7f77f8156a50 0x7f77f80c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f6ffd700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8156e20 0x7f77f8067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083837035 0 0) 0x7f77f80c87d0 con 0x7f77f80c91a0 2023-10-08T15:42:06.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e0003570 con 0x7f77f80c91a0 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2328789056 0 0) 0x7f77e0003570 con 0x7f77f80c91a0 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8156e20 msgr2=0x7f77f8067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8156e20 0x7f77f8067b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 >> v2:172.21.15.183:3300/0 conn(0x7f77f8156a50 msgr2=0x7f77f80c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 --2- 172.21.15.29:0/4040585094 >> v2:172.21.15.183:3300/0 conn(0x7f77f8156a50 0x7f77f80c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8068750 con 0x7f77f80c91a0 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f77f00017f0 con 0x7f77f80c91a0 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 >> v1:172.21.15.29:6789/0 conn(0x7f77f80c91a0 legacy=0x7f77f80adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0003a60 0x7f77e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e0004810 0x7f77e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8156e20 0x7f77e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8068d10 con 0x7f77e0004810 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f806e650 con 0x7f77e0003a60 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0005240 con 0x7f77f8156e20 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.212+0000 7f77f6ffd700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e0004810 0x7f77e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f7fff700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8156e20 0x7f77e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f77fe700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0003a60 0x7f77e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f6ffd700 1 -- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8156e20 msgr2=0x7f77e000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f6ffd700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8156e20 0x7f77e000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f6ffd700 1 -- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0003a60 msgr2=0x7f77e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f6ffd700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0003a60 0x7f77e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f6ffd700 1 -- 172.21.15.29:0/4040585094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0003570 con 0x7f77e0004810 2023-10-08T15:42:06.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f77fe700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0003a60 0x7f77e0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f6ffd700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e0004810 0x7f77e0004c80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f77f8157230 tx=0x7f77ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcd977265edc0df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00e710 con 0x7f77e0004810 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00e870 con 0x7f77e0004810 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.213+0000 7f77f67fc700 1 -- 172.21.15.29:0/4040585094 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00ec30 con 0x7f77e0004810 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.214+0000 7f77fdc43700 1 -- 172.21.15.29:0/4040585094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e0004810 msgr2=0x7f77e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.214+0000 7f77fdc43700 1 --2- 172.21.15.29:0/4040585094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e0004810 0x7f77e0004c80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f77f8157230 tx=0x7f77ec0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.214+0000 7f77f7fff700 1 -- 172.21.15.29:0/4040585094 reap_dead start 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.214+0000 7f77fdc43700 1 -- 172.21.15.29:0/4040585094 shutdown_connections 2023-10-08T15:42:06.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.214+0000 7f77fdc43700 1 -- 172.21.15.29:0/4040585094 >> 172.21.15.29:0/4040585094 conn(0x7f77f806a250 msgr2=0x7f77f806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:06.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.214+0000 7f77fdc43700 1 -- 172.21.15.29:0/4040585094 shutdown_connections 2023-10-08T15:42:06.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.214+0000 7f77fdc43700 1 -- 172.21.15.29:0/4040585094 wait complete. 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.215+0000 7f77fdc43700 1 Processor -- start 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.215+0000 7f77fdc43700 1 -- start start 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77fdc43700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0004810 0x7f77f8155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77fdc43700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f8155ca0 0x7f77f81596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77fdc43700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8159c10 0x7f77f80c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77fdc43700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80c6350 con 0x7f77f8155ca0 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77fdc43700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80b21c0 con 0x7f77e0004810 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77fdc43700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8157260 con 0x7f77f8159c10 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f8155ca0 0x7f77f81596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f8155ca0 0x7f77f81596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35770/0 (socket says 172.21.15.29:35770) 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 -- 172.21.15.29:0/1289410956 learned_addr learned my addr 172.21.15.29:0/1289410956 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f7fff700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8159c10 0x7f77f80c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f77fe700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0004810 0x7f77f8155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 -- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8159c10 msgr2=0x7f77f80c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8159c10 0x7f77f80c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 -- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0004810 msgr2=0x7f77f8155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0004810 0x7f77f8155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 -- 172.21.15.29:0/1289410956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80c5d90 con 0x7f77f8155ca0 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.216+0000 7f77f6ffd700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f8155ca0 0x7f77f81596d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00e4b0 tx=0x7f77ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.217+0000 7f77df7fe700 1 -- 172.21.15.29:0/1289410956 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec022070 con 0x7f77f8155ca0 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.217+0000 7f77df7fe700 1 -- 172.21.15.29:0/1289410956 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00e9e0 con 0x7f77f8155ca0 2023-10-08T15:42:06.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.217+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f80c6070 con 0x7f77f8155ca0 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.217+0000 7f77df7fe700 1 -- 172.21.15.29:0/1289410956 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec027470 con 0x7f77f8155ca0 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.217+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f815a080 con 0x7f77f8155ca0 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.218+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f804c3c0 con 0x7f77f8155ca0 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.218+0000 7f77df7fe700 1 -- 172.21.15.29:0/1289410956 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77ec01c450 con 0x7f77f8155ca0 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.218+0000 7f77df7fe700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77e4066f30 0x7f77e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.219+0000 7f77df7fe700 1 -- 172.21.15.29:0/1289410956 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77ec085fa0 con 0x7f77f8155ca0 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.219+0000 7f77f77fe700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77e4066f30 0x7f77e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.219+0000 7f77df7fe700 1 -- 172.21.15.29:0/1289410956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f77e406ea50 con 0x7f77f8155ca0 2023-10-08T15:42:06.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.219+0000 7f77f77fe700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77e4066f30 0x7f77e40693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009ee0 tx=0x7f77e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:06.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.223+0000 7f77df7fe700 1 -- 172.21.15.29:0/1289410956 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77ec0b75a0 con 0x7f77f8155ca0 2023-10-08T15:42:06.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.416+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f77f8068a30 con 0x7f77f8155ca0 2023-10-08T15:42:06.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.417+0000 7f77df7fe700 1 -- 172.21.15.29:0/1289410956 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32403 (secure 0 0 0) 0x7f77ec02c030 con 0x7f77f8155ca0 2023-10-08T15:42:06.417 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 49, 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2023-10-08T15:40:06.698823+0000", 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2023-10-08T15:41:58.500209+0000", 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2023-10-08T15:40:12.124600+0000", 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2023-10-08T15:40:09.117651+0000", 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T15:42:06.418 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2023-10-08T15:42:06.419 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 7, 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 8, 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "quincy", 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:40:12.381633+0000", 2023-10-08T15:42:06.420 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:06.421 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:06.422 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:06.423 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:06.424 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:06.425 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 6, 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:39.312324+0000", 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:06.427 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2023-10-08T15:42:06.428 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:06.429 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:06.430 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:06.431 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:06.432 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.433 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 7, 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:40.225704+0000", 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 3, 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool,full", 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:06.434 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:06.435 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "47", 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:06.436 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:06.437 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:06.439 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:06.440 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:06.441 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.442 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6802", 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.443 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6803", 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.444 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6806", 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6807", 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.445 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6804", 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6805", 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.446 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6801/86356", 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6803/86356", 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6807/86356", 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6805/86356", 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:06.447 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.449 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.449 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.449 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:42:06.449 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:06.450 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6808", 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6809", 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.451 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6810", 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6811", 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.452 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.453 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.453 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:06.453 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.453 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.453 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.453 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6814", 2023-10-08T15:42:06.453 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:06.453 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6815", 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6812", 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6813", 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6809/86358", 2023-10-08T15:42:06.455 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6811/86358", 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6815/86358", 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6813/86358", 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:06.456 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.457 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6816", 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6817", 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.458 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6818", 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6819", 2023-10-08T15:42:06.459 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:06.460 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.460 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.460 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.460 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:06.460 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.460 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.460 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.460 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6823", 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6825", 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.461 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6820", 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6821", 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.462 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6817/86359", 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6819/86359", 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6825/86359", 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6821/86359", 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.463 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:06.464 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6822", 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6824", 2023-10-08T15:42:06.465 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6826", 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:06.466 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6827", 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.467 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6830", 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6831", 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.468 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6828", 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6829", 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:06.469 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6824/86379", 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6827/86379", 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6831/86379", 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6829/86379", 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull", 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:06.470 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:06.471 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6819", 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.472 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6821", 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6823", 2023-10-08T15:42:06.473 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6826", 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.474 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6830", 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6831", 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:06.475 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6828", 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6829", 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.476 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6821/86587", 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6826/86587", 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6831/86587", 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6829/86587", 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:42:06.477 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:06.478 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6816", 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6817", 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:06.479 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6818", 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.480 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6820", 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6825", 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:06.481 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6827", 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.482 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6822", 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6824", 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.483 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6817/86596", 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6820/86596", 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6827/86596", 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6824/86596", 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:42:06.484 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:06.485 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6800", 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6801", 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:06.486 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6802", 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.487 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6803", 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6806", 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.488 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6807", 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6804", 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:06.489 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6805", 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6801/86585", 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6803/86585", 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6807/86585", 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6805/86585", 2023-10-08T15:42:06.490 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:06.491 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.492 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6808", 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6809", 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:06.493 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6810", 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6811", 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.494 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6814", 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6815", 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:06.495 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6812", 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:06.496 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6813", 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6809/86586", 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6811/86586", 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6815/86586", 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6813/86586", 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "full", 2023-10-08T15:42:06.497 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:06.498 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.252513+0000", 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.293514+0000", 2023-10-08T15:42:06.499 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.271170+0000", 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:06.500 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.272577+0000", 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:42:06.501 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.317440+0000", 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:06.502 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.309422+0000", 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.276770+0000", 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:06.504 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.222500+0000", 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2023-10-08T15:42:06.505 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2023-10-08T15:42:06.506 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2023-10-08T15:42:06.507 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2023-10-08T15:42:06.507 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2023-10-08T15:42:06.507 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2023-10-08T15:42:06.507 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2023-10-08T15:42:06.507 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2023-10-08T15:42:06.507 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:06.507 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77e4066f30 msgr2=0x7f77e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77e4066f30 0x7f77e40693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009ee0 tx=0x7f77e8008040 comp rx=0 tx=0).stop 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f8155ca0 msgr2=0x7f77f81596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f8155ca0 0x7f77f81596d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00e4b0 tx=0x7f77ec01a000 comp rx=0 tx=0).stop 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 shutdown_connections 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f77e4066f30 0x7f77e40693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77f8159c10 0x7f77f80c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77e0004810 0x7f77f8155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 --2- 172.21.15.29:0/1289410956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77f8155ca0 0x7f77f81596d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 >> 172.21.15.29:0/1289410956 conn(0x7f77f806a250 msgr2=0x7f77f8154380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 shutdown_connections 2023-10-08T15:42:06.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:06.419+0000 7f77fdc43700 1 -- 172.21.15.29:0/1289410956 wait complete. 2023-10-08T15:42:06.510 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-08T15:42:06.511 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-08T15:42:06.478+0000 7f3b3c216700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-08T15:42:11.512 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T15:42:11.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.644+0000 7f8df6c7e700 1 Processor -- start 2023-10-08T15:42:11.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.644+0000 7f8df6c7e700 1 -- start start 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df6c7e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8df015a2b0 0x7f8df00b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df6c7e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8df00d1c30 0x7f8df00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df6c7e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df00c5d80 con 0x7f8df015a680 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df6c7e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df0068470 con 0x7f8df015a2b0 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df6c7e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df00c6060 con 0x7f8df00d1c30 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df4a1a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8df015a2b0 0x7f8df00b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df4a1a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8df015a2b0 0x7f8df00b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38062/0 (socket says 172.21.15.29:38062) 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df4a1a700 1 -- 172.21.15.29:0/2981196082 learned_addr learned my addr 172.21.15.29:0/2981196082 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8deffff700 1 --2- 172.21.15.29:0/2981196082 >> v2:172.21.15.183:3300/0 conn(0x7f8df00d1c30 0x7f8df00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:11.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df4a1a700 1 -- 172.21.15.29:0/2981196082 >> v2:172.21.15.183:3300/0 conn(0x7f8df00d1c30 msgr2=0x7f8df00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df4a1a700 1 --2- 172.21.15.29:0/2981196082 >> v2:172.21.15.183:3300/0 conn(0x7f8df00d1c30 0x7f8df00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df4a1a700 1 -- 172.21.15.29:0/2981196082 >> v1:172.21.15.183:6789/0 conn(0x7f8df015a680 legacy=0x7f8df00c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df4a1a700 1 -- 172.21.15.29:0/2981196082 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00c6340 con 0x7f8df015a2b0 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.645+0000 7f8df4a1a700 1 --2- 172.21.15.29:0/2981196082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a2b0 0x7f8df00b3da0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8df0089190 tx=0x7f8de4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8eac21d7534f614 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8def7fe700 1 -- 172.21.15.29:0/2981196082 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4005c10 con 0x7f8df015a2b0 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8def7fe700 1 -- 172.21.15.29:0/2981196082 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4005d70 con 0x7f8df015a2b0 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8def7fe700 1 -- 172.21.15.29:0/2981196082 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de400b880 con 0x7f8df015a2b0 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8df6c7e700 1 -- 172.21.15.29:0/2981196082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a2b0 msgr2=0x7f8df00b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/2981196082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a2b0 0x7f8df00b3da0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8df0089190 tx=0x7f8de4009220 comp rx=0 tx=0).stop 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8df6c7e700 1 -- 172.21.15.29:0/2981196082 shutdown_connections 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/2981196082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a2b0 0x7f8df00b3da0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/2981196082 >> v2:172.21.15.183:3300/0 conn(0x7f8df00d1c30 0x7f8df00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8df6c7e700 1 -- 172.21.15.29:0/2981196082 >> 172.21.15.29:0/2981196082 conn(0x7f8df0067e40 msgr2=0x7f8df00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:11.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8df6c7e700 1 -- 172.21.15.29:0/2981196082 shutdown_connections 2023-10-08T15:42:11.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.646+0000 7f8df6c7e700 1 -- 172.21.15.29:0/2981196082 wait complete. 2023-10-08T15:42:11.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.647+0000 7f8df6c7e700 1 Processor -- start 2023-10-08T15:42:11.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df6c7e700 1 -- start start 2023-10-08T15:42:11.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df6c7e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d1c30 0x7f8df0149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df6c7e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df015a2b0 0x7f8df015e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df6c7e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a680 0x7f8df015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df6c7e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00c81c0 con 0x7f8df015a680 2023-10-08T15:42:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df6c7e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df014a0e0 con 0x7f8df015a2b0 2023-10-08T15:42:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df6c7e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df015f360 con 0x7f8df00d1c30 2023-10-08T15:42:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df521b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a680 0x7f8df015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:11.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df521b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a680 0x7f8df015fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38074/0 (socket says 172.21.15.29:38074) 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.648+0000 7f8df521b700 1 -- 172.21.15.29:0/1668473346 learned_addr learned my addr 172.21.15.29:0/1668473346 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8deffff700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df015a2b0 0x7f8df015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df4a1a700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d1c30 0x7f8df0149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df521b700 1 -- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d1c30 msgr2=0x7f8df0149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df521b700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d1c30 0x7f8df0149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df521b700 1 -- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df015a2b0 msgr2=0x7f8df015e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df521b700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df015a2b0 0x7f8df015e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df521b700 1 -- 172.21.15.29:0/1668473346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4009480 con 0x7f8df015a680 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df4a1a700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d1c30 0x7f8df0149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8deffff700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df015a2b0 0x7f8df015e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:11.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df521b700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a680 0x7f8df015fba0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8de800c870 tx=0x7f8de8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8decff9700 1 -- 172.21.15.29:0/1668473346 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8012630 con 0x7f8df015a680 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8decff9700 1 -- 172.21.15.29:0/1668473346 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de80127b0 con 0x7f8df015a680 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df015eac0 con 0x7f8df015a680 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8decff9700 1 -- 172.21.15.29:0/1668473346 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8012b70 con 0x7f8df015a680 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.649+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df015f080 con 0x7f8df015a680 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.650+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df00c8330 con 0x7f8df015a680 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.651+0000 7f8decff9700 1 -- 172.21.15.29:0/1668473346 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8de8003030 con 0x7f8df015a680 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.651+0000 7f8decff9700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8dd4066f30 0x7f8dd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:11.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.651+0000 7f8decff9700 1 -- 172.21.15.29:0/1668473346 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8de80844b0 con 0x7f8df015a680 2023-10-08T15:42:11.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.651+0000 7f8df4a1a700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8dd4066f30 0x7f8dd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:11.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.652+0000 7f8df4a1a700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8dd4066f30 0x7f8dd40693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009260 tx=0x7f8de4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:11.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.655+0000 7f8decff9700 1 -- 172.21.15.29:0/1668473346 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8de8051720 con 0x7f8df015a680 2023-10-08T15:42:11.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.849+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8df004c3c0 con 0x7f8df015a680 2023-10-08T15:42:11.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.850+0000 7f8decff9700 1 -- 172.21.15.29:0/1668473346 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+32260 (secure 0 0 0) 0x7f8de8054d40 con 0x7f8df015a680 2023-10-08T15:42:11.851 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:11.851 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:42:11.851 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 52, 2023-10-08T15:42:11.851 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:42:11.851 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2023-10-08T15:40:06.698823+0000", 2023-10-08T15:42:11.851 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2023-10-08T15:42:09.535200+0000", 2023-10-08T15:42:11.851 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2023-10-08T15:40:12.124600+0000", 2023-10-08T15:42:11.851 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2023-10-08T15:40:09.117651+0000", 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T15:42:11.852 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 7, 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 8, 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "quincy", 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:40:12.381633+0000", 2023-10-08T15:42:11.853 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:11.854 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:11.855 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "52", 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:11.857 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:11.858 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.859 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 6, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:39.312324+0000", 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:11.860 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:11.861 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "52", 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:11.862 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:11.863 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:11.864 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:42:11.865 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 7, 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:40.225704+0000", 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:11.866 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:11.867 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "52", 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:11.868 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:11.869 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:11.870 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:11.871 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:11.872 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.873 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.874 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6802", 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.875 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6803", 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6806", 2023-10-08T15:42:11.876 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6807", 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.877 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6804", 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6805", 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6801/86356", 2023-10-08T15:42:11.878 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6803/86356", 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6807/86356", 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6805/86356", 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.879 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:11.880 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6808", 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6809", 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.881 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6810", 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6811", 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:11.882 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6814", 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.883 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6815", 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6812", 2023-10-08T15:42:11.884 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6813", 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6809/86358", 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6811/86358", 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6815/86358", 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6813/86358", 2023-10-08T15:42:11.885 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:11.886 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6816", 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:11.887 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6817", 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.888 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6818", 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6819", 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:11.889 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6823", 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6825", 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.890 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6820", 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6821", 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:11.891 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6817/86359", 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6819/86359", 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6825/86359", 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6821/86359", 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.892 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:11.893 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6822", 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6824", 2023-10-08T15:42:11.894 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6826", 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.895 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6827", 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6830", 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:11.896 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.897 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.897 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.897 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6831", 2023-10-08T15:42:11.897 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:11.897 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.897 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.899 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6828", 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6829", 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.900 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6824/86379", 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6827/86379", 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6831/86379", 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6829/86379", 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.901 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.902 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:42:11.902 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:11.902 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:11.902 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:11.902 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:11.902 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:11.902 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:11.902 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6819", 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:11.903 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6821", 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.904 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6823", 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6826", 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.905 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6830", 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6831", 2023-10-08T15:42:11.906 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6828", 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.907 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6829", 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6821/86587", 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6826/86587", 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6831/86587", 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6829/86587", 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:11.908 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:11.909 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6816", 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.910 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6817", 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6818", 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6820", 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6825", 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:11.912 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6827", 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.913 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6822", 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6824", 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6817/86596", 2023-10-08T15:42:11.914 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6820/86596", 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6827/86596", 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6824/86596", 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:11.915 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.916 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6800", 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6801", 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.917 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6802", 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6803", 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.918 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6806", 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6807", 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.919 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6804", 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6805", 2023-10-08T15:42:11.920 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6801/86585", 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6803/86585", 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6807/86585", 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6805/86585", 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.922 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.922 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:42:11.922 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:11.922 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:11.922 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:11.922 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:11.922 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:11.922 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6808", 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:11.923 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6809", 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6810", 2023-10-08T15:42:11.924 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6811", 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.925 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6814", 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6815", 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.926 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6812", 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6813", 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.927 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6809/86586", 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6811/86586", 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6815/86586", 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6813/86586", 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2023-10-08T15:42:11.928 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.252513+0000", 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:42:11.929 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.293514+0000", 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:11.930 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.271170+0000", 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:11.931 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.272577+0000", 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.317440+0000", 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:11.932 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.309422+0000", 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:42:11.933 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.276770+0000", 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:11.934 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.222500+0000", 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2023-10-08T15:42:11.935 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2023-10-08T15:42:11.936 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:11.937 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:42:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8dd4066f30 msgr2=0x7f8dd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8dd4066f30 0x7f8dd40693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009260 tx=0x7f8de4016000 comp rx=0 tx=0).stop 2023-10-08T15:42:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a680 msgr2=0x7f8df015fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a680 0x7f8df015fba0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8de800c870 tx=0x7f8de8001670 comp rx=0 tx=0).stop 2023-10-08T15:42:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 shutdown_connections 2023-10-08T15:42:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8dd4066f30 0x7f8dd40693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8df015a680 0x7f8df015fba0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d1c30 0x7f8df0149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 --2- 172.21.15.29:0/1668473346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df015a2b0 0x7f8df015e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 >> 172.21.15.29:0/1668473346 conn(0x7f8df0067e40 msgr2=0x7f8df00b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 shutdown_connections 2023-10-08T15:42:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:11.852+0000 7f8df6c7e700 1 -- 172.21.15.29:0/1668473346 wait complete. 2023-10-08T15:42:11.940 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-08T15:42:11.941 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-08T15:42:12.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.058+0000 7f159a88f700 1 Processor -- start 2023-10-08T15:42:12.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.059+0000 7f159a88f700 1 -- start start 2023-10-08T15:42:12.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.059+0000 7f159a88f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1594157870 0x7f159415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.059+0000 7f159a88f700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1594157c40 0x7f1594158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.059+0000 7f159a88f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159415cbb0 con 0x7f159415a620 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.059+0000 7f159a88f700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159415bfa0 con 0x7f1594157c40 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.059+0000 7f159a88f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159415c280 con 0x7f1594157870 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1593fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1594157870 0x7f159415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1598e2c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1594157c40 0x7f1594158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1593fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1594157870 0x7f159415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.29:46762/0 (socket says 172.21.15.29:46762) 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1593fff700 1 -- 172.21.15.29:0/976434318 learned_addr learned my addr 172.21.15.29:0/976434318 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f15937fe700 1 --1- 172.21.15.29:0/976434318 >> v1:172.21.15.183:6789/0 conn(0x7f159415a620 0x7f159415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:43472/0 (socket says 172.21.15.29:43472) 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1593fff700 1 -- 172.21.15.29:0/976434318 >> v2:172.21.15.183:3300/0 conn(0x7f1594157c40 msgr2=0x7f1594158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1593fff700 1 --2- 172.21.15.29:0/976434318 >> v2:172.21.15.183:3300/0 conn(0x7f1594157c40 0x7f1594158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1593fff700 1 -- 172.21.15.29:0/976434318 >> v1:172.21.15.183:6789/0 conn(0x7f159415a620 legacy=0x7f159415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1593fff700 1 -- 172.21.15.29:0/976434318 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159415c560 con 0x7f1594157870 2023-10-08T15:42:12.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1598e2c700 1 --2- 172.21.15.29:0/976434318 >> v2:172.21.15.183:3300/0 conn(0x7f1594157c40 0x7f1594158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:12.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1593fff700 1 --2- 172.21.15.29:0/976434318 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1594157870 0x7f159415b6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f15880099b0 tx=0x7f1588009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c327ee16d863aeac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:12.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1592ffd700 1 -- 172.21.15.29:0/976434318 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588009ea0 con 0x7f1594157870 2023-10-08T15:42:12.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1592ffd700 1 -- 172.21.15.29:0/976434318 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158800b860 con 0x7f1594157870 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.060+0000 7f1592ffd700 1 -- 172.21.15.29:0/976434318 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800bc00 con 0x7f1594157870 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.061+0000 7f159a88f700 1 -- 172.21.15.29:0/976434318 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1594157870 msgr2=0x7f159415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.061+0000 7f159a88f700 1 --2- 172.21.15.29:0/976434318 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1594157870 0x7f159415b6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f15880099b0 tx=0x7f1588009250 comp rx=0 tx=0).stop 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.061+0000 7f159a88f700 1 -- 172.21.15.29:0/976434318 shutdown_connections 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.061+0000 7f159a88f700 1 --2- 172.21.15.29:0/976434318 >> v2:172.21.15.183:3300/0 conn(0x7f1594157c40 0x7f1594158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.061+0000 7f159a88f700 1 --2- 172.21.15.29:0/976434318 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1594157870 0x7f159415b6a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.061+0000 7f159a88f700 1 -- 172.21.15.29:0/976434318 >> 172.21.15.29:0/976434318 conn(0x7f1594068ce0 msgr2=0x7f15940690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.061+0000 7f159a88f700 1 -- 172.21.15.29:0/976434318 shutdown_connections 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.061+0000 7f159a88f700 1 -- 172.21.15.29:0/976434318 wait complete. 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.062+0000 7f159a88f700 1 Processor -- start 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.062+0000 7f159a88f700 1 -- start start 2023-10-08T15:42:12.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f159a88f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594157870 0x7f159414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f159a88f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1594157c40 0x7f15941492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f159a88f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f159415a620 0x7f1594148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f159a88f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594149d50 con 0x7f1594157c40 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f159a88f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159414a030 con 0x7f1594157870 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f159a88f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159414a310 con 0x7f159415a620 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f15937fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1594157c40 0x7f15941492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f15937fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1594157c40 0x7f15941492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38090/0 (socket says 172.21.15.29:38090) 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f15937fe700 1 -- 172.21.15.29:0/2026079728 learned_addr learned my addr 172.21.15.29:0/2026079728 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f1593fff700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594157870 0x7f159414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f1598e2c700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f159415a620 0x7f1594148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f15937fe700 1 -- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f159415a620 msgr2=0x7f1594148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f15937fe700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f159415a620 0x7f1594148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f15937fe700 1 -- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594157870 msgr2=0x7f159414f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f15937fe700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594157870 0x7f159414f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f15937fe700 1 -- 172.21.15.29:0/2026079728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c009a20 con 0x7f1594157c40 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.063+0000 7f1593fff700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594157870 0x7f159414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.064+0000 7f15937fe700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1594157c40 0x7f15941492d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f158400c560 tx=0x7f1584007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.064+0000 7f157bfff700 1 -- 172.21.15.29:0/2026079728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584005a70 con 0x7f1594157c40 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.064+0000 7f157bfff700 1 -- 172.21.15.29:0/2026079728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584005bd0 con 0x7f1594157c40 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.064+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15880094f0 con 0x7f1594157c40 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.064+0000 7f157bfff700 1 -- 172.21.15.29:0/2026079728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840070d0 con 0x7f1594157c40 2023-10-08T15:42:12.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.064+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159414a8d0 con 0x7f1594157c40 2023-10-08T15:42:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.065+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159414aaf0 con 0x7f1594157c40 2023-10-08T15:42:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.065+0000 7f157bfff700 1 -- 172.21.15.29:0/2026079728 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1584007440 con 0x7f1594157c40 2023-10-08T15:42:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.065+0000 7f157bfff700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.066+0000 7f157bfff700 1 -- 172.21.15.29:0/2026079728 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1584083860 con 0x7f1594157c40 2023-10-08T15:42:12.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.066+0000 7f1593fff700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.069 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.066+0000 7f1593fff700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1580066f30 0x7f15800693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f15880099b0 tx=0x7f1588017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:12.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.070+0000 7f157bfff700 1 -- 172.21.15.29:0/2026079728 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1584050b90 con 0x7f1594157c40 2023-10-08T15:42:12.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.262+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f159404c3c0 con 0x7f1594157c40 2023-10-08T15:42:12.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.263+0000 7f157bfff700 1 -- 172.21.15.29:0/2026079728 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+32260 (secure 0 0 0) 0x7f1584017020 con 0x7f1594157c40 2023-10-08T15:42:12.264 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:12.264 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:42:12.264 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 52, 2023-10-08T15:42:12.264 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2023-10-08T15:40:06.698823+0000", 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2023-10-08T15:42:09.535200+0000", 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2023-10-08T15:40:12.124600+0000", 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2023-10-08T15:40:09.117651+0000", 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2023-10-08T15:42:12.265 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.69999998807907104, 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 7, 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 8, 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2023-10-08T15:42:12.266 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "quincy", 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:40:12.381633+0000", 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:12.267 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2023-10-08T15:42:12.268 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "52", 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:12.269 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:12.270 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:12.271 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:12.272 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 6, 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2023-10-08T15:42:12.273 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:39.312324+0000", 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:12.275 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "52", 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:12.276 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:12.277 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:12.278 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2023-10-08T15:42:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 7, 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2023-10-08T15:41:40.225704+0000", 2023-10-08T15:42:12.280 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2023-10-08T15:42:12.281 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2023-10-08T15:42:12.282 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "52", 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2023-10-08T15:42:12.283 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T15:42:12.284 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T15:42:12.285 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2023-10-08T15:42:12.286 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.289 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6802", 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6803", 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.290 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6806", 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6807", 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.291 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6804", 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6805", 2023-10-08T15:42:12.292 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86356 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6801/86356", 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6803/86356", 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6807/86356", 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6805/86356", 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.293 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:12.294 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6808", 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6809", 2023-10-08T15:42:12.295 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6810", 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.296 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6811", 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6814", 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:12.297 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6815", 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.298 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6812", 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6813", 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86358 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6809/86358", 2023-10-08T15:42:12.299 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6811/86358", 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6815/86358", 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6813/86358", 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:12.300 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.301 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6816", 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6817", 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:12.302 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.303 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.303 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.303 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6818", 2023-10-08T15:42:12.303 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:12.303 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.303 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.303 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.303 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6819", 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6823", 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.304 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6825", 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.305 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6820", 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6821", 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86359 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6817/86359", 2023-10-08T15:42:12.306 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6819/86359", 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6825/86359", 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6821/86359", 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:42:12.307 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:12.308 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6822", 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6824", 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:12.309 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6826", 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.310 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6827", 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6830", 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.311 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6831", 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6828", 2023-10-08T15:42:12.312 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6829", 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86379 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.29:6824/86379", 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.29:6827/86379", 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.29:6831/86379", 2023-10-08T15:42:12.313 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.29:6829/86379", 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:12.314 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6819", 2023-10-08T15:42:12.315 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6821", 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.316 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6823", 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6826", 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.317 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6830", 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6831", 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.318 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6828", 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6829", 2023-10-08T15:42:12.319 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86587 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6821/86587", 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6826/86587", 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6831/86587", 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6829/86587", 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:12.320 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:12.321 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6816", 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:12.322 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6817", 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6818", 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6820", 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.324 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6825", 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.325 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6827", 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6822", 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:12.326 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6824", 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86596 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6817/86596", 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6820/86596", 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6827/86596", 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6824/86596", 2023-10-08T15:42:12.327 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:12.328 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6800", 2023-10-08T15:42:12.329 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6801", 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:12.330 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6802", 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6803", 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.331 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6806", 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6807", 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:12.332 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6804", 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.333 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6805", 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86585 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6801/86585", 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6803/86585", 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6807/86585", 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6805/86585", 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:12.334 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2023-10-08T15:42:12.335 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 13, 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 43, 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6808", 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.336 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6809", 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6810", 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.337 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6811", 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6814", 2023-10-08T15:42:12.338 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6815", 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.339 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6812", 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.183:6813", 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 86586 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.183:6809/86586", 2023-10-08T15:42:12.340 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.183:6811/86586", 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.183:6815/86586", 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.183:6813/86586", 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:12.341 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.252513+0000", 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:12.342 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.293514+0000", 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:12.343 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.271170+0000", 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 3, 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:12.344 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.272577+0000", 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 4, 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.317440+0000", 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.345 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 5, 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.309422+0000", 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.346 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 6, 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.276770+0000", 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 7, 2023-10-08T15:42:12.347 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138320759226367, 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2023-10-08T15:40:10.222500+0000", 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2023-10-08T15:42:12.348 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.349 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2023-10-08T15:42:12.350 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2023-10-08T15:42:12.351 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:12.351 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:42:12.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1580066f30 msgr2=0x7f15800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1580066f30 0x7f15800693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f15880099b0 tx=0x7f1588017000 comp rx=0 tx=0).stop 2023-10-08T15:42:12.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1594157c40 msgr2=0x7f15941492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1594157c40 0x7f15941492d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f158400c560 tx=0x7f1584007f70 comp rx=0 tx=0).stop 2023-10-08T15:42:12.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 shutdown_connections 2023-10-08T15:42:12.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f159415a620 0x7f1594148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1594157870 0x7f159414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 --2- 172.21.15.29:0/2026079728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1594157c40 0x7f15941492d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.265+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 >> 172.21.15.29:0/2026079728 conn(0x7f1594068ce0 msgr2=0x7f15940b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:12.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.266+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 shutdown_connections 2023-10-08T15:42:12.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.266+0000 7f159a88f700 1 -- 172.21.15.29:0/2026079728 wait complete. 2023-10-08T15:42:12.354 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:12.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.473+0000 7f19e69f7700 1 Processor -- start 2023-10-08T15:42:12.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.473+0000 7f19e69f7700 1 -- start start 2023-10-08T15:42:12.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19e69f7700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19e00c75c0 0x7f19e00c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19e69f7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00c9cb0 con 0x7f19e00abeb0 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19e69f7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00c90a0 con 0x7f19e00abae0 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19e69f7700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e00c9380 con 0x7f19e00c75c0 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19df7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19e00c75c0 0x7f19e00c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19e4f94700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f19e00abeb0 0x7f19e00acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54966/0 (socket says 172.21.15.29:54966) 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19e4f94700 1 -- 172.21.15.29:0/3102566381 learned_addr learned my addr 172.21.15.29:0/3102566381 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19df7fe700 1 -- 172.21.15.29:0/3102566381 >> v1:172.21.15.183:6789/0 conn(0x7f19e00abae0 legacy=0x7f19e00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19df7fe700 1 -- 172.21.15.29:0/3102566381 >> v1:172.21.15.29:6789/0 conn(0x7f19e00abeb0 legacy=0x7f19e00acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19df7fe700 1 -- 172.21.15.29:0/3102566381 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00c9660 con 0x7f19e00c75c0 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19deffd700 1 -- 172.21.15.29:0/3102566381 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054749206 0 0) 0x7f19e00c9cb0 con 0x7f19e00abeb0 2023-10-08T15:42:12.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19df7fe700 1 --2- 172.21.15.29:0/3102566381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00c75c0 0x7f19e00c8400 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f19d40098e0 tx=0x7f19d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce05072ea02442c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19deffd700 1 -- 172.21.15.29:0/3102566381 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4009e80 con 0x7f19e00c75c0 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19deffd700 1 -- 172.21.15.29:0/3102566381 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400b860 con 0x7f19e00c75c0 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.474+0000 7f19deffd700 1 -- 172.21.15.29:0/3102566381 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400bbe0 con 0x7f19e00c75c0 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.475+0000 7f19e69f7700 1 -- 172.21.15.29:0/3102566381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00c75c0 msgr2=0x7f19e00c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.475+0000 7f19e69f7700 1 --2- 172.21.15.29:0/3102566381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00c75c0 0x7f19e00c8400 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f19d40098e0 tx=0x7f19d40091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.475+0000 7f19e69f7700 1 -- 172.21.15.29:0/3102566381 shutdown_connections 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.475+0000 7f19e69f7700 1 --2- 172.21.15.29:0/3102566381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00c75c0 0x7f19e00c8400 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.475+0000 7f19e69f7700 1 -- 172.21.15.29:0/3102566381 >> 172.21.15.29:0/3102566381 conn(0x7f19e0067660 msgr2=0x7f19e0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:12.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.475+0000 7f19e69f7700 1 -- 172.21.15.29:0/3102566381 shutdown_connections 2023-10-08T15:42:12.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.475+0000 7f19e69f7700 1 -- 172.21.15.29:0/3102566381 wait complete. 2023-10-08T15:42:12.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.476+0000 7f19e69f7700 1 Processor -- start 2023-10-08T15:42:12.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.476+0000 7f19e69f7700 1 -- start start 2023-10-08T15:42:12.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19e69f7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00abae0 0x7f19e0157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19e69f7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19e00abeb0 0x7f19e00cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19e69f7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19e00c75c0 0x7f19e015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19e69f7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e016d8c0 con 0x7f19e00abae0 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19e69f7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00aac60 con 0x7f19e00c75c0 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19e69f7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00aaf40 con 0x7f19e00abeb0 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19dffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00abae0 0x7f19e0157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19dffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00abae0 0x7f19e0157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38096/0 (socket says 172.21.15.29:38096) 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19dffff700 1 -- 172.21.15.29:0/2932537722 learned_addr learned my addr 172.21.15.29:0/2932537722 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19df7fe700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19e00abeb0 0x7f19e00cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19e4f94700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19e00c75c0 0x7f19e015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19dffff700 1 -- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19e00abeb0 msgr2=0x7f19e00cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19dffff700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19e00abeb0 0x7f19e00cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19dffff700 1 -- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19e00c75c0 msgr2=0x7f19e015c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19dffff700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19e00c75c0 0x7f19e015c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19dffff700 1 -- 172.21.15.29:0/2932537722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4009420 con 0x7f19e00abae0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.477+0000 7f19df7fe700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19e00abeb0 0x7f19e00cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.478+0000 7f19dffff700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00abae0 0x7f19e0157a00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c4e0 tx=0x7f19d000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.478+0000 7f19c7fff700 1 -- 172.21.15.29:0/2932537722 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0011590 con 0x7f19e00abae0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.478+0000 7f19c7fff700 1 -- 172.21.15.29:0/2932537722 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0011710 con 0x7f19e00abae0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.478+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e00ab220 con 0x7f19e00abae0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.478+0000 7f19c7fff700 1 -- 172.21.15.29:0/2932537722 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0011ad0 con 0x7f19e00abae0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.478+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e0157f40 con 0x7f19e00abae0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.479+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e004c3c0 con 0x7f19e00abae0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.479+0000 7f19c7fff700 1 -- 172.21.15.29:0/2932537722 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19d001b3b0 con 0x7f19e00abae0 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.479+0000 7f19c7fff700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:12.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.480+0000 7f19c7fff700 1 -- 172.21.15.29:0/2932537722 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19d0083b00 con 0x7f19e00abae0 2023-10-08T15:42:12.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.480+0000 7f19df7fe700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:12.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.480+0000 7f19df7fe700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f19cc066f30 0x7f19cc0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19e00c79c0 tx=0x7f19d4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:12.484 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.484+0000 7f19c7fff700 1 -- 172.21.15.29:0/2932537722 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19d0050d70 con 0x7f19e00abae0 2023-10-08T15:42:12.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.725+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19e006aeb0 con 0x7f19e00abae0 2023-10-08T15:42:12.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.726+0000 7f19c7fff700 1 -- 172.21.15.29:0/2932537722 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f19d0017070 con 0x7f19e00abae0 2023-10-08T15:42:12.727 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:12.727 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:42:12.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f19cc066f30 msgr2=0x7f19cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f19cc066f30 0x7f19cc0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19e00c79c0 tx=0x7f19d4017000 comp rx=0 tx=0).stop 2023-10-08T15:42:12.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00abae0 msgr2=0x7f19e0157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:12.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00abae0 0x7f19e0157a00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c4e0 tx=0x7f19d000c8a0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 shutdown_connections 2023-10-08T15:42:12.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19e00c75c0 0x7f19e015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19e00abae0 0x7f19e0157a00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 --2- 172.21.15.29:0/2932537722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19e00abeb0 0x7f19e00cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:12.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 >> 172.21.15.29:0/2932537722 conn(0x7f19e0067660 msgr2=0x7f19e0159850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:12.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 shutdown_connections 2023-10-08T15:42:12.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:12.728+0000 7f19e69f7700 1 -- 172.21.15.29:0/2932537722 wait complete. 2023-10-08T15:42:12.730 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:42:12.741 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-08T15:42:12.880 INFO:teuthology.orchestra.run.smithi029.stdout:{"cluster_fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","whoami":0,"id":5310,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.020988932000002,"mdsmap_epoch":25,"osdmap_epoch":53,"osdmap_epoch_barrier":49,"uptime":36.957480259999997} 2023-10-08T15:42:12.924 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "aa16b01f-3858-4fc7-9751-d7cb76fff138", "fs_name": "cephfs", "id": 5310, "mdsmap_epoch": 25, "osdmap_epoch": 53, "osdmap_epoch_barrier": 49, "rank_uptime": 31.020988932, "state": "up:active", "uptime": 36.95748026, "want_state": "up:active", "whoami": 0 } 2023-10-08T15:42:12.924 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-08T15:42:12.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:42:12.925 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-08T15:42:13.214 INFO:teuthology.orchestra.run.smithi029.stderr:50+0 records in 2023-10-08T15:42:13.214 INFO:teuthology.orchestra.run.smithi029.stderr:50+0 records out 2023-10-08T15:42:13.214 INFO:teuthology.orchestra.run.smithi029.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.272842 s, 192 MB/s 2023-10-08T15:42:13.217 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:42:13.217 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:13.260 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:13.305 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:42:13.305 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T15:42:13.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:42:13.305 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T15:42:13.381 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:42:13.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:42:13.381 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T15:42:13.397 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T15:42:13.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T15:42:13.397 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T15:42:13.436 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-10-08T15:42:13.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T15:42:13.437 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T15:42:13.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.614+0000 7f31da6ae700 1 Processor -- start 2023-10-08T15:42:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.614+0000 7f31da6ae700 1 -- start start 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.614+0000 7f31da6ae700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31d40b1220 0x7f31d40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.614+0000 7f31da6ae700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40cb4f0 0x7f31d40cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.614+0000 7f31da6ae700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d415de60 con 0x7f31d40b0e50 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.614+0000 7f31da6ae700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40cbed0 con 0x7f31d40b1220 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.614+0000 7f31da6ae700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d415e140 con 0x7f31d40cb4f0 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d3fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f31d40b0e50 0x7f31d406d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54978/0 (socket says 172.21.15.29:54978) 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d3fff700 1 -- 172.21.15.29:0/2079296829 learned_addr learned my addr 172.21.15.29:0/2079296829 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d37fe700 1 --2- 172.21.15.29:0/2079296829 >> v2:172.21.15.29:3300/0 conn(0x7f31d40b1220 0x7f31d40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d8c4b700 1 --2- 172.21.15.29:0/2079296829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40cb4f0 0x7f31d40cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:13.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d2ffd700 1 -- 172.21.15.29:0/2079296829 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007484972 0 0) 0x7f31d415de60 con 0x7f31d40b0e50 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d2ffd700 1 -- 172.21.15.29:0/2079296829 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c0003570 con 0x7f31d40b0e50 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d37fe700 1 -- 172.21.15.29:0/2079296829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40cb4f0 msgr2=0x7f31d40cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d37fe700 1 --2- 172.21.15.29:0/2079296829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40cb4f0 0x7f31d40cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d37fe700 1 -- 172.21.15.29:0/2079296829 >> v1:172.21.15.29:6789/0 conn(0x7f31d40b0e50 legacy=0x7f31d406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d37fe700 1 -- 172.21.15.29:0/2079296829 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d415e420 con 0x7f31d40b1220 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d37fe700 1 --2- 172.21.15.29:0/2079296829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d40c9180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0098e0 tx=0x7f31bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fea1c086609e6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d2ffd700 1 -- 172.21.15.29:0/2079296829 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc011630 con 0x7f31d40b1220 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d2ffd700 1 -- 172.21.15.29:0/2079296829 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc011790 con 0x7f31d40b1220 2023-10-08T15:42:13.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.615+0000 7f31d2ffd700 1 -- 172.21.15.29:0/2079296829 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc011b30 con 0x7f31d40b1220 2023-10-08T15:42:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.616+0000 7f31da6ae700 1 -- 172.21.15.29:0/2079296829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 msgr2=0x7f31d40c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.616+0000 7f31da6ae700 1 --2- 172.21.15.29:0/2079296829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d40c9180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0098e0 tx=0x7f31bc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.616+0000 7f31da6ae700 1 -- 172.21.15.29:0/2079296829 shutdown_connections 2023-10-08T15:42:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.616+0000 7f31da6ae700 1 --2- 172.21.15.29:0/2079296829 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40cb4f0 0x7f31d40cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.616+0000 7f31da6ae700 1 --2- 172.21.15.29:0/2079296829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d40c9180 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.616+0000 7f31da6ae700 1 -- 172.21.15.29:0/2079296829 >> 172.21.15.29:0/2079296829 conn(0x7f31d4069870 msgr2=0x7f31d4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.616+0000 7f31da6ae700 1 -- 172.21.15.29:0/2079296829 shutdown_connections 2023-10-08T15:42:13.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.616+0000 7f31da6ae700 1 -- 172.21.15.29:0/2079296829 wait complete. 2023-10-08T15:42:13.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.617+0000 7f31da6ae700 1 Processor -- start 2023-10-08T15:42:13.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.617+0000 7f31da6ae700 1 -- start start 2023-10-08T15:42:13.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31da6ae700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40b0e50 0x7f31d4159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:13.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31da6ae700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d4146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:13.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31da6ae700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31d40cb4f0 0x7f31d4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:13.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31da6ae700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41590f0 con 0x7f31d40b1220 2023-10-08T15:42:13.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31da6ae700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4159ac0 con 0x7f31d40cb4f0 2023-10-08T15:42:13.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31da6ae700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41584e0 con 0x7f31d40b0e50 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d4146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d4146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38112/0 (socket says 172.21.15.29:38112) 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 -- 172.21.15.29:0/271481996 learned_addr learned my addr 172.21.15.29:0/271481996 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d3fff700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40b0e50 0x7f31d4159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d8c4b700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31d40cb4f0 0x7f31d4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 -- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40b0e50 msgr2=0x7f31d4159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40b0e50 0x7f31d4159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 -- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31d40cb4f0 msgr2=0x7f31d4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31d40cb4f0 0x7f31d4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 -- 172.21.15.29:0/271481996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc009420 con 0x7f31d40b1220 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d8c4b700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31d40cb4f0 0x7f31d4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:13.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.618+0000 7f31d37fe700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d4146550 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f31d40c59e0 tx=0x7f31bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.619+0000 7f31cbfff700 1 -- 172.21.15.29:0/271481996 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc000d10 con 0x7f31d40b1220 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.619+0000 7f31cbfff700 1 -- 172.21.15.29:0/271481996 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc011b10 con 0x7f31d40b1220 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.619+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d41587c0 con 0x7f31d40b1220 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.619+0000 7f31cbfff700 1 -- 172.21.15.29:0/271481996 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc025620 con 0x7f31d40b1220 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.619+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d4158d80 con 0x7f31d40b1220 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.620+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d404c3c0 con 0x7f31d40b1220 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.620+0000 7f31cbfff700 1 -- 172.21.15.29:0/271481996 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31bc025a50 con 0x7f31d40b1220 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.621+0000 7f31cbfff700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f31b4066f30 0x7f31b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.621+0000 7f31cbfff700 1 -- 172.21.15.29:0/271481996 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f31bc085ca0 con 0x7f31d40b1220 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.621+0000 7f31d3fff700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f31b4066f30 0x7f31b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:13.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.621+0000 7f31d3fff700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f31b4066f30 0x7f31b40693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f31c4007fd0 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:13.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.625+0000 7f31cbfff700 1 -- 172.21.15.29:0/271481996 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31bc052ed0 con 0x7f31d40b1220 2023-10-08T15:42:13.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.862+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31d406da30 con 0x7f31d40b1220 2023-10-08T15:42:13.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.863+0000 7f31cbfff700 1 -- 172.21.15.29:0/271481996 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f31bc015090 con 0x7f31d40b1220 2023-10-08T15:42:13.864 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:13.864 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:42:13.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f31b4066f30 msgr2=0x7f31b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:13.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f31b4066f30 0x7f31b40693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f31c4007fd0 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2023-10-08T15:42:13.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 msgr2=0x7f31d4146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:13.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d4146550 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f31d40c59e0 tx=0x7f31bc017000 comp rx=0 tx=0).stop 2023-10-08T15:42:13.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 shutdown_connections 2023-10-08T15:42:13.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f31b4066f30 0x7f31b40693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31d40cb4f0 0x7f31d4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31d40b0e50 0x7f31d4159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 --2- 172.21.15.29:0/271481996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31d40b1220 0x7f31d4146550 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:13.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 >> 172.21.15.29:0/271481996 conn(0x7f31d4069870 msgr2=0x7f31d4069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:13.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 shutdown_connections 2023-10-08T15:42:13.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.865+0000 7f31da6ae700 1 -- 172.21.15.29:0/271481996 wait complete. 2023-10-08T15:42:13.867 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:42:13.878 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.996+0000 7f648e956700 1 Processor -- start 2023-10-08T15:42:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.997+0000 7f648e956700 1 -- start start 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.997+0000 7f648e956700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f64880b1220 0x7f64880c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.997+0000 7f648e956700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64880cb4f0 0x7f64880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.997+0000 7f648e956700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648815de60 con 0x7f64880b0e50 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.997+0000 7f648e956700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64880cbeb0 con 0x7f64880cb4f0 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.997+0000 7f648e956700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648815e140 con 0x7f64880b1220 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.997+0000 7f648cef3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64880cb4f0 0x7f64880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f6487fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f64880b0e50 0x7f648806d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54980/0 (socket says 172.21.15.29:54980) 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f648cef3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f64880cb4f0 0x7f64880cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38126/0 (socket says 172.21.15.29:38126) 2023-10-08T15:42:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f6487fff700 1 -- 172.21.15.29:0/1264153375 learned_addr learned my addr 172.21.15.29:0/1264153375 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f64877fe700 1 --2- 172.21.15.29:0/1264153375 >> v2:172.21.15.183:3300/0 conn(0x7f64880b1220 0x7f64880c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f648cef3700 1 -- 172.21.15.29:0/1264153375 >> v2:172.21.15.183:3300/0 conn(0x7f64880b1220 msgr2=0x7f64880c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f648cef3700 1 --2- 172.21.15.29:0/1264153375 >> v2:172.21.15.183:3300/0 conn(0x7f64880b1220 0x7f64880c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f648cef3700 1 -- 172.21.15.29:0/1264153375 >> v1:172.21.15.29:6789/0 conn(0x7f64880b0e50 legacy=0x7f648806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f648cef3700 1 -- 172.21.15.29:0/1264153375 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648815e420 con 0x7f64880cb4f0 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f6486ffd700 1 -- 172.21.15.29:0/1264153375 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114639891 0 0) 0x7f648815de60 con 0x7f64880b0e50 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f648cef3700 1 --2- 172.21.15.29:0/1264153375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880cb4f0 0x7f64880cb970 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f648806cd30 tx=0x7f6480009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3538e681812a43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f6486ffd700 1 -- 172.21.15.29:0/1264153375 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000e070 con 0x7f64880cb4f0 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f6486ffd700 1 -- 172.21.15.29:0/1264153375 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648000bc30 con 0x7f64880cb4f0 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.998+0000 7f6486ffd700 1 -- 172.21.15.29:0/1264153375 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480012430 con 0x7f64880cb4f0 2023-10-08T15:42:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.999+0000 7f648e956700 1 -- 172.21.15.29:0/1264153375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880cb4f0 msgr2=0x7f64880cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.999+0000 7f648e956700 1 --2- 172.21.15.29:0/1264153375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880cb4f0 0x7f64880cb970 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f648806cd30 tx=0x7f6480009780 comp rx=0 tx=0).stop 2023-10-08T15:42:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.999+0000 7f648e956700 1 -- 172.21.15.29:0/1264153375 shutdown_connections 2023-10-08T15:42:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.999+0000 7f648e956700 1 --2- 172.21.15.29:0/1264153375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880cb4f0 0x7f64880cb970 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.999+0000 7f648e956700 1 --2- 172.21.15.29:0/1264153375 >> v2:172.21.15.183:3300/0 conn(0x7f64880b1220 0x7f64880c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.999+0000 7f648e956700 1 -- 172.21.15.29:0/1264153375 >> 172.21.15.29:0/1264153375 conn(0x7f6488069870 msgr2=0x7f6488069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.999+0000 7f648e956700 1 -- 172.21.15.29:0/1264153375 shutdown_connections 2023-10-08T15:42:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:13.999+0000 7f648e956700 1 -- 172.21.15.29:0/1264153375 wait complete. 2023-10-08T15:42:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.000+0000 7f648e956700 1 Processor -- start 2023-10-08T15:42:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.000+0000 7f648e956700 1 -- start start 2023-10-08T15:42:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f648e956700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64880b0e50 0x7f64880b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f648e956700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880b1220 0x7f64880c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f648e956700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64880cb4f0 0x7f64881584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f648e956700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880b4420 con 0x7f64880b1220 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f648e956700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880b46c0 con 0x7f64880b0e50 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f648e956700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64880c5f00 con 0x7f64880cb4f0 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880b1220 0x7f64880c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880b1220 0x7f64880c4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38138/0 (socket says 172.21.15.29:38138) 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 -- 172.21.15.29:0/1904246412 learned_addr learned my addr 172.21.15.29:0/1904246412 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f6487fff700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64880b0e50 0x7f64880b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f648cef3700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64880cb4f0 0x7f64881584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 -- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64880cb4f0 msgr2=0x7f64881584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64880cb4f0 0x7f64881584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 -- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64880b0e50 msgr2=0x7f64880b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64880b0e50 0x7f64880b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 -- 172.21.15.29:0/1904246412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480009a20 con 0x7f64880b1220 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.001+0000 7f64877fe700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880b1220 0x7f64880c4080 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d860 tx=0x7f647c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.002+0000 7f646ffff700 1 -- 172.21.15.29:0/1904246412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c0125f0 con 0x7f64880b1220 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.002+0000 7f646ffff700 1 -- 172.21.15.29:0/1904246412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c012750 con 0x7f64880b1220 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.002+0000 7f646ffff700 1 -- 172.21.15.29:0/1904246412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c012af0 con 0x7f64880b1220 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.002+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64880c61e0 con 0x7f64880b1220 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.002+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64880c45c0 con 0x7f64880b1220 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.003+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64880c47e0 con 0x7f64880b1220 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.003+0000 7f646ffff700 1 -- 172.21.15.29:0/1904246412 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f647c013480 con 0x7f64880b1220 2023-10-08T15:42:14.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.003+0000 7f646ffff700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6474066f30 0x7f64740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.003+0000 7f646ffff700 1 -- 172.21.15.29:0/1904246412 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f647c0848f0 con 0x7f64880b1220 2023-10-08T15:42:14.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.004+0000 7f6487fff700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6474066f30 0x7f64740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.004+0000 7f6487fff700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6474066f30 0x7f64740693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.008 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.008+0000 7f646ffff700 1 -- 172.21.15.29:0/1904246412 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f647c0555b0 con 0x7f64880b1220 2023-10-08T15:42:14.203 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.202+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64880c6680 con 0x7f64880b1220 2023-10-08T15:42:14.204 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.203+0000 7f646ffff700 1 -- 172.21.15.29:0/1904246412 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+15445 (secure 0 0 0) 0x7f647c055140 con 0x7f64880b1220 2023-10-08T15:42:14.204 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:14.204 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":54,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:42:13.551694+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:39.312324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:40.225704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.35","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:14.206 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6474066f30 msgr2=0x7f64740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6474066f30 0x7f64740693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478007d30 comp rx=0 tx=0).stop 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880b1220 msgr2=0x7f64880c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880b1220 0x7f64880c4080 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d860 tx=0x7f647c008040 comp rx=0 tx=0).stop 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 shutdown_connections 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f6474066f30 0x7f64740693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64880cb4f0 0x7f64881584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64880b0e50 0x7f64880b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 --2- 172.21.15.29:0/1904246412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64880b1220 0x7f64880c4080 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 >> 172.21.15.29:0/1904246412 conn(0x7f6488069870 msgr2=0x7f648806cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 shutdown_connections 2023-10-08T15:42:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.206+0000 7f648e956700 1 -- 172.21.15.29:0/1904246412 wait complete. 2023-10-08T15:42:14.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T15:41:39.312324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T15:41:40.225704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T15:42:14.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:42:14.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.339+0000 7f8b973ab700 1 Processor -- start 2023-10-08T15:42:14.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.339+0000 7f8b973ab700 1 -- start start 2023-10-08T15:42:14.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b973ab700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b9015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b973ab700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9015ea90 con 0x7f8b9015a230 2023-10-08T15:42:14.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b973ab700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b900b3100 con 0x7f8b900697c0 2023-10-08T15:42:14.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b973ab700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900d1cf0 con 0x7f8b90159e60 2023-10-08T15:42:14.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b94946700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f8b9015a230 0x7f8b900690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54984/0 (socket says 172.21.15.29:54984) 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b94946700 1 -- 172.21.15.29:0/1541471388 learned_addr learned my addr 172.21.15.29:0/1541471388 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b95147700 1 --2- 172.21.15.29:0/1541471388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b9015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b8ffff700 1 -- 172.21.15.29:0/1541471388 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781345483 0 0) 0x7f8b9015ea90 con 0x7f8b9015a230 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.340+0000 7f8b8ffff700 1 -- 172.21.15.29:0/1541471388 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b78003570 con 0x7f8b9015a230 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b8ffff700 1 -- 172.21.15.29:0/1541471388 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567723125 0 0) 0x7f8b900b3100 con 0x7f8b900697c0 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b8ffff700 1 -- 172.21.15.29:0/1541471388 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b9015ea90 con 0x7f8b900697c0 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b95147700 1 -- 172.21.15.29:0/1541471388 >> v1:172.21.15.183:6789/0 conn(0x7f8b900697c0 legacy=0x7f8b900af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b8ffff700 1 -- 172.21.15.29:0/1541471388 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2459247170 0 0) 0x7f8b78003570 con 0x7f8b9015a230 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b95147700 1 -- 172.21.15.29:0/1541471388 >> v1:172.21.15.29:6789/0 conn(0x7f8b9015a230 legacy=0x7f8b900690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b95147700 1 -- 172.21.15.29:0/1541471388 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b900d10e0 con 0x7f8b90159e60 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b95147700 1 --2- 172.21.15.29:0/1541471388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b9015e550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009910 tx=0x7f8b880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c18f51e8ca5afdbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b8ffff700 1 -- 172.21.15.29:0/1541471388 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84001470 con 0x7f8b90159e60 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b8ffff700 1 -- 172.21.15.29:0/1541471388 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88011420 con 0x7f8b90159e60 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.341+0000 7f8b8ffff700 1 -- 172.21.15.29:0/1541471388 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b880117c0 con 0x7f8b90159e60 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.342+0000 7f8b973ab700 1 -- 172.21.15.29:0/1541471388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 msgr2=0x7f8b9015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.342+0000 7f8b973ab700 1 --2- 172.21.15.29:0/1541471388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b9015e550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009910 tx=0x7f8b880091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.342+0000 7f8b973ab700 1 -- 172.21.15.29:0/1541471388 shutdown_connections 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.342+0000 7f8b973ab700 1 --2- 172.21.15.29:0/1541471388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b9015e550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.342+0000 7f8b973ab700 1 -- 172.21.15.29:0/1541471388 >> 172.21.15.29:0/1541471388 conn(0x7f8b90070700 msgr2=0x7f8b90070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.342+0000 7f8b973ab700 1 -- 172.21.15.29:0/1541471388 shutdown_connections 2023-10-08T15:42:14.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.342+0000 7f8b973ab700 1 -- 172.21.15.29:0/1541471388 wait complete. 2023-10-08T15:42:14.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.343+0000 7f8b973ab700 1 Processor -- start 2023-10-08T15:42:14.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.343+0000 7f8b973ab700 1 -- start start 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b973ab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b900697c0 0x7f8b9014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b973ab700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b900c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b973ab700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9015a230 0x7f8b900b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b973ab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900cb300 con 0x7f8b900697c0 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b973ab700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900ca260 con 0x7f8b9015a230 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b973ab700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900ca540 con 0x7f8b90159e60 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b900697c0 0x7f8b9014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b900697c0 0x7f8b9014a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38142/0 (socket says 172.21.15.29:38142) 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 -- 172.21.15.29:0/13182266 learned_addr learned my addr 172.21.15.29:0/13182266 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b94946700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b900c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95948700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9015a230 0x7f8b900b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 -- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 msgr2=0x7f8b900c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b900c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 -- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9015a230 msgr2=0x7f8b900b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9015a230 0x7f8b900b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 -- 172.21.15.29:0/13182266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88009420 con 0x7f8b900697c0 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b95147700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b900697c0 0x7f8b9014a090 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8b880091e0 tx=0x7f8b88016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b8d7fa700 1 -- 172.21.15.29:0/13182266 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8801cb30 con 0x7f8b900697c0 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b8d7fa700 1 -- 172.21.15.29:0/13182266 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8801cc90 con 0x7f8b900697c0 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b900ca820 con 0x7f8b900697c0 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b8d7fa700 1 -- 172.21.15.29:0/13182266 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8801a6a0 con 0x7f8b900697c0 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.344+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b900cade0 con 0x7f8b900697c0 2023-10-08T15:42:14.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.345+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9004c3c0 con 0x7f8b900697c0 2023-10-08T15:42:14.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.346+0000 7f8b8d7fa700 1 -- 172.21.15.29:0/13182266 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b8801aa90 con 0x7f8b900697c0 2023-10-08T15:42:14.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.346+0000 7f8b8d7fa700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b7c066f30 0x7f8b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.346+0000 7f8b8d7fa700 1 -- 172.21.15.29:0/13182266 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8b88086390 con 0x7f8b900697c0 2023-10-08T15:42:14.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.346+0000 7f8b94946700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b7c066f30 0x7f8b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.347+0000 7f8b94946700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b7c066f30 0x7f8b7c0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b90158df0 tx=0x7f8b84000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.350+0000 7f8b8d7fa700 1 -- 172.21.15.29:0/13182266 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b880535c0 con 0x7f8b900697c0 2023-10-08T15:42:14.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.539+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b900cb590 con 0x7f8b900697c0 2023-10-08T15:42:14.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.539+0000 7f8b8d7fa700 1 -- 172.21.15.29:0/13182266 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b88056be0 con 0x7f8b900697c0 2023-10-08T15:42:14.540 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:42:14.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.541+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b7c066f30 msgr2=0x7f8b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.541+0000 7f8b973ab700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b7c066f30 0x7f8b7c0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b90158df0 tx=0x7f8b84000bc0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.541+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b900697c0 msgr2=0x7f8b9014a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.541+0000 7f8b973ab700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b900697c0 0x7f8b9014a090 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8b880091e0 tx=0x7f8b88016000 comp rx=0 tx=0).stop 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.542+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 shutdown_connections 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.542+0000 7f8b973ab700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f8b7c066f30 0x7f8b7c0693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.542+0000 7f8b973ab700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b9015a230 0x7f8b900b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.542+0000 7f8b973ab700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b900697c0 0x7f8b9014a090 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.542+0000 7f8b973ab700 1 --2- 172.21.15.29:0/13182266 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b90159e60 0x7f8b900c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.542+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 >> 172.21.15.29:0/13182266 conn(0x7f8b90070700 msgr2=0x7f8b900ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.542+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 shutdown_connections 2023-10-08T15:42:14.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.542+0000 7f8b973ab700 1 -- 172.21.15.29:0/13182266 wait complete. 2023-10-08T15:42:14.554 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T15:42:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.675+0000 7f99b8ef3700 1 Processor -- start 2023-10-08T15:42:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.675+0000 7f99b8ef3700 1 -- start start 2023-10-08T15:42:14.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b8ef3700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99b40b6580 0x7f99b406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b8ef3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b40b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b8ef3700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b406ac90 con 0x7f99b40cce30 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b8ef3700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40b4d70 con 0x7f99b40b6580 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b8ef3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b415b3b0 con 0x7f99b406a830 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b2ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99b40b6580 0x7f99b406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b37fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f99b40cce30 0x7f99b415aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54990/0 (socket says 172.21.15.29:54990) 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b2ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99b40b6580 0x7f99b406a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38154/0 (socket says 172.21.15.29:38154) 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.676+0000 7f99b37fe700 1 -- 172.21.15.29:0/4078355153 learned_addr learned my addr 172.21.15.29:0/4078355153 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b3fff700 1 --2- 172.21.15.29:0/4078355153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b40b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b2ffd700 1 -- 172.21.15.29:0/4078355153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 msgr2=0x7f99b40b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b2ffd700 1 --2- 172.21.15.29:0/4078355153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b40b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b2ffd700 1 -- 172.21.15.29:0/4078355153 >> v1:172.21.15.29:6789/0 conn(0x7f99b40cce30 legacy=0x7f99b415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b2ffd700 1 -- 172.21.15.29:0/4078355153 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40cd8d0 con 0x7f99b40b6580 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b27fc700 1 -- 172.21.15.29:0/4078355153 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616267044 0 0) 0x7f99a4001110 con 0x7f99b40cce30 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b3fff700 1 --2- 172.21.15.29:0/4078355153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b40b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b2ffd700 1 --2- 172.21.15.29:0/4078355153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40b6580 0x7f99b406a2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99a80098e0 tx=0x7f99a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f49505b8f50b057 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b27fc700 1 -- 172.21.15.29:0/4078355153 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8009e80 con 0x7f99b40b6580 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b27fc700 1 -- 172.21.15.29:0/4078355153 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800b860 con 0x7f99b40b6580 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b27fc700 1 -- 172.21.15.29:0/4078355153 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800bbe0 con 0x7f99b40b6580 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b8ef3700 1 -- 172.21.15.29:0/4078355153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40b6580 msgr2=0x7f99b406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/4078355153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40b6580 0x7f99b406a2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99a80098e0 tx=0x7f99a80091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b8ef3700 1 -- 172.21.15.29:0/4078355153 shutdown_connections 2023-10-08T15:42:14.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.677+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/4078355153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b40b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.678+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/4078355153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40b6580 0x7f99b406a2f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.678+0000 7f99b8ef3700 1 -- 172.21.15.29:0/4078355153 >> 172.21.15.29:0/4078355153 conn(0x7f99b4068cb0 msgr2=0x7f99b40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:14.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.678+0000 7f99b8ef3700 1 -- 172.21.15.29:0/4078355153 shutdown_connections 2023-10-08T15:42:14.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.678+0000 7f99b8ef3700 1 -- 172.21.15.29:0/4078355153 wait complete. 2023-10-08T15:42:14.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.679+0000 7f99b8ef3700 1 Processor -- start 2023-10-08T15:42:14.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.679+0000 7f99b8ef3700 1 -- start start 2023-10-08T15:42:14.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.679+0000 7f99b8ef3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b4157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.679+0000 7f99b8ef3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b40b6580 0x7f99b414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.679+0000 7f99b8ef3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40cce30 0x7f99b415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.679+0000 7f99b8ef3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4156f00 con 0x7f99b40cce30 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.679+0000 7f99b8ef3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b41562f0 con 0x7f99b40b6580 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.679+0000 7f99b8ef3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b41565d0 con 0x7f99b406a830 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40cce30 0x7f99b415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40cce30 0x7f99b415e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38162/0 (socket says 172.21.15.29:38162) 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 -- 172.21.15.29:0/303918481 learned_addr learned my addr 172.21.15.29:0/303918481 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b37fe700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b4157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b2ffd700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b40b6580 0x7f99b414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 -- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 msgr2=0x7f99b4157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b4157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 -- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b40b6580 msgr2=0x7f99b414e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b40b6580 0x7f99b414e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 -- 172.21.15.29:0/303918481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8009420 con 0x7f99b40cce30 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b3fff700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40cce30 0x7f99b415e7e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00a380 tx=0x7f99ac007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f999b7fe700 1 -- 172.21.15.29:0/303918481 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac015440 con 0x7f99b40cce30 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f999b7fe700 1 -- 172.21.15.29:0/303918481 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0155a0 con 0x7f99b40cce30 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b41568b0 con 0x7f99b40cce30 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f999b7fe700 1 -- 172.21.15.29:0/303918481 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac015960 con 0x7f99b40cce30 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.680+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b414e8b0 con 0x7f99b40cce30 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.681+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b4157070 con 0x7f99b40cce30 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.682+0000 7f999b7fe700 1 -- 172.21.15.29:0/303918481 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99ac00d440 con 0x7f99b40cce30 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.682+0000 7f999b7fe700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a0066f30 0x7f99a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:14.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.682+0000 7f999b7fe700 1 -- 172.21.15.29:0/303918481 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f99ac085070 con 0x7f99b40cce30 2023-10-08T15:42:14.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.682+0000 7f99b37fe700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a0066f30 0x7f99a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:14.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.683+0000 7f99b37fe700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a0066f30 0x7f99a00693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f99a4007160 tx=0x7f99a4007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:14.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.686+0000 7f999b7fe700 1 -- 172.21.15.29:0/303918481 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99ac0522a0 con 0x7f99b40cce30 2023-10-08T15:42:14.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.878+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99b40b4440 con 0x7f99b40cce30 2023-10-08T15:42:14.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.878+0000 7f999b7fe700 1 -- 172.21.15.29:0/303918481 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99ac0558c0 con 0x7f99b40cce30 2023-10-08T15:42:14.879 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a0066f30 msgr2=0x7f99a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a0066f30 0x7f99a00693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f99a4007160 tx=0x7f99a4007f50 comp rx=0 tx=0).stop 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40cce30 msgr2=0x7f99b415e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40cce30 0x7f99b415e7e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00a380 tx=0x7f99ac007900 comp rx=0 tx=0).stop 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 shutdown_connections 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a0066f30 0x7f99a00693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b40cce30 0x7f99b415e7e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b406a830 0x7f99b4157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 --2- 172.21.15.29:0/303918481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b40b6580 0x7f99b414e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:14.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 >> 172.21.15.29:0/303918481 conn(0x7f99b4068cb0 msgr2=0x7f99b415ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:14.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 shutdown_connections 2023-10-08T15:42:14.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:14.880+0000 7f99b8ef3700 1 -- 172.21.15.29:0/303918481 wait complete. 2023-10-08T15:42:14.893 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T15:42:15.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.013+0000 7fb08fa10700 1 Processor -- start 2023-10-08T15:42:15.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.013+0000 7fb08fa10700 1 -- start start 2023-10-08T15:42:15.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.014+0000 7fb08fa10700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb088159ec0 0x7fb0880af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.014+0000 7fb08fa10700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb0880afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.014+0000 7fb08fa10700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0880b0790 con 0x7fb08815a290 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.014+0000 7fb08fa10700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0880ce1f0 con 0x7fb088159ec0 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.014+0000 7fb08fa10700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880b0b20 con 0x7fb08806acb0 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.014+0000 7fb08d7ac700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb088159ec0 0x7fb0880af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.014+0000 7fb08d7ac700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb088159ec0 0x7fb0880af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38170/0 (socket says 172.21.15.29:38170) 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb08d7ac700 1 -- 172.21.15.29:0/737103398 learned_addr learned my addr 172.21.15.29:0/737103398 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb08dfad700 1 --2- 172.21.15.29:0/737103398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb0880afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb08d7ac700 1 -- 172.21.15.29:0/737103398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 msgr2=0x7fb0880afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb08d7ac700 1 --2- 172.21.15.29:0/737103398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb0880afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.017 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb08d7ac700 1 -- 172.21.15.29:0/737103398 >> v1:172.21.15.183:6789/0 conn(0x7fb08815a290 legacy=0x7fb08806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb087fff700 1 -- 172.21.15.29:0/737103398 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365761358 0 0) 0x7fb0880b0790 con 0x7fb08815a290 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb08d7ac700 1 -- 172.21.15.29:0/737103398 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880b04b0 con 0x7fb088159ec0 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb08d7ac700 1 --2- 172.21.15.29:0/737103398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb0880af940 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb080009f20 tx=0x7fb080009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf78ae2aba2cb95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb087fff700 1 -- 172.21.15.29:0/737103398 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000e070 con 0x7fb088159ec0 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb087fff700 1 -- 172.21.15.29:0/737103398 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08000b9d0 con 0x7fb088159ec0 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.015+0000 7fb087fff700 1 -- 172.21.15.29:0/737103398 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0800092e0 con 0x7fb088159ec0 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.016+0000 7fb08fa10700 1 -- 172.21.15.29:0/737103398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 msgr2=0x7fb0880af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.016+0000 7fb08fa10700 1 --2- 172.21.15.29:0/737103398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb0880af940 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb080009f20 tx=0x7fb080009840 comp rx=0 tx=0).stop 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.016+0000 7fb08fa10700 1 -- 172.21.15.29:0/737103398 shutdown_connections 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.016+0000 7fb08fa10700 1 --2- 172.21.15.29:0/737103398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb0880afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.016+0000 7fb08fa10700 1 --2- 172.21.15.29:0/737103398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb0880af940 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.018 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.016+0000 7fb08fa10700 1 -- 172.21.15.29:0/737103398 >> 172.21.15.29:0/737103398 conn(0x7fb0880d1880 msgr2=0x7fb0880cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.016+0000 7fb08fa10700 1 -- 172.21.15.29:0/737103398 shutdown_connections 2023-10-08T15:42:15.019 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.016+0000 7fb08fa10700 1 -- 172.21.15.29:0/737103398 wait complete. 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.017+0000 7fb08fa10700 1 Processor -- start 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.017+0000 7fb08fa10700 1 -- start start 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08fa10700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb08815e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08fa10700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb08816b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08fa10700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08815a290 0x7fb0880c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08fa10700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb088156280 con 0x7fb088159ec0 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08fa10700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb088156e00 con 0x7fb08815a290 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08fa10700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0881564d0 con 0x7fb08806acb0 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb08816b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb08816b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38172/0 (socket says 172.21.15.29:38172) 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 -- 172.21.15.29:0/2202530467 learned_addr learned my addr 172.21.15.29:0/2202530467 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08d7ac700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb08815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08dfad700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08815a290 0x7fb0880c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 -- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 msgr2=0x7fb08815e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb08815e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 -- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08815a290 msgr2=0x7fb0880c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08815a290 0x7fb0880c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 -- 172.21.15.29:0/2202530467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080009ae0 con 0x7fb088159ec0 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08d7ac700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb08815e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08dfad700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08815a290 0x7fb0880c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.018+0000 7fb08cfab700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb08816b9a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00c530 tx=0x7fb07c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.019+0000 7fb0857fa700 1 -- 172.21.15.29:0/2202530467 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c011590 con 0x7fb088159ec0 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.019+0000 7fb0857fa700 1 -- 172.21.15.29:0/2202530467 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0116f0 con 0x7fb088159ec0 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.019+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0881567b0 con 0x7fb088159ec0 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.019+0000 7fb0857fa700 1 -- 172.21.15.29:0/2202530467 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c011ab0 con 0x7fb088159ec0 2023-10-08T15:42:15.023 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.019+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08816bee0 con 0x7fb088159ec0 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.020+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08816c100 con 0x7fb088159ec0 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.020+0000 7fb0857fa700 1 -- 172.21.15.29:0/2202530467 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb07c01b3b0 con 0x7fb088159ec0 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.020+0000 7fb0857fa700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb074066f30 0x7fb0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.020+0000 7fb0857fa700 1 -- 172.21.15.29:0/2202530467 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb07c083ae0 con 0x7fb088159ec0 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.021+0000 7fb08d7ac700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb074066f30 0x7fb0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.021+0000 7fb08d7ac700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb074066f30 0x7fb0740693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb088157f60 tx=0x7fb080018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.025+0000 7fb0857fa700 1 -- 172.21.15.29:0/2202530467 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb08816c100 con 0x7fb088159ec0 2023-10-08T15:42:15.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.217+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb08816c100 con 0x7fb088159ec0 2023-10-08T15:42:15.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.217+0000 7fb0857fa700 1 -- 172.21.15.29:0/2202530467 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb08816c100 con 0x7fb088159ec0 2023-10-08T15:42:15.218 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb074066f30 msgr2=0x7fb0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb074066f30 0x7fb0740693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb088157f60 tx=0x7fb080018000 comp rx=0 tx=0).stop 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 msgr2=0x7fb08816b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb08816b9a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00c530 tx=0x7fb07c00c8f0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 shutdown_connections 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb074066f30 0x7fb0740693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08815a290 0x7fb0880c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08806acb0 0x7fb08815e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.220 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 --2- 172.21.15.29:0/2202530467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb088159ec0 0x7fb08816b9a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 >> 172.21.15.29:0/2202530467 conn(0x7fb0880d1880 msgr2=0x7fb0880c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 shutdown_connections 2023-10-08T15:42:15.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.219+0000 7fb08fa10700 1 -- 172.21.15.29:0/2202530467 wait complete. 2023-10-08T15:42:15.232 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:15.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.349+0000 7f300a262700 1 Processor -- start 2023-10-08T15:42:15.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.349+0000 7f300a262700 1 -- start start 2023-10-08T15:42:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f300a262700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30040b32f0 0x7f3004159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f300a262700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f3004068f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f300a262700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300415a160 con 0x7f3004159850 2023-10-08T15:42:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f300a262700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30040694d0 con 0x7f30040b32f0 2023-10-08T15:42:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f300a262700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040cbaa0 con 0x7f3004068b10 2023-10-08T15:42:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f3002ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30040b32f0 0x7f3004159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f30037fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3004159850 0x7f30040b2be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55002/0 (socket says 172.21.15.29:55002) 2023-10-08T15:42:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f30037fe700 1 -- 172.21.15.29:0/1074202736 learned_addr learned my addr 172.21.15.29:0/1074202736 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.350+0000 7f3003fff700 1 --2- 172.21.15.29:0/1074202736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f3004068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f3002ffd700 1 -- 172.21.15.29:0/1074202736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 msgr2=0x7f3004068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f3002ffd700 1 --2- 172.21.15.29:0/1074202736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f3004068f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f3002ffd700 1 -- 172.21.15.29:0/1074202736 >> v1:172.21.15.29:6789/0 conn(0x7f3004159850 legacy=0x7f30040b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f3002ffd700 1 -- 172.21.15.29:0/1074202736 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30040cbd80 con 0x7f30040b32f0 2023-10-08T15:42:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f30027fc700 1 -- 172.21.15.29:0/1074202736 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546811085 0 0) 0x7f300415a160 con 0x7f3004159850 2023-10-08T15:42:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f3003fff700 1 --2- 172.21.15.29:0/1074202736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f3004068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f3002ffd700 1 --2- 172.21.15.29:0/1074202736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30040b32f0 0x7f3004159c20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80098e0 tx=0x7f2ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f22082eca1d8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f30027fc700 1 -- 172.21.15.29:0/1074202736 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8009e80 con 0x7f30040b32f0 2023-10-08T15:42:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f30027fc700 1 -- 172.21.15.29:0/1074202736 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff800b860 con 0x7f30040b32f0 2023-10-08T15:42:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f30027fc700 1 -- 172.21.15.29:0/1074202736 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff800bbe0 con 0x7f30040b32f0 2023-10-08T15:42:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f300a262700 1 -- 172.21.15.29:0/1074202736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30040b32f0 msgr2=0x7f3004159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f300a262700 1 --2- 172.21.15.29:0/1074202736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30040b32f0 0x7f3004159c20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80098e0 tx=0x7f2ff80091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f300a262700 1 -- 172.21.15.29:0/1074202736 shutdown_connections 2023-10-08T15:42:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f300a262700 1 --2- 172.21.15.29:0/1074202736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f3004068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f300a262700 1 --2- 172.21.15.29:0/1074202736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30040b32f0 0x7f3004159c20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f300a262700 1 -- 172.21.15.29:0/1074202736 >> 172.21.15.29:0/1074202736 conn(0x7f3004067660 msgr2=0x7f3004067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f300a262700 1 -- 172.21.15.29:0/1074202736 shutdown_connections 2023-10-08T15:42:15.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.351+0000 7f300a262700 1 -- 172.21.15.29:0/1074202736 wait complete. 2023-10-08T15:42:15.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.353+0000 7f300a262700 1 Processor -- start 2023-10-08T15:42:15.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.353+0000 7f300a262700 1 -- start start 2023-10-08T15:42:15.359 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.353+0000 7f300a262700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f300415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.353+0000 7f300a262700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30040b32f0 0x7f3004156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.353+0000 7f300a262700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3004159850 0x7f30040b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.353+0000 7f300a262700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004159ff0 con 0x7f3004159850 2023-10-08T15:42:15.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.353+0000 7f300a262700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040b1700 con 0x7f30040b32f0 2023-10-08T15:42:15.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.353+0000 7f300a262700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040b14d0 con 0x7f3004068b10 2023-10-08T15:42:15.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3004159850 0x7f30040b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3004159850 0x7f30040b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38188/0 (socket says 172.21.15.29:38188) 2023-10-08T15:42:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 -- 172.21.15.29:0/4254647856 learned_addr learned my addr 172.21.15.29:0/4254647856 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f30037fe700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f300415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3002ffd700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30040b32f0 0x7f3004156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 -- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 msgr2=0x7f300415d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f300415d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 -- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30040b32f0 msgr2=0x7f3004156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30040b32f0 0x7f3004156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 -- 172.21.15.29:0/4254647856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8009420 con 0x7f3004159850 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f30037fe700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f300415d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3002ffd700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30040b32f0 0x7f3004156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f3003fff700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3004159850 0x7f30040b0f90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009fc0 tx=0x7f2ffc0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f2feb7fe700 1 -- 172.21.15.29:0/4254647856 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00dd40 con 0x7f3004159850 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f2feb7fe700 1 -- 172.21.15.29:0/4254647856 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00f040 con 0x7f3004159850 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300416a060 con 0x7f3004159850 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f2feb7fe700 1 -- 172.21.15.29:0/4254647856 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc015690 con 0x7f3004159850 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.354+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300416abe0 con 0x7f3004159850 2023-10-08T15:42:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.355+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30040891c0 con 0x7f3004159850 2023-10-08T15:42:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.356+0000 7f2feb7fe700 1 -- 172.21.15.29:0/4254647856 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ffc01e3b0 con 0x7f3004159850 2023-10-08T15:42:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.356+0000 7f2feb7fe700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2ff0066f30 0x7f2ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.356+0000 7f2feb7fe700 1 -- 172.21.15.29:0/4254647856 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2ffc084ad0 con 0x7f3004159850 2023-10-08T15:42:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.356+0000 7f30037fe700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2ff0066f30 0x7f2ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.357+0000 7f30037fe700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2ff0066f30 0x7f2ff00693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40011e0 tx=0x7f2ff4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.360+0000 7f2feb7fe700 1 -- 172.21.15.29:0/4254647856 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ffc051d00 con 0x7f3004159850 2023-10-08T15:42:15.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.598+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f300404bb80 con 0x7f3004159850 2023-10-08T15:42:15.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.599+0000 7f2feb7fe700 1 -- 172.21.15.29:0/4254647856 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2ffc01a090 con 0x7f3004159850 2023-10-08T15:42:15.600 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:15.600 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2ff0066f30 msgr2=0x7f2ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2ff0066f30 0x7f2ff00693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40011e0 tx=0x7f2ff4009040 comp rx=0 tx=0).stop 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3004159850 msgr2=0x7f30040b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3004159850 0x7f30040b0f90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009fc0 tx=0x7f2ffc0099b0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 shutdown_connections 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f2ff0066f30 0x7f2ff00693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3004159850 0x7f30040b0f90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3004068b10 0x7f300415d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 --2- 172.21.15.29:0/4254647856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30040b32f0 0x7f3004156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 >> 172.21.15.29:0/4254647856 conn(0x7f3004067660 msgr2=0x7f30040cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 shutdown_connections 2023-10-08T15:42:15.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.601+0000 7f300a262700 1 -- 172.21.15.29:0/4254647856 wait complete. 2023-10-08T15:42:15.603 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:42:15.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:15.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.731+0000 7f1aa5180700 1 Processor -- start 2023-10-08T15:42:15.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.731+0000 7f1aa5180700 1 -- start start 2023-10-08T15:42:15.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1aa5180700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa00cd6e0 0x7f1aa00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1aa5180700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa00cb7c0 con 0x7f1aa015cbd0 2023-10-08T15:42:15.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1aa5180700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa015e290 con 0x7f1aa00cdab0 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1aa5180700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa015e850 con 0x7f1aa00cd6e0 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1aa497f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1aa015cbd0 0x7f1aa015d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55004/0 (socket says 172.21.15.29:55004) 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1aa497f700 1 -- 172.21.15.29:0/3908928968 learned_addr learned my addr 172.21.15.29:0/3908928968 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1a9ffff700 1 --2- 172.21.15.29:0/3908928968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa00cd6e0 0x7f1aa00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1a9effd700 1 -- 172.21.15.29:0/3908928968 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398513590 0 0) 0x7f1aa00cb7c0 con 0x7f1aa015cbd0 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1a9effd700 1 -- 172.21.15.29:0/3908928968 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a88003570 con 0x7f1aa015cbd0 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1a9effd700 1 -- 172.21.15.29:0/3908928968 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389992084 0 0) 0x7f1aa015e290 con 0x7f1aa00cdab0 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1a9effd700 1 -- 172.21.15.29:0/3908928968 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa00cb7c0 con 0x7f1aa00cdab0 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.732+0000 7f1a9ffff700 1 -- 172.21.15.29:0/3908928968 >> v1:172.21.15.183:6789/0 conn(0x7f1aa00cdab0 legacy=0x7f1aa015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1a9ffff700 1 -- 172.21.15.29:0/3908928968 >> v1:172.21.15.29:6789/0 conn(0x7f1aa015cbd0 legacy=0x7f1aa015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1a9ffff700 1 -- 172.21.15.29:0/3908928968 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa015e570 con 0x7f1aa00cd6e0 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1a9ffff700 1 --2- 172.21.15.29:0/3908928968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa00cd6e0 0x7f1aa00cbc50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009910 tx=0x7f1a900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f3824da0151f45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1a9effd700 1 -- 172.21.15.29:0/3908928968 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011630 con 0x7f1aa00cd6e0 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1a9effd700 1 -- 172.21.15.29:0/3908928968 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90011790 con 0x7f1aa00cd6e0 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1a9effd700 1 -- 172.21.15.29:0/3908928968 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011b30 con 0x7f1aa00cd6e0 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1aa5180700 1 -- 172.21.15.29:0/3908928968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa00cd6e0 msgr2=0x7f1aa00cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1aa5180700 1 --2- 172.21.15.29:0/3908928968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa00cd6e0 0x7f1aa00cbc50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009910 tx=0x7f1a900091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1aa5180700 1 -- 172.21.15.29:0/3908928968 shutdown_connections 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1aa5180700 1 --2- 172.21.15.29:0/3908928968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa00cd6e0 0x7f1aa00cbc50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1aa5180700 1 -- 172.21.15.29:0/3908928968 >> 172.21.15.29:0/3908928968 conn(0x7f1aa0067660 msgr2=0x7f1aa0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1aa5180700 1 -- 172.21.15.29:0/3908928968 shutdown_connections 2023-10-08T15:42:15.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.733+0000 7f1aa5180700 1 -- 172.21.15.29:0/3908928968 wait complete. 2023-10-08T15:42:15.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.734+0000 7f1aa5180700 1 Processor -- start 2023-10-08T15:42:15.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.735+0000 7f1aa5180700 1 -- start start 2023-10-08T15:42:15.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.735+0000 7f1aa5180700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1aa00cd6e0 0x7f1aa0159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.735+0000 7f1aa5180700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1aa00cdab0 0x7f1aa00ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.735+0000 7f1aa5180700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa015cbd0 0x7f1aa00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.735+0000 7f1aa5180700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c9f60 con 0x7f1aa00cdab0 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.735+0000 7f1aa5180700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c9350 con 0x7f1aa00cd6e0 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.735+0000 7f1aa5180700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c9630 con 0x7f1aa015cbd0 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.735+0000 7f1a9f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1aa00cdab0 0x7f1aa00ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1aa00cdab0 0x7f1aa00ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38192/0 (socket says 172.21.15.29:38192) 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9f7fe700 1 -- 172.21.15.29:0/2225486193 learned_addr learned my addr 172.21.15.29:0/2225486193 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1aa497f700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa015cbd0 0x7f1aa00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9ffff700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1aa00cd6e0 0x7f1aa0159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9f7fe700 1 -- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa015cbd0 msgr2=0x7f1aa00b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9f7fe700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa015cbd0 0x7f1aa00b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9f7fe700 1 -- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1aa00cd6e0 msgr2=0x7f1aa0159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9f7fe700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1aa00cd6e0 0x7f1aa0159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9f7fe700 1 -- 172.21.15.29:0/2225486193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90009420 con 0x7f1aa00cdab0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a9f7fe700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1aa00cdab0 0x7f1aa00ca3f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c790 tx=0x7f1a94007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a87fff700 1 -- 172.21.15.29:0/2225486193 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94010510 con 0x7f1aa00cdab0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a87fff700 1 -- 172.21.15.29:0/2225486193 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94010670 con 0x7f1aa00cdab0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa00c9910 con 0x7f1aa00cdab0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1a87fff700 1 -- 172.21.15.29:0/2225486193 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94010a10 con 0x7f1aa00cdab0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.736+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa00c8f70 con 0x7f1aa00cdab0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.737+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa00ca110 con 0x7f1aa00cdab0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.738+0000 7f1a87fff700 1 -- 172.21.15.29:0/2225486193 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a9401b3b0 con 0x7f1aa00cdab0 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.738+0000 7f1a87fff700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a8c066f30 0x7f1a8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:15.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.738+0000 7f1a87fff700 1 -- 172.21.15.29:0/2225486193 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1a94083dd0 con 0x7f1aa00cdab0 2023-10-08T15:42:15.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.738+0000 7f1a9ffff700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a8c066f30 0x7f1a8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:15.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.739+0000 7f1a9ffff700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a8c066f30 0x7f1a8c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009860 tx=0x7f1a90017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:15.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.743+0000 7f1a87fff700 1 -- 172.21.15.29:0/2225486193 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aa00ca110 con 0x7f1aa00cdab0 2023-10-08T15:42:15.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.936+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aa00ca0a0 con 0x7f1aa00cdab0 2023-10-08T15:42:15.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.937+0000 7f1a87fff700 1 -- 172.21.15.29:0/2225486193 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+15445 (secure 0 0 0) 0x7f1a94085090 con 0x7f1aa00cdab0 2023-10-08T15:42:15.938 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:15.938 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":54,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:42:13.551694+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:39.312324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:40.225704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.35","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:15.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a8c066f30 msgr2=0x7f1a8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a8c066f30 0x7f1a8c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009860 tx=0x7f1a90017000 comp rx=0 tx=0).stop 2023-10-08T15:42:15.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1aa00cdab0 msgr2=0x7f1aa00ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:15.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1aa00cdab0 0x7f1aa00ca3f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c790 tx=0x7f1a94007e10 comp rx=0 tx=0).stop 2023-10-08T15:42:15.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 shutdown_connections 2023-10-08T15:42:15.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1a8c066f30 0x7f1a8c0693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1aa015cbd0 0x7f1aa00b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1aa00cd6e0 0x7f1aa0159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 --2- 172.21.15.29:0/2225486193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1aa00cdab0 0x7f1aa00ca3f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:15.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.939+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 >> 172.21.15.29:0/2225486193 conn(0x7f1aa0067660 msgr2=0x7f1aa01571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:15.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.940+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 shutdown_connections 2023-10-08T15:42:15.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:15.940+0000 7f1aa5180700 1 -- 172.21.15.29:0/2225486193 wait complete. 2023-10-08T15:42:15.952 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T15:42:15.952 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:16.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.070+0000 7f402e46e700 1 Processor -- start 2023-10-08T15:42:16.071 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.070+0000 7f402e46e700 1 -- start start 2023-10-08T15:42:16.073 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f402e46e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40281523e0 0x7f402806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f402e46e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4028158e50 0x7f40280cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f402e46e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402806c010 con 0x7f4028152010 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f402e46e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402806bd10 con 0x7f4028158e50 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f402e46e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402815c060 con 0x7f40281523e0 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f402ca0b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4028158e50 0x7f40280cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f4027fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4028152010 0x7f402815b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55020/0 (socket says 172.21.15.29:55020) 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f402ca0b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4028158e50 0x7f40280cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38198/0 (socket says 172.21.15.29:38198) 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.071+0000 7f4027fff700 1 -- 172.21.15.29:0/790047691 learned_addr learned my addr 172.21.15.29:0/790047691 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f40277fe700 1 --2- 172.21.15.29:0/790047691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40281523e0 0x7f402806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f402ca0b700 1 -- 172.21.15.29:0/790047691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40281523e0 msgr2=0x7f402806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f402ca0b700 1 --2- 172.21.15.29:0/790047691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40281523e0 0x7f402806c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f402ca0b700 1 -- 172.21.15.29:0/790047691 >> v1:172.21.15.29:6789/0 conn(0x7f4028152010 legacy=0x7f402815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f402ca0b700 1 -- 172.21.15.29:0/790047691 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402815c340 con 0x7f4028158e50 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f4026ffd700 1 -- 172.21.15.29:0/790047691 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677084443 0 0) 0x7f402806c010 con 0x7f4028152010 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f40277fe700 1 --2- 172.21.15.29:0/790047691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40281523e0 0x7f402806c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f402ca0b700 1 --2- 172.21.15.29:0/790047691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4028158e50 0x7f40280cdf30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4020009e60 tx=0x7f4020009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908e2eba8b05513b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f4026ffd700 1 -- 172.21.15.29:0/790047691 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000e070 con 0x7f4028158e50 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f4026ffd700 1 -- 172.21.15.29:0/790047691 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402000bc30 con 0x7f4028158e50 2023-10-08T15:42:16.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f4026ffd700 1 -- 172.21.15.29:0/790047691 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020012430 con 0x7f4028158e50 2023-10-08T15:42:16.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.072+0000 7f402e46e700 1 -- 172.21.15.29:0/790047691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4028158e50 msgr2=0x7f40280cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.073+0000 7f402e46e700 1 --2- 172.21.15.29:0/790047691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4028158e50 0x7f40280cdf30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4020009e60 tx=0x7f4020009780 comp rx=0 tx=0).stop 2023-10-08T15:42:16.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.073+0000 7f402e46e700 1 -- 172.21.15.29:0/790047691 shutdown_connections 2023-10-08T15:42:16.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.073+0000 7f402e46e700 1 --2- 172.21.15.29:0/790047691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4028158e50 0x7f40280cdf30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.073+0000 7f402e46e700 1 --2- 172.21.15.29:0/790047691 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40281523e0 0x7f402806c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.073+0000 7f402e46e700 1 -- 172.21.15.29:0/790047691 >> 172.21.15.29:0/790047691 conn(0x7f4028069870 msgr2=0x7f4028069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.073+0000 7f402e46e700 1 -- 172.21.15.29:0/790047691 shutdown_connections 2023-10-08T15:42:16.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.073+0000 7f402e46e700 1 -- 172.21.15.29:0/790047691 wait complete. 2023-10-08T15:42:16.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.074+0000 7f402e46e700 1 Processor -- start 2023-10-08T15:42:16.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.074+0000 7f402e46e700 1 -- start start 2023-10-08T15:42:16.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402e46e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4028152010 0x7f4028068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402e46e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40281523e0 0x7f402814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402e46e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4028158e50 0x7f402814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402e46e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4028067660 con 0x7f40281523e0 2023-10-08T15:42:16.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402e46e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4028068890 con 0x7f4028152010 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402e46e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4028067ec0 con 0x7f4028158e50 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40281523e0 0x7f402814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40281523e0 0x7f402814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38202/0 (socket says 172.21.15.29:38202) 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 -- 172.21.15.29:0/3856533838 learned_addr learned my addr 172.21.15.29:0/3856533838 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402ca0b700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4028158e50 0x7f402814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f4027fff700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4028152010 0x7f4028068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 -- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4028158e50 msgr2=0x7f402814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4028158e50 0x7f402814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 -- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4028152010 msgr2=0x7f4028068350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4028152010 0x7f4028068350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 -- 172.21.15.29:0/3856533838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020009a20 con 0x7f40281523e0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f40277fe700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40281523e0 0x7f402814aa50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f401c00e8d0 tx=0x7f401c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f400ffff700 1 -- 172.21.15.29:0/3856533838 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c013410 con 0x7f40281523e0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f400ffff700 1 -- 172.21.15.29:0/3856533838 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c013570 con 0x7f40281523e0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4028150900 con 0x7f40281523e0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f400ffff700 1 -- 172.21.15.29:0/3856533838 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c013930 con 0x7f40281523e0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.075+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4028067b50 con 0x7f40281523e0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.076+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402804c3c0 con 0x7f40281523e0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.077+0000 7f400ffff700 1 -- 172.21.15.29:0/3856533838 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f401c013ca0 con 0x7f40281523e0 2023-10-08T15:42:16.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.077+0000 7f400ffff700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4014066f30 0x7f40140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.077+0000 7f400ffff700 1 -- 172.21.15.29:0/3856533838 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f401c0842f0 con 0x7f40281523e0 2023-10-08T15:42:16.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.077+0000 7f4027fff700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4014066f30 0x7f40140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.078+0000 7f4027fff700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4014066f30 0x7f40140693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4018007160 tx=0x7f4018007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.081+0000 7f400ffff700 1 -- 172.21.15.29:0/3856533838 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f401c054fb0 con 0x7f40281523e0 2023-10-08T15:42:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.318+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4028068000 con 0x7f40281523e0 2023-10-08T15:42:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.318+0000 7f400ffff700 1 -- 172.21.15.29:0/3856533838 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f401c05a070 con 0x7f40281523e0 2023-10-08T15:42:16.319 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:16.319 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:42:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4014066f30 msgr2=0x7f40140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4014066f30 0x7f40140693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4018007160 tx=0x7f4018007f50 comp rx=0 tx=0).stop 2023-10-08T15:42:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40281523e0 msgr2=0x7f402814aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40281523e0 0x7f402814aa50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f401c00e8d0 tx=0x7f401c008040 comp rx=0 tx=0).stop 2023-10-08T15:42:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 shutdown_connections 2023-10-08T15:42:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4014066f30 0x7f40140693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4028158e50 0x7f402814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4028152010 0x7f4028068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 --2- 172.21.15.29:0/3856533838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40281523e0 0x7f402814aa50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.320+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 >> 172.21.15.29:0/3856533838 conn(0x7f4028069870 msgr2=0x7f40280cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.321+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 shutdown_connections 2023-10-08T15:42:16.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.321+0000 7f402e46e700 1 -- 172.21.15.29:0/3856533838 wait complete. 2023-10-08T15:42:16.323 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:42:16.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:16.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.451+0000 7f52152a7700 1 Processor -- start 2023-10-08T15:42:16.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.451+0000 7f52152a7700 1 -- start start 2023-10-08T15:42:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.451+0000 7f52152a7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f52100cfe20 0x7f52100ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.451+0000 7f52152a7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100c5d80 con 0x7f52100d1c30 2023-10-08T15:42:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.451+0000 7f52152a7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100c6060 con 0x7f521015a2b0 2023-10-08T15:42:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.451+0000 7f52152a7700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5210068470 con 0x7f52100cfe20 2023-10-08T15:42:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520e7fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f52100d1c30 0x7f52100cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55022/0 (socket says 172.21.15.29:55022) 2023-10-08T15:42:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520e7fc700 1 -- 172.21.15.29:0/800490408 learned_addr learned my addr 172.21.15.29:0/800490408 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520f7fe700 1 --2- 172.21.15.29:0/800490408 >> v2:172.21.15.183:3300/0 conn(0x7f52100cfe20 0x7f52100ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520dffb700 1 -- 172.21.15.29:0/800490408 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653015633 0 0) 0x7f52100c5d80 con 0x7f52100d1c30 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520dffb700 1 -- 172.21.15.29:0/800490408 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f8003570 con 0x7f52100d1c30 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520dffb700 1 -- 172.21.15.29:0/800490408 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579101715 0 0) 0x7f52100c6060 con 0x7f521015a2b0 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520dffb700 1 -- 172.21.15.29:0/800490408 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52100c5d80 con 0x7f521015a2b0 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520f7fe700 1 -- 172.21.15.29:0/800490408 >> v1:172.21.15.183:6789/0 conn(0x7f521015a2b0 legacy=0x7f52100b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520f7fe700 1 -- 172.21.15.29:0/800490408 >> v1:172.21.15.29:6789/0 conn(0x7f52100d1c30 legacy=0x7f52100cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520f7fe700 1 -- 172.21.15.29:0/800490408 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100c6340 con 0x7f52100cfe20 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520f7fe700 1 --2- 172.21.15.29:0/800490408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 0x7f52100ccdd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5208009e60 tx=0x7f5208009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=699aa7602a5c3651 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520dffb700 1 -- 172.21.15.29:0/800490408 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800e070 con 0x7f52100cfe20 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520dffb700 1 -- 172.21.15.29:0/800490408 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520800bab0 con 0x7f52100cfe20 2023-10-08T15:42:16.454 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.452+0000 7f520dffb700 1 -- 172.21.15.29:0/800490408 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800be70 con 0x7f52100cfe20 2023-10-08T15:42:16.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.453+0000 7f52152a7700 1 -- 172.21.15.29:0/800490408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 msgr2=0x7f52100ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.453+0000 7f52152a7700 1 --2- 172.21.15.29:0/800490408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 0x7f52100ccdd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5208009e60 tx=0x7f5208009780 comp rx=0 tx=0).stop 2023-10-08T15:42:16.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.453+0000 7f52152a7700 1 -- 172.21.15.29:0/800490408 shutdown_connections 2023-10-08T15:42:16.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.453+0000 7f52152a7700 1 --2- 172.21.15.29:0/800490408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 0x7f52100ccdd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.453+0000 7f52152a7700 1 -- 172.21.15.29:0/800490408 >> 172.21.15.29:0/800490408 conn(0x7f5210067e40 msgr2=0x7f52100d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.453+0000 7f52152a7700 1 -- 172.21.15.29:0/800490408 shutdown_connections 2023-10-08T15:42:16.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.453+0000 7f52152a7700 1 -- 172.21.15.29:0/800490408 wait complete. 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.454+0000 7f52152a7700 1 Processor -- start 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.454+0000 7f52152a7700 1 -- start start 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f52152a7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 0x7f52101577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f52152a7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52100d1c30 0x7f5210156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f52152a7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f521015a2b0 0x7f52100c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f52152a7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521009b2d0 con 0x7f521015a2b0 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f52152a7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521009aca0 con 0x7f52100cfe20 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f52152a7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521009d970 con 0x7f52100d1c30 2023-10-08T15:42:16.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f521015a2b0 0x7f52100c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f521015a2b0 0x7f52100c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38214/0 (socket says 172.21.15.29:38214) 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520f7fe700 1 -- 172.21.15.29:0/680309443 learned_addr learned my addr 172.21.15.29:0/680309443 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520effd700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 0x7f52101577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520e7fc700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52100d1c30 0x7f5210156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520f7fe700 1 -- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52100d1c30 msgr2=0x7f5210156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520f7fe700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52100d1c30 0x7f5210156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520f7fe700 1 -- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 msgr2=0x7f52101577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520f7fe700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 0x7f52101577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.455+0000 7f520f7fe700 1 -- 172.21.15.29:0/680309443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208009a20 con 0x7f521015a2b0 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.456+0000 7f520f7fe700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f521015a2b0 0x7f52100c8350 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5208013000 tx=0x7f5208019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.456+0000 7f51f6ffd700 1 -- 172.21.15.29:0/680309443 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208012db0 con 0x7f521015a2b0 2023-10-08T15:42:16.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.456+0000 7f51f6ffd700 1 -- 172.21.15.29:0/680309443 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5208026480 con 0x7f521015a2b0 2023-10-08T15:42:16.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.456+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521009dc50 con 0x7f521015a2b0 2023-10-08T15:42:16.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.456+0000 7f51f6ffd700 1 -- 172.21.15.29:0/680309443 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208026840 con 0x7f521015a2b0 2023-10-08T15:42:16.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.456+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521009d640 con 0x7f521015a2b0 2023-10-08T15:42:16.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.457+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521009b480 con 0x7f521015a2b0 2023-10-08T15:42:16.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.457+0000 7f51f6ffd700 1 -- 172.21.15.29:0/680309443 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f520801c400 con 0x7f521015a2b0 2023-10-08T15:42:16.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.458+0000 7f51f6ffd700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51fc066f30 0x7f51fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.458+0000 7f51f6ffd700 1 -- 172.21.15.29:0/680309443 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f5208086390 con 0x7f521015a2b0 2023-10-08T15:42:16.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.458+0000 7f520effd700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51fc066f30 0x7f51fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.458+0000 7f520effd700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51fc066f30 0x7f51fc0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5200003a40 tx=0x7f5200007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.462+0000 7f51f6ffd700 1 -- 172.21.15.29:0/680309443 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f521009b480 con 0x7f521015a2b0 2023-10-08T15:42:16.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.700+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f521009dde0 con 0x7f521015a2b0 2023-10-08T15:42:16.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.701+0000 7f51f6ffd700 1 -- 172.21.15.29:0/680309443 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f52080535c0 con 0x7f521015a2b0 2023-10-08T15:42:16.702 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:16.702 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:41:41.251854+0000","modified":"2023-10-08T15:41:44.868620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/3946331252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3946331252},{"type":"v1","addr":"172.21.15.29:6834","nonce":3946331252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T15:42:16.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51fc066f30 msgr2=0x7f51fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51fc066f30 0x7f51fc0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5200003a40 tx=0x7f5200007d40 comp rx=0 tx=0).stop 2023-10-08T15:42:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f521015a2b0 msgr2=0x7f52100c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f521015a2b0 0x7f52100c8350 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5208013000 tx=0x7f5208019000 comp rx=0 tx=0).stop 2023-10-08T15:42:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 shutdown_connections 2023-10-08T15:42:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f51fc066f30 0x7f51fc0693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f521015a2b0 0x7f52100c8350 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52100cfe20 0x7f52101577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 --2- 172.21.15.29:0/680309443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52100d1c30 0x7f5210156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 >> 172.21.15.29:0/680309443 conn(0x7f5210067e40 msgr2=0x7f5210069370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 shutdown_connections 2023-10-08T15:42:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.703+0000 7f52152a7700 1 -- 172.21.15.29:0/680309443 wait complete. 2023-10-08T15:42:16.707 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 25 2023-10-08T15:42:16.715 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.833+0000 7fb1e74db700 1 Processor -- start 2023-10-08T15:42:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.833+0000 7fb1e74db700 1 -- start start 2023-10-08T15:42:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.834+0000 7fb1e74db700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1e00b0e50 0x7fb1e00c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.834+0000 7fb1e74db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e00b1220 0x7fb1e006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.834+0000 7fb1e74db700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e015de60 con 0x7fb1e006dad0 2023-10-08T15:42:16.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.834+0000 7fb1e74db700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e015e140 con 0x7fb1e00b0e50 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.834+0000 7fb1e74db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e015e420 con 0x7fb1e00b1220 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.834+0000 7fb1e5277700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1e00b0e50 0x7fb1e00c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.834+0000 7fb1e5277700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1e00b0e50 0x7fb1e00c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38230/0 (socket says 172.21.15.29:38230) 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.834+0000 7fb1e5277700 1 -- 172.21.15.29:0/3574377824 learned_addr learned my addr 172.21.15.29:0/3574377824 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1e5277700 1 -- 172.21.15.29:0/3574377824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e00b1220 msgr2=0x7fb1e006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1e4a76700 1 --2- 172.21.15.29:0/3574377824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e00b1220 0x7fb1e006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1e5277700 1 --2- 172.21.15.29:0/3574377824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e00b1220 0x7fb1e006d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1e5277700 1 -- 172.21.15.29:0/3574377824 >> v1:172.21.15.183:6789/0 conn(0x7fb1e006dad0 legacy=0x7fb1e00cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1e5277700 1 -- 172.21.15.29:0/3574377824 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e015e700 con 0x7fb1e00b0e50 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1e5277700 1 --2- 172.21.15.29:0/3574377824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e00c9180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80099e0 tx=0x7fb1d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea256998d3e4801 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1dffff700 1 -- 172.21.15.29:0/3574377824 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d800b7e0 con 0x7fb1e00b0e50 2023-10-08T15:42:16.837 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1dffff700 1 -- 172.21.15.29:0/3574377824 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d800b940 con 0x7fb1e00b0e50 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.835+0000 7fb1dffff700 1 -- 172.21.15.29:0/3574377824 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d800bd00 con 0x7fb1e00b0e50 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.836+0000 7fb1e74db700 1 -- 172.21.15.29:0/3574377824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 msgr2=0x7fb1e00c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.836+0000 7fb1e74db700 1 --2- 172.21.15.29:0/3574377824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e00c9180 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80099e0 tx=0x7fb1d8009250 comp rx=0 tx=0).stop 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.836+0000 7fb1e74db700 1 -- 172.21.15.29:0/3574377824 shutdown_connections 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.836+0000 7fb1e74db700 1 --2- 172.21.15.29:0/3574377824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e00c9180 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.836+0000 7fb1e74db700 1 --2- 172.21.15.29:0/3574377824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e00b1220 0x7fb1e006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.836+0000 7fb1e74db700 1 -- 172.21.15.29:0/3574377824 >> 172.21.15.29:0/3574377824 conn(0x7fb1e0069870 msgr2=0x7fb1e0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.836+0000 7fb1e74db700 1 -- 172.21.15.29:0/3574377824 shutdown_connections 2023-10-08T15:42:16.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.836+0000 7fb1e74db700 1 -- 172.21.15.29:0/3574377824 wait complete. 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.837+0000 7fb1e74db700 1 Processor -- start 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.837+0000 7fb1e74db700 1 -- start start 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e74db700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e006dad0 0x7fb1e00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e74db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e0153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e74db700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e00b1220 0x7fb1e006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e74db700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00c6a60 con 0x7fb1e00b0e50 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e74db700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00c8660 con 0x7fb1e00b1220 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e74db700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e015d130 con 0x7fb1e006dad0 2023-10-08T15:42:16.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e0153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e0153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38242/0 (socket says 172.21.15.29:38242) 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 -- 172.21.15.29:0/2230469358 learned_addr learned my addr 172.21.15.29:0/2230469358 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e5277700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e006dad0 0x7fb1e00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e5a78700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e00b1220 0x7fb1e006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 -- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e006dad0 msgr2=0x7fb1e00b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e006dad0 0x7fb1e00b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 -- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e00b1220 msgr2=0x7fb1e006bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e00b1220 0x7fb1e006bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 -- 172.21.15.29:0/2230469358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80094f0 con 0x7fb1e00b0e50 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e5a78700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e00b1220 0x7fb1e006bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e5277700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e006dad0 0x7fb1e00b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:16.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e4a76700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e0153d30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400c880 tx=0x7fb1d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1dd7fa700 1 -- 172.21.15.29:0/2230469358 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4011600 con 0x7fb1e00b0e50 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1dd7fa700 1 -- 172.21.15.29:0/2230469358 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d4011780 con 0x7fb1e00b0e50 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e00c6410 con 0x7fb1e00b0e50 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.838+0000 7fb1dd7fa700 1 -- 172.21.15.29:0/2230469358 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4011b40 con 0x7fb1e00b0e50 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.839+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e015d410 con 0x7fb1e00b0e50 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.839+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e00c6c10 con 0x7fb1e00b0e50 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.840+0000 7fb1dd7fa700 1 -- 172.21.15.29:0/2230469358 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1d4018360 con 0x7fb1e00b0e50 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.840+0000 7fb1dd7fa700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb1cc066f30 0x7fb1cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.840+0000 7fb1dd7fa700 1 -- 172.21.15.29:0/2230469358 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb1d4084270 con 0x7fb1e00b0e50 2023-10-08T15:42:16.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.841+0000 7fb1e5277700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb1cc066f30 0x7fb1cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:16.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.841+0000 7fb1e5277700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb1cc066f30 0x7fb1cc0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80099e0 tx=0x7fb1d8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:16.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:16.845+0000 7fb1dd7fa700 1 -- 172.21.15.29:0/2230469358 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1e00c6c10 con 0x7fb1e00b0e50 2023-10-08T15:42:17.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.037+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1e004c3c0 con 0x7fb1e00b0e50 2023-10-08T15:42:17.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.038+0000 7fb1dd7fa700 1 -- 172.21.15.29:0/2230469358 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+15445 (secure 0 0 0) 0x7fb1d4054f30 con 0x7fb1e00b0e50 2023-10-08T15:42:17.039 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:17.039 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":54,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:42:13.551694+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:41:39.312324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T15:41:40.225704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.35","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:17.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb1cc066f30 msgr2=0x7fb1cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb1cc066f30 0x7fb1cc0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80099e0 tx=0x7fb1d8016000 comp rx=0 tx=0).stop 2023-10-08T15:42:17.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 msgr2=0x7fb1e0153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e0153d30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400c880 tx=0x7fb1d4008040 comp rx=0 tx=0).stop 2023-10-08T15:42:17.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 shutdown_connections 2023-10-08T15:42:17.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb1cc066f30 0x7fb1cc0693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1e00b1220 0x7fb1e006bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1e006dad0 0x7fb1e00b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 --2- 172.21.15.29:0/2230469358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1e00b0e50 0x7fb1e0153d30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 >> 172.21.15.29:0/2230469358 conn(0x7fb1e0069870 msgr2=0x7fb1e0154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 shutdown_connections 2023-10-08T15:42:17.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.040+0000 7fb1e74db700 1 -- 172.21.15.29:0/2230469358 wait complete. 2023-10-08T15:42:17.052 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T15:42:17.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.171+0000 7fb513ff5700 1 Processor -- start 2023-10-08T15:42:17.172 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.171+0000 7fb513ff5700 1 -- start start 2023-10-08T15:42:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb513ff5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c15a2b0 0x7fb50c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb513ff5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb50c0cfe20 0x7fb50c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb513ff5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0c5d80 con 0x7fb50c0d1c30 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb513ff5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c068470 con 0x7fb50c0cfe20 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb513ff5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c6060 con 0x7fb50c15a2b0 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb511590700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb50c0d1c30 0x7fb50c0cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55026/0 (socket says 172.21.15.29:55026) 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb511590700 1 -- 172.21.15.29:0/3014627400 learned_addr learned my addr 172.21.15.29:0/3014627400 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb511d91700 1 --2- 172.21.15.29:0/3014627400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c15a2b0 0x7fb50c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.172+0000 7fb512592700 1 --2- 172.21.15.29:0/3014627400 >> v2:172.21.15.183:3300/0 conn(0x7fb50c0cfe20 0x7fb50c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb510d8f700 1 -- 172.21.15.29:0/3014627400 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123198375 0 0) 0x7fb50c0c5d80 con 0x7fb50c0d1c30 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb510d8f700 1 -- 172.21.15.29:0/3014627400 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f4003570 con 0x7fb50c0d1c30 2023-10-08T15:42:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb511d91700 1 -- 172.21.15.29:0/3014627400 >> v2:172.21.15.183:3300/0 conn(0x7fb50c0cfe20 msgr2=0x7fb50c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb511d91700 1 --2- 172.21.15.29:0/3014627400 >> v2:172.21.15.183:3300/0 conn(0x7fb50c0cfe20 0x7fb50c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb511d91700 1 -- 172.21.15.29:0/3014627400 >> v1:172.21.15.29:6789/0 conn(0x7fb50c0d1c30 legacy=0x7fb50c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb511d91700 1 -- 172.21.15.29:0/3014627400 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0c6340 con 0x7fb50c15a2b0 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb512592700 1 --2- 172.21.15.29:0/3014627400 >> v2:172.21.15.183:3300/0 conn(0x7fb50c0cfe20 0x7fb50c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb511d91700 1 --2- 172.21.15.29:0/3014627400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c15a2b0 0x7fb50c0b3da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb504009eb0 tx=0x7fb504009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ae1bf494a37c25 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb510d8f700 1 -- 172.21.15.29:0/3014627400 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400e070 con 0x7fb50c15a2b0 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb510d8f700 1 -- 172.21.15.29:0/3014627400 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400bb80 con 0x7fb50c15a2b0 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.173+0000 7fb510d8f700 1 -- 172.21.15.29:0/3014627400 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504012430 con 0x7fb50c15a2b0 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.174+0000 7fb513ff5700 1 -- 172.21.15.29:0/3014627400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c15a2b0 msgr2=0x7fb50c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.174+0000 7fb513ff5700 1 --2- 172.21.15.29:0/3014627400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c15a2b0 0x7fb50c0b3da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb504009eb0 tx=0x7fb504009780 comp rx=0 tx=0).stop 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.174+0000 7fb513ff5700 1 -- 172.21.15.29:0/3014627400 shutdown_connections 2023-10-08T15:42:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.174+0000 7fb513ff5700 1 --2- 172.21.15.29:0/3014627400 >> v2:172.21.15.183:3300/0 conn(0x7fb50c0cfe20 0x7fb50c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.174+0000 7fb513ff5700 1 --2- 172.21.15.29:0/3014627400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c15a2b0 0x7fb50c0b3da0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.174+0000 7fb513ff5700 1 -- 172.21.15.29:0/3014627400 >> 172.21.15.29:0/3014627400 conn(0x7fb50c067e40 msgr2=0x7fb50c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.174+0000 7fb513ff5700 1 -- 172.21.15.29:0/3014627400 shutdown_connections 2023-10-08T15:42:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.174+0000 7fb513ff5700 1 -- 172.21.15.29:0/3014627400 wait complete. 2023-10-08T15:42:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.175+0000 7fb513ff5700 1 Processor -- start 2023-10-08T15:42:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.175+0000 7fb513ff5700 1 -- start start 2023-10-08T15:42:17.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb513ff5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c0cfe20 0x7fb50c16a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb513ff5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb50c0d1c30 0x7fb50c167490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb513ff5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c15a2b0 0x7fb50c0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb513ff5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c1679d0 con 0x7fb50c0d1c30 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb513ff5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c09b410 con 0x7fb50c15a2b0 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb513ff5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c167b50 con 0x7fb50c0cfe20 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb50c0d1c30 0x7fb50c167490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb50c0d1c30 0x7fb50c167490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38248/0 (socket says 172.21.15.29:38248) 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 -- 172.21.15.29:0/1830845826 learned_addr learned my addr 172.21.15.29:0/1830845826 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511d91700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c0cfe20 0x7fb50c16a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb512592700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c15a2b0 0x7fb50c0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 -- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c0cfe20 msgr2=0x7fb50c16a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c0cfe20 0x7fb50c16a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 -- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c15a2b0 msgr2=0x7fb50c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c15a2b0 0x7fb50c0d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 -- 172.21.15.29:0/1830845826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc009420 con 0x7fb50c0d1c30 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb511590700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb50c0d1c30 0x7fb50c167490 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb50000c560 tx=0x7fb500007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb509ffb700 1 -- 172.21.15.29:0/1830845826 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500005b30 con 0x7fb50c0d1c30 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb509ffb700 1 -- 172.21.15.29:0/1830845826 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500005c90 con 0x7fb50c0d1c30 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb504009a20 con 0x7fb50c0d1c30 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.176+0000 7fb509ffb700 1 -- 172.21.15.29:0/1830845826 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000072e0 con 0x7fb50c0d1c30 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.177+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c167d60 con 0x7fb50c0d1c30 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.178+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c04c3c0 con 0x7fb50c0d1c30 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.178+0000 7fb509ffb700 1 -- 172.21.15.29:0/1830845826 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb50001b3b0 con 0x7fb50c0d1c30 2023-10-08T15:42:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.178+0000 7fb509ffb700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb4f8066f30 0x7fb4f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.178+0000 7fb509ffb700 1 -- 172.21.15.29:0/1830845826 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb500083820 con 0x7fb50c0d1c30 2023-10-08T15:42:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.179+0000 7fb511d91700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb4f8066f30 0x7fb4f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.179+0000 7fb511d91700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb4f8066f30 0x7fb4f80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb5040097c0 tx=0x7fb504019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.183+0000 7fb509ffb700 1 -- 172.21.15.29:0/1830845826 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb50004b5a0 con 0x7fb50c0d1c30 2023-10-08T15:42:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.421+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb50c15d7b0 con 0x7fb50c0d1c30 2023-10-08T15:42:17.422 INFO:tasks.ceph.mon.a.smithi029.stderr:2023-10-08T15:42:17.421+0000 7f3b39a11700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T15:42:17.425 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.425+0000 7fb509ffb700 1 -- 172.21.15.29:0/1830845826 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb500017020 con 0x7fb50c0d1c30 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb4f8066f30 msgr2=0x7fb4f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb4f8066f30 0x7fb4f80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb5040097c0 tx=0x7fb504019000 comp rx=0 tx=0).stop 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb50c0d1c30 msgr2=0x7fb50c167490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb50c0d1c30 0x7fb50c167490 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb50000c560 tx=0x7fb500007dd0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 shutdown_connections 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fb4f8066f30 0x7fb4f80693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c15a2b0 0x7fb50c0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c0cfe20 0x7fb50c16a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 --2- 172.21.15.29:0/1830845826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb50c0d1c30 0x7fb50c167490 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 >> 172.21.15.29:0/1830845826 conn(0x7fb50c067e40 msgr2=0x7fb50c0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 shutdown_connections 2023-10-08T15:42:17.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.427+0000 7fb513ff5700 1 -- 172.21.15.29:0/1830845826 wait complete. 2023-10-08T15:42:17.429 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T15:42:17.429 INFO:tasks.ceph.mds.c.smithi029.stderr: -9083> 2023-10-08T15:41:46.835+0000 7efeee8de700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:42:17.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T15:42:17.460 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-08T15:42:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.562+0000 7f5a4e1c7700 1 Processor -- start 2023-10-08T15:42:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.563+0000 7f5a4e1c7700 1 -- start start 2023-10-08T15:42:17.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.563+0000 7f5a4e1c7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a4806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.563+0000 7f5a4e1c7700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480b0790 con 0x7f5a48159ec0 2023-10-08T15:42:17.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a4e1c7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480ce1f0 con 0x7f5a4806aae0 2023-10-08T15:42:17.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a4e1c7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4806af60 con 0x7f5a4815a290 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a477fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5a48159ec0 0x7f5a480af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:55044/0 (socket says 172.21.15.29:55044) 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a477fe700 1 -- 172.21.15.29:0/3904349498 learned_addr learned my addr 172.21.15.29:0/3904349498 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a46ffd700 1 --2- 172.21.15.29:0/3904349498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a4806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a467fc700 1 -- 172.21.15.29:0/3904349498 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779406767 0 0) 0x7f5a480ce1f0 con 0x7f5a4806aae0 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a46ffd700 1 -- 172.21.15.29:0/3904349498 >> v1:172.21.15.183:6789/0 conn(0x7f5a4806aae0 legacy=0x7f5a480cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a46ffd700 1 -- 172.21.15.29:0/3904349498 >> v1:172.21.15.29:6789/0 conn(0x7f5a48159ec0 legacy=0x7f5a480af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a46ffd700 1 -- 172.21.15.29:0/3904349498 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480b0b20 con 0x7f5a4815a290 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a46ffd700 1 --2- 172.21.15.29:0/3904349498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a4806a5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009910 tx=0x7f5a3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40bafc056504b170 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.564+0000 7f5a467fc700 1 -- 172.21.15.29:0/3904349498 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00b860 con 0x7f5a4815a290 2023-10-08T15:42:17.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a467fc700 1 -- 172.21.15.29:0/3904349498 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c00b9c0 con 0x7f5a4815a290 2023-10-08T15:42:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a467fc700 1 -- 172.21.15.29:0/3904349498 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00bd60 con 0x7f5a4815a290 2023-10-08T15:42:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/3904349498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 msgr2=0x7f5a4806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a4e1c7700 1 --2- 172.21.15.29:0/3904349498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a4806a5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009910 tx=0x7f5a3c0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/3904349498 shutdown_connections 2023-10-08T15:42:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a4e1c7700 1 --2- 172.21.15.29:0/3904349498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a4806a5a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/3904349498 >> 172.21.15.29:0/3904349498 conn(0x7f5a480d1880 msgr2=0x7f5a480cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/3904349498 shutdown_connections 2023-10-08T15:42:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.565+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/3904349498 wait complete. 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.566+0000 7f5a4e1c7700 1 Processor -- start 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.566+0000 7f5a4e1c7700 1 -- start start 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a4e1c7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a4806aae0 0x7f5a4816e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a4e1c7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48159ec0 0x7f5a48160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a4e1c7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a48155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a4e1c7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48157780 con 0x7f5a48159ec0 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a4e1c7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4816e970 con 0x7f5a4806aae0 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a4e1c7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48157200 con 0x7f5a4815a290 2023-10-08T15:42:17.571 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a46ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48159ec0 0x7f5a48160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a46ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48159ec0 0x7f5a48160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38272/0 (socket says 172.21.15.29:38272) 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a46ffd700 1 -- 172.21.15.29:0/2954690434 learned_addr learned my addr 172.21.15.29:0/2954690434 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a477fe700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a4806aae0 0x7f5a4816e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.567+0000 7f5a47fff700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a48155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a46ffd700 1 -- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 msgr2=0x7f5a48155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a46ffd700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a48155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a46ffd700 1 -- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a4806aae0 msgr2=0x7f5a4816e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a46ffd700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a4806aae0 0x7f5a4816e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a46ffd700 1 -- 172.21.15.29:0/2954690434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c009420 con 0x7f5a48159ec0 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a47fff700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a48155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a46ffd700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48159ec0 0x7f5a48160350 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00c010 tx=0x7f5a3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a2f7fe700 1 -- 172.21.15.29:0/2954690434 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c01f070 con 0x7f5a48159ec0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a2f7fe700 1 -- 172.21.15.29:0/2954690434 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c002f70 con 0x7f5a48159ec0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a2f7fe700 1 -- 172.21.15.29:0/2954690434 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c01a670 con 0x7f5a48159ec0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4815e530 con 0x7f5a48159ec0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.568+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a481574a0 con 0x7f5a48159ec0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.569+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4804c3c0 con 0x7f5a48159ec0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.569+0000 7f5a2f7fe700 1 -- 172.21.15.29:0/2954690434 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a3c01a9e0 con 0x7f5a48159ec0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.570+0000 7f5a2f7fe700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5a34066f30 0x7f5a340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.570+0000 7f5a2f7fe700 1 -- 172.21.15.29:0/2954690434 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f5a3c085ad0 con 0x7f5a48159ec0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.570+0000 7f5a477fe700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5a34066f30 0x7f5a340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:17.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.570+0000 7f5a477fe700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5a34066f30 0x7f5a340693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5a38007130 tx=0x7f5a38007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:17.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.574+0000 7f5a2f7fe700 1 -- 172.21.15.29:0/2954690434 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a3c052cb0 con 0x7f5a48159ec0 2023-10-08T15:42:17.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:17.810+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5a480b04b0 con 0x7f5a48159ec0 2023-10-08T15:42:18.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.426+0000 7f5a2f7fe700 1 -- 172.21.15.29:0/2954690434 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5a3c0280a0 con 0x7f5a48159ec0 2023-10-08T15:42:18.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5a34066f30 msgr2=0x7f5a340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5a34066f30 0x7f5a340693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5a38007130 tx=0x7f5a38007eb0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48159ec0 msgr2=0x7f5a48160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48159ec0 0x7f5a48160350 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00c010 tx=0x7f5a3c017000 comp rx=0 tx=0).stop 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 shutdown_connections 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f5a34066f30 0x7f5a340693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a4815a290 0x7f5a48155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a4806aae0 0x7f5a4816e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 --2- 172.21.15.29:0/2954690434 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48159ec0 0x7f5a48160350 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 >> 172.21.15.29:0/2954690434 conn(0x7f5a480d1880 msgr2=0x7f5a480c7040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:18.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 shutdown_connections 2023-10-08T15:42:18.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.429+0000 7f5a4e1c7700 1 -- 172.21.15.29:0/2954690434 wait complete. 2023-10-08T15:42:18.443 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T15:42:18.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.607+0000 7f3b55ef9700 1 Processor -- start 2023-10-08T15:42:18.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.607+0000 7f3b55ef9700 1 -- start start 2023-10-08T15:42:18.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b55ef9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 0x7f3b500ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b55ef9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3b500cdcc0 0x7f3b500ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b55ef9700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b500d0140 con 0x7f3b50159c10 2023-10-08T15:42:18.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b55ef9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500cf280 con 0x7f3b500cdcc0 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b55ef9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500cf530 con 0x7f3b50159fe0 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b556f8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3b500cdcc0 0x7f3b500ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b54ef7700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3b50159c10 0x7f3b500cd5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47924/0 (socket says 172.21.15.29:47924) 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b54ef7700 1 -- 172.21.15.29:0/1170245873 learned_addr learned my addr 172.21.15.29:0/1170245873 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b4ffff700 1 --2- 172.21.15.29:0/1170245873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 0x7f3b500ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b556f8700 1 -- 172.21.15.29:0/1170245873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 msgr2=0x7f3b500ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b556f8700 1 --2- 172.21.15.29:0/1170245873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 0x7f3b500ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b4f7fe700 1 -- 172.21.15.29:0/1170245873 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739253378 0 0) 0x7f3b500d0140 con 0x7f3b50159c10 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b556f8700 1 -- 172.21.15.29:0/1170245873 >> v1:172.21.15.29:6789/0 conn(0x7f3b50159c10 legacy=0x7f3b500cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.608+0000 7f3b556f8700 1 -- 172.21.15.29:0/1170245873 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500cf810 con 0x7f3b500cdcc0 2023-10-08T15:42:18.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b556f8700 1 --2- 172.21.15.29:0/1170245873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500ced40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3b380098e0 tx=0x7f3b380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee1f81c6f4a6a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b4f7fe700 1 -- 172.21.15.29:0/1170245873 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800b640 con 0x7f3b500cdcc0 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b4f7fe700 1 -- 172.21.15.29:0/1170245873 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3800b7a0 con 0x7f3b500cdcc0 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b4f7fe700 1 -- 172.21.15.29:0/1170245873 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800bb40 con 0x7f3b500cdcc0 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b55ef9700 1 -- 172.21.15.29:0/1170245873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 msgr2=0x7f3b500ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/1170245873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500ced40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3b380098e0 tx=0x7f3b380091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b55ef9700 1 -- 172.21.15.29:0/1170245873 shutdown_connections 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/1170245873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500ced40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/1170245873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 0x7f3b500ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b55ef9700 1 -- 172.21.15.29:0/1170245873 >> 172.21.15.29:0/1170245873 conn(0x7f3b500696b0 msgr2=0x7f3b50067660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b55ef9700 1 -- 172.21.15.29:0/1170245873 shutdown_connections 2023-10-08T15:42:18.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.609+0000 7f3b55ef9700 1 -- 172.21.15.29:0/1170245873 wait complete. 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.610+0000 7f3b55ef9700 1 Processor -- start 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b55ef9700 1 -- start start 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b55ef9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b55ef9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b50159c10 0x7f3b501574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b55ef9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 0x7f3b50141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b55ef9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501564e0 con 0x7f3b500cdcc0 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b55ef9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500b6760 con 0x7f3b50159c10 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b55ef9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501566f0 con 0x7f3b50159fe0 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b54ef7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b54ef7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41976/0 (socket says 172.21.15.29:41976) 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.611+0000 7f3b54ef7700 1 -- 172.21.15.29:0/723913365 learned_addr learned my addr 172.21.15.29:0/723913365 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b4ffff700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b50159c10 0x7f3b501574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b556f8700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 0x7f3b50141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b54ef7700 1 -- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 msgr2=0x7f3b50141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b54ef7700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 0x7f3b50141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b54ef7700 1 -- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b50159c10 msgr2=0x7f3b501574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b54ef7700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b50159c10 0x7f3b501574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b54ef7700 1 -- 172.21.15.29:0/723913365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38009420 con 0x7f3b500cdcc0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b54ef7700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500b6220 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800c7e0 tx=0x7f3b48007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b4cff9700 1 -- 172.21.15.29:0/723913365 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48005b30 con 0x7f3b500cdcc0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b4cff9700 1 -- 172.21.15.29:0/723913365 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b48005c90 con 0x7f3b500cdcc0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b4cff9700 1 -- 172.21.15.29:0/723913365 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48007300 con 0x7f3b500cdcc0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b501569d0 con 0x7f3b500cdcc0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.612+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b50156f90 con 0x7f3b500cdcc0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.613+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b500cfaf0 con 0x7f3b500cdcc0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.614+0000 7f3b4cff9700 1 -- 172.21.15.29:0/723913365 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b4801b3b0 con 0x7f3b500cdcc0 2023-10-08T15:42:18.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.614+0000 7f3b4cff9700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b30066f30 0x7f3b300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.614+0000 7f3b4cff9700 1 -- 172.21.15.29:0/723913365 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f3b48083ae0 con 0x7f3b500cdcc0 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.614+0000 7f3b4ffff700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b30066f30 0x7f3b300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:18.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.615+0000 7f3b4ffff700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b30066f30 0x7f3b300693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009fd0 tx=0x7f3b4000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:18.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.619+0000 7f3b4cff9700 1 -- 172.21.15.29:0/723913365 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b48050cc0 con 0x7f3b500cdcc0 2023-10-08T15:42:18.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:18.812+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3b5004bb80 con 0x7f3b500cdcc0 2023-10-08T15:42:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.575+0000 7f3b4cff9700 1 -- 172.21.15.29:0/723913365 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3b48017020 con 0x7f3b500cdcc0 2023-10-08T15:42:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b30066f30 msgr2=0x7f3b300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b30066f30 0x7f3b300693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009fd0 tx=0x7f3b4000b040 comp rx=0 tx=0).stop 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 msgr2=0x7f3b500b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500b6220 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800c7e0 tx=0x7f3b48007df0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 shutdown_connections 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f3b30066f30 0x7f3b300693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3b50159fe0 0x7f3b50141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b500cdcc0 0x7f3b500b6220 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 --2- 172.21.15.29:0/723913365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3b50159c10 0x7f3b501574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 >> 172.21.15.29:0/723913365 conn(0x7f3b500696b0 msgr2=0x7f3b500b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 shutdown_connections 2023-10-08T15:42:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.578+0000 7f3b55ef9700 1 -- 172.21.15.29:0/723913365 wait complete. 2023-10-08T15:42:19.581 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2023-10-08T15:42:19.593 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T15:42:19.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.721+0000 7f0e1c4d4700 1 Processor -- start 2023-10-08T15:42:19.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.721+0000 7f0e1c4d4700 1 -- start start 2023-10-08T15:42:19.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1c4d4700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e14159ef0 0x7f0e1415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:19.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1c4d4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140b46f0 0x7f0e140b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:19.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1c4d4700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e140b5070 con 0x7f0e140b6a10 2023-10-08T15:42:19.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1c4d4700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e140b17b0 con 0x7f0e14159ef0 2023-10-08T15:42:19.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1c4d4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140b1a60 con 0x7f0e140b46f0 2023-10-08T15:42:19.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1a270700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e14159ef0 0x7f0e1415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:19.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e19a6f700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f0e140b6a10 0x7f0e140b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47934/0 (socket says 172.21.15.29:47934) 2023-10-08T15:42:19.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e19a6f700 1 -- 172.21.15.29:0/676861490 learned_addr learned my addr 172.21.15.29:0/676861490 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:19.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1aa71700 1 --2- 172.21.15.29:0/676861490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140b46f0 0x7f0e140b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:19.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1a270700 1 -- 172.21.15.29:0/676861490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140b46f0 msgr2=0x7f0e140b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:19.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1a270700 1 --2- 172.21.15.29:0/676861490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140b46f0 0x7f0e140b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1a270700 1 -- 172.21.15.29:0/676861490 >> v1:172.21.15.29:6789/0 conn(0x7f0e140b6a10 legacy=0x7f0e140b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:19.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1a270700 1 -- 172.21.15.29:0/676861490 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140b1d40 con 0x7f0e14159ef0 2023-10-08T15:42:19.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1926e700 1 -- 172.21.15.29:0/676861490 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294012439 0 0) 0x7f0e140b5070 con 0x7f0e140b6a10 2023-10-08T15:42:19.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1a270700 1 --2- 172.21.15.29:0/676861490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e14159ef0 0x7f0e1415a2c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0e100098d0 tx=0x7f0e10009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dced6009d4c653ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:19.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1926e700 1 -- 172.21.15.29:0/676861490 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10009e70 con 0x7f0e14159ef0 2023-10-08T15:42:19.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1926e700 1 -- 172.21.15.29:0/676861490 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e10005c10 con 0x7f0e14159ef0 2023-10-08T15:42:19.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.722+0000 7f0e1926e700 1 -- 172.21.15.29:0/676861490 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000b650 con 0x7f0e14159ef0 2023-10-08T15:42:19.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.723+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/676861490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e14159ef0 msgr2=0x7f0e1415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:19.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.723+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/676861490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e14159ef0 0x7f0e1415a2c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0e100098d0 tx=0x7f0e10009120 comp rx=0 tx=0).stop 2023-10-08T15:42:19.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.723+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/676861490 shutdown_connections 2023-10-08T15:42:19.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.723+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/676861490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e140b46f0 0x7f0e140b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.723+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/676861490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e14159ef0 0x7f0e1415a2c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.723+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/676861490 >> 172.21.15.29:0/676861490 conn(0x7f0e1409a0a0 msgr2=0x7f0e14067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:19.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.723+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/676861490 shutdown_connections 2023-10-08T15:42:19.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.723+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/676861490 wait complete. 2023-10-08T15:42:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.724+0000 7f0e1c4d4700 1 Processor -- start 2023-10-08T15:42:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.724+0000 7f0e1c4d4700 1 -- start start 2023-10-08T15:42:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1c4d4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e140b46f0 0x7f0e14150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1c4d4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e140b6a10 0x7f0e1409e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:19.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1c4d4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e14159ef0 0x7f0e14069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1c4d4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141573e0 con 0x7f0e140b46f0 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1c4d4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141567d0 con 0x7f0e140b6a10 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1c4d4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14156ab0 con 0x7f0e14159ef0 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e140b46f0 0x7f0e14150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e140b46f0 0x7f0e14150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41994/0 (socket says 172.21.15.29:41994) 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 -- 172.21.15.29:0/928598475 learned_addr learned my addr 172.21.15.29:0/928598475 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e19a6f700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e140b6a10 0x7f0e1409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1aa71700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e14159ef0 0x7f0e14069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 -- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e14159ef0 msgr2=0x7f0e14069eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e14159ef0 0x7f0e14069eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 -- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e140b6a10 msgr2=0x7f0e1409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:19.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e140b6a10 0x7f0e1409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 -- 172.21.15.29:0/928598475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e100093c0 con 0x7f0e140b46f0 2023-10-08T15:42:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1a270700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e140b46f0 0x7f0e14150420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000b3c0 tx=0x7f0e10016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e0a7fc700 1 -- 172.21.15.29:0/928598475 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10006310 con 0x7f0e140b46f0 2023-10-08T15:42:19.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e0a7fc700 1 -- 172.21.15.29:0/928598475 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e10006490 con 0x7f0e140b46f0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e14156d90 con 0x7f0e140b46f0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.725+0000 7f0e0a7fc700 1 -- 172.21.15.29:0/928598475 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10006850 con 0x7f0e140b46f0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.726+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e14150960 con 0x7f0e140b46f0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.726+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e141531b0 con 0x7f0e140b46f0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.727+0000 7f0e0a7fc700 1 -- 172.21.15.29:0/928598475 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e1001b690 con 0x7f0e140b46f0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.727+0000 7f0e0a7fc700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.727+0000 7f0e0a7fc700 1 -- 172.21.15.29:0/928598475 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f0e100865c0 con 0x7f0e140b46f0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.727+0000 7f0e19a6f700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.728+0000 7f0e19a6f700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0e14158330 tx=0x7f0e04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:19.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.732+0000 7f0e0a7fc700 1 -- 172.21.15.29:0/928598475 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e10053950 con 0x7f0e140b46f0 2023-10-08T15:42:19.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:19.929+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0e1404c3c0 con 0x7f0e140b46f0 2023-10-08T15:42:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.580+0000 7f0e0a7fc700 1 -- 172.21.15.29:0/928598475 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0e10056f70 con 0x7f0e140b46f0 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 msgr2=0x7f0df80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0e14158330 tx=0x7f0e04009040 comp rx=0 tx=0).stop 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e140b46f0 msgr2=0x7f0e14150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e140b46f0 0x7f0e14150420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000b3c0 tx=0x7f0e10016000 comp rx=0 tx=0).stop 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 shutdown_connections 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0df8066f30 0x7f0df80693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e14159ef0 0x7f0e14069eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e140b46f0 0x7f0e14150420 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 --2- 172.21.15.29:0/928598475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e140b6a10 0x7f0e1409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 >> 172.21.15.29:0/928598475 conn(0x7f0e1409a0a0 msgr2=0x7f0e1415b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:20.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 shutdown_connections 2023-10-08T15:42:20.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.583+0000 7f0e1c4d4700 1 -- 172.21.15.29:0/928598475 wait complete. 2023-10-08T15:42:20.585 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2023-10-08T15:42:20.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T15:42:20.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.726+0000 7f70599ef700 1 Processor -- start 2023-10-08T15:42:20.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.726+0000 7f70599ef700 1 -- start start 2023-10-08T15:42:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.727+0000 7f70599ef700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f705406db00 0x7f70540b1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.727+0000 7f70599ef700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540cb350 con 0x7f7054157e60 2023-10-08T15:42:20.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.727+0000 7f70599ef700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540cc790 con 0x7f705406d730 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.727+0000 7f70599ef700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70540cca70 con 0x7f705406db00 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.727+0000 7f70537fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f705406db00 0x7f70540b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.727+0000 7f70527fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7054157e60 0x7f70540cd550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47948/0 (socket says 172.21.15.29:47948) 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.727+0000 7f70527fc700 1 -- 172.21.15.29:0/4004918901 learned_addr learned my addr 172.21.15.29:0/4004918901 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.728+0000 7f70537fe700 1 -- 172.21.15.29:0/4004918901 >> v1:172.21.15.183:6789/0 conn(0x7f705406d730 legacy=0x7f7054157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.728+0000 7f70537fe700 1 -- 172.21.15.29:0/4004918901 >> v1:172.21.15.29:6789/0 conn(0x7f7054157e60 legacy=0x7f70540cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.728+0000 7f7051ffb700 1 -- 172.21.15.29:0/4004918901 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744363785 0 0) 0x7f70540cb350 con 0x7f7054157e60 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.728+0000 7f70537fe700 1 -- 172.21.15.29:0/4004918901 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540ccd50 con 0x7f705406db00 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.728+0000 7f70537fe700 1 --2- 172.21.15.29:0/4004918901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f70540b1960 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7044009e60 tx=0x7f7044009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbe186cb376aef9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:20.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.728+0000 7f7051ffb700 1 -- 172.21.15.29:0/4004918901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704400e070 con 0x7f705406db00 2023-10-08T15:42:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.728+0000 7f7051ffb700 1 -- 172.21.15.29:0/4004918901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704400bc30 con 0x7f705406db00 2023-10-08T15:42:20.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.728+0000 7f7051ffb700 1 -- 172.21.15.29:0/4004918901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044012430 con 0x7f705406db00 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.729+0000 7f70599ef700 1 -- 172.21.15.29:0/4004918901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 msgr2=0x7f70540b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.729+0000 7f70599ef700 1 --2- 172.21.15.29:0/4004918901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f70540b1960 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7044009e60 tx=0x7f7044009780 comp rx=0 tx=0).stop 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.729+0000 7f70599ef700 1 -- 172.21.15.29:0/4004918901 shutdown_connections 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.729+0000 7f70599ef700 1 --2- 172.21.15.29:0/4004918901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f70540b1960 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.729+0000 7f70599ef700 1 -- 172.21.15.29:0/4004918901 >> 172.21.15.29:0/4004918901 conn(0x7f705406a380 msgr2=0x7f70540cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.729+0000 7f70599ef700 1 -- 172.21.15.29:0/4004918901 shutdown_connections 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.729+0000 7f70599ef700 1 -- 172.21.15.29:0/4004918901 wait complete. 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.730+0000 7f70599ef700 1 Processor -- start 2023-10-08T15:42:20.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.730+0000 7f70599ef700 1 -- start start 2023-10-08T15:42:20.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70599ef700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f705406d730 0x7f70540c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70599ef700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f705415d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70599ef700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7054157e60 0x7f70540b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70599ef700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7054159090 con 0x7f705406db00 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70599ef700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7054158480 con 0x7f7054157e60 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70599ef700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7054158760 con 0x7f705406d730 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f705415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f705415d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42018/0 (socket says 172.21.15.29:42018) 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 -- 172.21.15.29:0/1047584435 learned_addr learned my addr 172.21.15.29:0/1047584435 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70537fe700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7054157e60 0x7f70540b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f7052ffd700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f705406d730 0x7f70540c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 -- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f705406d730 msgr2=0x7f70540c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f705406d730 0x7f70540c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 -- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7054157e60 msgr2=0x7f70540b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7054157e60 0x7f70540b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 -- 172.21.15.29:0/1047584435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7044009a20 con 0x7f705406db00 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70537fe700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7054157e60 0x7f70540b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.731+0000 7f70527fc700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f705415d350 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f703c00c5b0 tx=0x7f703c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.732+0000 7f704affd700 1 -- 172.21.15.29:0/1047584435 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c005b30 con 0x7f705406db00 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.732+0000 7f704affd700 1 -- 172.21.15.29:0/1047584435 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c005c90 con 0x7f705406db00 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.732+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7054158a40 con 0x7f705406db00 2023-10-08T15:42:20.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.732+0000 7f704affd700 1 -- 172.21.15.29:0/1047584435 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c007300 con 0x7f705406db00 2023-10-08T15:42:20.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.732+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70540c74d0 con 0x7f705406db00 2023-10-08T15:42:20.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.733+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7054159200 con 0x7f705406db00 2023-10-08T15:42:20.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.733+0000 7f704affd700 1 -- 172.21.15.29:0/1047584435 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f703c01b3b0 con 0x7f705406db00 2023-10-08T15:42:20.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.733+0000 7f704affd700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7034066f30 0x7f70340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:20.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.733+0000 7f704affd700 1 -- 172.21.15.29:0/1047584435 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f703c083780 con 0x7f705406db00 2023-10-08T15:42:20.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.734+0000 7f7052ffd700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7034066f30 0x7f70340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:20.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.734+0000 7f7052ffd700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7034066f30 0x7f70340693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f704c001760 tx=0x7f704c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:20.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.738+0000 7f704affd700 1 -- 172.21.15.29:0/1047584435 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f703c050cf0 con 0x7f705406db00 2023-10-08T15:42:20.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.933+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f705404c3c0 con 0x7f705406db00 2023-10-08T15:42:20.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.936+0000 7f704affd700 1 -- 172.21.15.29:0/1047584435 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f703c054310 con 0x7f705406db00 2023-10-08T15:42:20.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7034066f30 msgr2=0x7f70340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7034066f30 0x7f70340693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f704c001760 tx=0x7f704c009040 comp rx=0 tx=0).stop 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 msgr2=0x7f705415d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f705415d350 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f703c00c5b0 tx=0x7f703c001070 comp rx=0 tx=0).stop 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 shutdown_connections 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7034066f30 0x7f70340693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7054157e60 0x7f70540b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f705406d730 0x7f70540c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 --2- 172.21.15.29:0/1047584435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f705406db00 0x7f705415d350 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 >> 172.21.15.29:0/1047584435 conn(0x7f705406a380 msgr2=0x7f70540c9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:20.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 shutdown_connections 2023-10-08T15:42:20.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:20.939+0000 7f70599ef700 1 -- 172.21.15.29:0/1047584435 wait complete. 2023-10-08T15:42:20.951 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-08T15:42:21.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.072+0000 7f7e5a13e700 1 Processor -- start 2023-10-08T15:42:21.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.072+0000 7f7e5a13e700 1 -- start start 2023-10-08T15:42:21.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.072+0000 7f7e5a13e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e5406c630 0x7f7e54067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.072+0000 7f7e5a13e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e54067ba0 0x7f7e54159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.072+0000 7f7e5a13e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e540cb370 con 0x7f7e540b0890 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.072+0000 7f7e5a13e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e54067fe0 con 0x7f7e5406c630 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.072+0000 7f7e5a13e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540b0c60 con 0x7f7e54067ba0 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e537fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7e540b0890 0x7f7e540cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47950/0 (socket says 172.21.15.29:47950) 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e537fe700 1 -- 172.21.15.29:0/3989125117 learned_addr learned my addr 172.21.15.29:0/3989125117 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865920282 0 0) 0x7f7e540cb370 con 0x7f7e540b0890 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e3c003570 con 0x7f7e540b0890 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e52ffd700 1 --2- 172.21.15.29:0/3989125117 >> v2:172.21.15.183:3300/0 conn(0x7f7e5406c630 0x7f7e54067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e53fff700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e54067ba0 0x7f7e54159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2952466495 0 0) 0x7f7e3c003570 con 0x7f7e540b0890 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e54067ba0 msgr2=0x7f7e54159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e54067ba0 0x7f7e54159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 >> v2:172.21.15.183:3300/0 conn(0x7f7e5406c630 msgr2=0x7f7e54067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 --2- 172.21.15.29:0/3989125117 >> v2:172.21.15.183:3300/0 conn(0x7f7e5406c630 0x7f7e54067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5406a1e0 con 0x7f7e540b0890 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f7e44001470 con 0x7f7e540b0890 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 >> v1:172.21.15.29:6789/0 conn(0x7f7e540b0890 legacy=0x7f7e540cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e3c003a60 0x7f7e3c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c004810 0x7f7e3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e54067ba0 0x7f7e3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54067fe0 con 0x7f7e3c003a60 2023-10-08T15:42:21.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540b0c60 con 0x7f7e3c004810 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c00bb90 con 0x7f7e54067ba0 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e537fe700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e3c003a60 0x7f7e3c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e52ffd700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c004810 0x7f7e3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.073+0000 7f7e53fff700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e54067ba0 0x7f7e3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e537fe700 1 -- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e54067ba0 msgr2=0x7f7e3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e537fe700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e54067ba0 0x7f7e3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e537fe700 1 -- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c004810 msgr2=0x7f7e3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e537fe700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c004810 0x7f7e3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e537fe700 1 -- 172.21.15.29:0/3989125117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c003570 con 0x7f7e3c003a60 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e537fe700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e3c003a60 0x7f7e3c003e70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c3c0 tx=0x7f7e44001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fdfbf6bb5d065f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4400cc90 con 0x7f7e3c003a60 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4400ce30 con 0x7f7e3c003a60 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e527fc700 1 -- 172.21.15.29:0/3989125117 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44005b70 con 0x7f7e3c003a60 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e5a13e700 1 -- 172.21.15.29:0/3989125117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e3c003a60 msgr2=0x7f7e3c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e5a13e700 1 --2- 172.21.15.29:0/3989125117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e3c003a60 0x7f7e3c003e70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c3c0 tx=0x7f7e44001e90 comp rx=0 tx=0).stop 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.074+0000 7f7e53fff700 1 -- 172.21.15.29:0/3989125117 reap_dead start 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.075+0000 7f7e5a13e700 1 -- 172.21.15.29:0/3989125117 shutdown_connections 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.075+0000 7f7e5a13e700 1 -- 172.21.15.29:0/3989125117 >> 172.21.15.29:0/3989125117 conn(0x7f7e5406fe50 msgr2=0x7f7e54069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.075+0000 7f7e5a13e700 1 -- 172.21.15.29:0/3989125117 shutdown_connections 2023-10-08T15:42:21.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.075+0000 7f7e5a13e700 1 -- 172.21.15.29:0/3989125117 wait complete. 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.076+0000 7f7e5a13e700 1 Processor -- start 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.076+0000 7f7e5a13e700 1 -- start start 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e5a13e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c003a60 0x7f7e540c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e5a13e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5414bde0 0x7f7e5415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e5a13e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5414c250 0x7f7e54160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e5a13e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540c2c00 con 0x7f7e5414c250 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e5a13e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540c2ee0 con 0x7f7e3c003a60 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e5a13e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540c31c0 con 0x7f7e5414bde0 2023-10-08T15:42:21.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5414c250 0x7f7e54160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5414c250 0x7f7e54160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42038/0 (socket says 172.21.15.29:42038) 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 -- 172.21.15.29:0/2710644158 learned_addr learned my addr 172.21.15.29:0/2710644158 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e52ffd700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5414bde0 0x7f7e5415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e537fe700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c003a60 0x7f7e540c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 -- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5414bde0 msgr2=0x7f7e5415fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5414bde0 0x7f7e5415fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 -- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c003a60 msgr2=0x7f7e540c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c003a60 0x7f7e540c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 -- 172.21.15.29:0/2710644158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540c34a0 con 0x7f7e5414c250 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e52ffd700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5414bde0 0x7f7e5415fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e537fe700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c003a60 0x7f7e540c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:21.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e53fff700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5414c250 0x7f7e54160430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e540c5aa0 tx=0x7f7e4c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e3b7fe700 1 -- 172.21.15.29:0/2710644158 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c009b10 con 0x7f7e5414c250 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e3b7fe700 1 -- 172.21.15.29:0/2710644158 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c002d50 con 0x7f7e5414c250 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e540c60f0 con 0x7f7e5414c250 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e3b7fe700 1 -- 172.21.15.29:0/2710644158 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c015670 con 0x7f7e5414c250 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.077+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e540c2990 con 0x7f7e5414c250 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.078+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5404c3c0 con 0x7f7e5414c250 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.079+0000 7f7e3b7fe700 1 -- 172.21.15.29:0/2710644158 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e4c003040 con 0x7f7e5414c250 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.079+0000 7f7e3b7fe700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7e40066f30 0x7f7e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.079+0000 7f7e3b7fe700 1 -- 172.21.15.29:0/2710644158 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7e4c084990 con 0x7f7e5414c250 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.079+0000 7f7e537fe700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7e40066f30 0x7f7e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.080+0000 7f7e537fe700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7e40066f30 0x7f7e400693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001ed0 tx=0x7f7e44015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.083+0000 7f7e3b7fe700 1 -- 172.21.15.29:0/2710644158 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e4c051f00 con 0x7f7e5414c250 2023-10-08T15:42:21.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.355+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f7e5406cdc0 con 0x7f7e5414c250 2023-10-08T15:42:21.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.580+0000 7f7e3b7fe700 1 -- 172.21.15.29:0/2710644158 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v126) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7e4c055520 con 0x7f7e5414c250 2023-10-08T15:42:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7e40066f30 msgr2=0x7f7e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7e40066f30 0x7f7e400693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001ed0 tx=0x7f7e44015000 comp rx=0 tx=0).stop 2023-10-08T15:42:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5414c250 msgr2=0x7f7e54160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5414c250 0x7f7e54160430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e540c5aa0 tx=0x7f7e4c009710 comp rx=0 tx=0).stop 2023-10-08T15:42:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 shutdown_connections 2023-10-08T15:42:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7e40066f30 0x7f7e400693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e5414c250 0x7f7e54160430 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e3c003a60 0x7f7e540c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 --2- 172.21.15.29:0/2710644158 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e5414bde0 0x7f7e5415fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 >> 172.21.15.29:0/2710644158 conn(0x7f7e5406fe50 msgr2=0x7f7e5415c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:21.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 shutdown_connections 2023-10-08T15:42:21.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.582+0000 7f7e5a13e700 1 -- 172.21.15.29:0/2710644158 wait complete. 2023-10-08T15:42:21.595 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-08T15:42:21.595 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-10-08T15:42:21.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-08T15:42:21.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.714+0000 7f7f440f5700 1 Processor -- start 2023-10-08T15:42:21.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.714+0000 7f7f440f5700 1 -- start start 2023-10-08T15:42:21.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.715+0000 7f7f440f5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.715+0000 7f7f440f5700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c069060 con 0x7f7f3c069de0 2023-10-08T15:42:21.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.715+0000 7f7f440f5700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c069300 con 0x7f7f3c0c9930 2023-10-08T15:42:21.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.715+0000 7f7f440f5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0695e0 con 0x7f7f3c0c9560 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.715+0000 7f7f41690700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7f3c069de0 0x7f7f3c15bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47958/0 (socket says 172.21.15.29:47958) 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.715+0000 7f7f41690700 1 -- 172.21.15.29:0/2248957502 learned_addr learned my addr 172.21.15.29:0/2248957502 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f41e91700 1 --2- 172.21.15.29:0/2248957502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f40e8f700 1 -- 172.21.15.29:0/2248957502 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316186659 0 0) 0x7f7f3c069060 con 0x7f7f3c069de0 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f40e8f700 1 -- 172.21.15.29:0/2248957502 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f24003570 con 0x7f7f3c069de0 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f40e8f700 1 -- 172.21.15.29:0/2248957502 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191418179 0 0) 0x7f7f3c069300 con 0x7f7f3c0c9930 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f40e8f700 1 -- 172.21.15.29:0/2248957502 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f3c069060 con 0x7f7f3c0c9930 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f40e8f700 1 -- 172.21.15.29:0/2248957502 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4042494666 0 0) 0x7f7f24003570 con 0x7f7f3c069de0 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f41e91700 1 -- 172.21.15.29:0/2248957502 >> v1:172.21.15.183:6789/0 conn(0x7f7f3c0c9930 legacy=0x7f7f3c0ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f41e91700 1 -- 172.21.15.29:0/2248957502 >> v1:172.21.15.29:6789/0 conn(0x7f7f3c069de0 legacy=0x7f7f3c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f41e91700 1 -- 172.21.15.29:0/2248957502 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0698c0 con 0x7f7f3c0c9560 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f41e91700 1 --2- 172.21.15.29:0/2248957502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c157a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009910 tx=0x7f7f340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c336f3320c583b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f40e8f700 1 -- 172.21.15.29:0/2248957502 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30001470 con 0x7f7f3c0c9560 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f40e8f700 1 -- 172.21.15.29:0/2248957502 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34011420 con 0x7f7f3c0c9560 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.716+0000 7f7f40e8f700 1 -- 172.21.15.29:0/2248957502 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340117c0 con 0x7f7f3c0c9560 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.717+0000 7f7f440f5700 1 -- 172.21.15.29:0/2248957502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 msgr2=0x7f7f3c157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.717+0000 7f7f440f5700 1 --2- 172.21.15.29:0/2248957502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c157a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009910 tx=0x7f7f340091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.717+0000 7f7f440f5700 1 -- 172.21.15.29:0/2248957502 shutdown_connections 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.717+0000 7f7f440f5700 1 --2- 172.21.15.29:0/2248957502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c157a50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.717+0000 7f7f440f5700 1 -- 172.21.15.29:0/2248957502 >> 172.21.15.29:0/2248957502 conn(0x7f7f3c067660 msgr2=0x7f7f3c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.717+0000 7f7f440f5700 1 -- 172.21.15.29:0/2248957502 shutdown_connections 2023-10-08T15:42:21.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.717+0000 7f7f440f5700 1 -- 172.21.15.29:0/2248957502 wait complete. 2023-10-08T15:42:21.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.718+0000 7f7f440f5700 1 Processor -- start 2023-10-08T15:42:21.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.718+0000 7f7f440f5700 1 -- start start 2023-10-08T15:42:21.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f440f5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f3c069de0 0x7f7f3c168600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f440f5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f440f5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0c9930 0x7f7f3c0c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f440f5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c1710 con 0x7f7f3c0c9930 2023-10-08T15:42:21.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f440f5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c13e0 con 0x7f7f3c069de0 2023-10-08T15:42:21.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f440f5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c168f70 con 0x7f7f3c0c9560 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0c9930 0x7f7f3c0c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0c9930 0x7f7f3c0c2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42044/0 (socket says 172.21.15.29:42044) 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 -- 172.21.15.29:0/1315140101 learned_addr learned my addr 172.21.15.29:0/1315140101 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f41e91700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f3c069de0 0x7f7f3c168600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f41690700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 -- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 msgr2=0x7f7f3c0c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c0c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 -- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f3c069de0 msgr2=0x7f7f3c168600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f3c069de0 0x7f7f3c168600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:21.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 -- 172.21.15.29:0/1315140101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f34009420 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f42692700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0c9930 0x7f7f3c0c2b60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00c860 tx=0x7f7f2c002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.719+0000 7f7f39ffb700 1 -- 172.21.15.29:0/1315140101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c002030 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.720+0000 7f7f39ffb700 1 -- 172.21.15.29:0/1315140101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0021b0 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.720+0000 7f7f39ffb700 1 -- 172.21.15.29:0/1315140101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c012630 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.720+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c169250 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.720+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c168b40 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.721+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c04c3c0 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.721+0000 7f7f39ffb700 1 -- 172.21.15.29:0/1315140101 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f2c012a20 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.721+0000 7f7f39ffb700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7f28066f30 0x7f7f280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.722+0000 7f7f39ffb700 1 -- 172.21.15.29:0/1315140101 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7f2c084120 con 0x7f7f3c0c9930 2023-10-08T15:42:21.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.722+0000 7f7f41e91700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7f28066f30 0x7f7f280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:21.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.722+0000 7f7f41e91700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7f28066f30 0x7f7f280693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7f340091e0 tx=0x7f7f34016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:21.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.726+0000 7f7f39ffb700 1 -- 172.21.15.29:0/1315140101 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f2c051690 con 0x7f7f3c0c9930 2023-10-08T15:42:21.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:21.998+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f7f3c15c9b0 con 0x7f7f3c0c9930 2023-10-08T15:42:22.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.585+0000 7f7f39ffb700 1 -- 172.21.15.29:0/1315140101 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v127) v1 ==== 137+0+0 (secure 0 0 0) 0x7f7f2c054cb0 con 0x7f7f3c0c9930 2023-10-08T15:42:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7f28066f30 msgr2=0x7f7f280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7f28066f30 0x7f7f280693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7f340091e0 tx=0x7f7f34016000 comp rx=0 tx=0).stop 2023-10-08T15:42:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0c9930 msgr2=0x7f7f3c0c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0c9930 0x7f7f3c0c2b60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00c860 tx=0x7f7f2c002700 comp rx=0 tx=0).stop 2023-10-08T15:42:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 shutdown_connections 2023-10-08T15:42:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f7f28066f30 0x7f7f280693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f3c0c9930 0x7f7f3c0c2b60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f3c069de0 0x7f7f3c168600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 --2- 172.21.15.29:0/1315140101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f3c0c9560 0x7f7f3c0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 >> 172.21.15.29:0/1315140101 conn(0x7f7f3c067660 msgr2=0x7f7f3c0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 shutdown_connections 2023-10-08T15:42:22.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.587+0000 7f7f440f5700 1 -- 172.21.15.29:0/1315140101 wait complete. 2023-10-08T15:42:22.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-08T15:42:22.736 INFO:teuthology.orchestra.run.smithi029.stdout:{"osd_objectstore":"memstore"} 2023-10-08T15:42:22.736 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-08T15:42:22.737 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T15:42:22.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.857+0000 7f037fa8c700 1 Processor -- start 2023-10-08T15:42:22.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.858+0000 7f037fa8c700 1 -- start start 2023-10-08T15:42:22.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.858+0000 7f037fa8c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780b4860 0x7f03780b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.858+0000 7f037fa8c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f03780b3570 0x7f037815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.858+0000 7f037fa8c700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780b14f0 con 0x7f03780b4c30 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.858+0000 7f037fa8c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780b17d0 con 0x7f03780b3570 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.858+0000 7f037fa8c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780b1ab0 con 0x7f03780b4860 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037d027700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f03780b4c30 0x7f0378159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47966/0 (socket says 172.21.15.29:47966) 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037d027700 1 -- 172.21.15.29:0/1304104362 learned_addr learned my addr 172.21.15.29:0/1304104362 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037d828700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780b4860 0x7f03780b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037e029700 1 --2- 172.21.15.29:0/1304104362 >> v2:172.21.15.183:3300/0 conn(0x7f03780b3570 0x7f037815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871233511 0 0) 0x7f03780b14f0 con 0x7f03780b4c30 2023-10-08T15:42:22.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0360003570 con 0x7f03780b4c30 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2733807336 0 0) 0x7f0360003570 con 0x7f03780b4c30 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780b4860 msgr2=0x7f03780b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780b4860 0x7f03780b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 >> v2:172.21.15.183:3300/0 conn(0x7f03780b3570 msgr2=0x7f037815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 --2- 172.21.15.29:0/1304104362 >> v2:172.21.15.183:3300/0 conn(0x7f03780b3570 0x7f037815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780b1d90 con 0x7f03780b4c30 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7f036c001470 con 0x7f03780b4c30 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 >> v1:172.21.15.29:6789/0 conn(0x7f03780b4c30 legacy=0x7f0378159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780b4860 0x7f0360003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f0360004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0360004d50 0x7f03600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780b17d0 con 0x7f0360003fe0 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780b1ab0 con 0x7f0360004d50 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036000ba90 con 0x7f03780b4860 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037d027700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f0360004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037d828700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780b4860 0x7f0360003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.859+0000 7f037e029700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0360004d50 0x7f03600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037d027700 1 -- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780b4860 msgr2=0x7f0360003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037d027700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780b4860 0x7f0360003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037d027700 1 -- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0360004d50 msgr2=0x7f03600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:22.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037d027700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0360004d50 0x7f03600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037d027700 1 -- 172.21.15.29:0/1304104362 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0360003570 con 0x7f0360003fe0 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037d027700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f0360004810 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f036c00c3c0 tx=0x7f036c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c420a48568054b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00cc30 con 0x7f0360003fe0 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00cd90 con 0x7f0360003fe0 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037c826700 1 -- 172.21.15.29:0/1304104362 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c005b70 con 0x7f0360003fe0 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037fa8c700 1 -- 172.21.15.29:0/1304104362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 msgr2=0x7f0360004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037fa8c700 1 --2- 172.21.15.29:0/1304104362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f0360004810 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f036c00c3c0 tx=0x7f036c001e90 comp rx=0 tx=0).stop 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037e029700 1 -- 172.21.15.29:0/1304104362 reap_dead start 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037fa8c700 1 -- 172.21.15.29:0/1304104362 shutdown_connections 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.860+0000 7f037fa8c700 1 -- 172.21.15.29:0/1304104362 >> 172.21.15.29:0/1304104362 conn(0x7f037809a0f0 msgr2=0x7f0378067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.861+0000 7f037fa8c700 1 -- 172.21.15.29:0/1304104362 shutdown_connections 2023-10-08T15:42:22.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.861+0000 7f037fa8c700 1 -- 172.21.15.29:0/1304104362 wait complete. 2023-10-08T15:42:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037fa8c700 1 Processor -- start 2023-10-08T15:42:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037fa8c700 1 -- start start 2023-10-08T15:42:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037fa8c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f03780ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037fa8c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03781583c0 0x7f037809db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037fa8c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780ad590 0x7f03780ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037fa8c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780adf70 con 0x7f0360003fe0 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037fa8c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03780af750 con 0x7f03781583c0 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037fa8c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780aceb0 con 0x7f03780ad590 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.862+0000 7f037d828700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f03780ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d828700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f03780ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42056/0 (socket says 172.21.15.29:42056) 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d027700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03781583c0 0x7f037809db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d828700 1 -- 172.21.15.29:0/2391754769 learned_addr learned my addr 172.21.15.29:0/2391754769 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037e029700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780ad590 0x7f03780ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d828700 1 -- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780ad590 msgr2=0x7f03780ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d828700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780ad590 0x7f03780ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d828700 1 -- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03781583c0 msgr2=0x7f037809db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:22.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d828700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03781583c0 0x7f037809db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d828700 1 -- 172.21.15.29:0/2391754769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780afcf0 con 0x7f0360003fe0 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d027700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03781583c0 0x7f037809db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037d828700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f03780ab520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0370011b90 tx=0x7f0370009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f0375ffb700 1 -- 172.21.15.29:0/2391754769 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370005c10 con 0x7f0360003fe0 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f0375ffb700 1 -- 172.21.15.29:0/2391754769 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370005d70 con 0x7f0360003fe0 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03780ac930 con 0x7f0360003fe0 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f0375ffb700 1 -- 172.21.15.29:0/2391754769 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000f900 con 0x7f0360003fe0 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.863+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03780af980 con 0x7f0360003fe0 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.864+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037804c3c0 con 0x7f0360003fe0 2023-10-08T15:42:22.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.865+0000 7f0375ffb700 1 -- 172.21.15.29:0/2391754769 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f037000fd30 con 0x7f0360003fe0 2023-10-08T15:42:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.865+0000 7f0375ffb700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0364066f30 0x7f03640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.865+0000 7f0375ffb700 1 -- 172.21.15.29:0/2391754769 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0370084810 con 0x7f0360003fe0 2023-10-08T15:42:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.865+0000 7f037d027700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0364066f30 0x7f03640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.866+0000 7f037d027700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0364066f30 0x7f03640693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f03780d1dc0 tx=0x7f036c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:22.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:22.869+0000 7f0375ffb700 1 -- 172.21.15.29:0/2391754769 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0370051d80 con 0x7f0360003fe0 2023-10-08T15:42:23.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.061+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f03780b2070 con 0x7f0360003fe0 2023-10-08T15:42:23.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.065+0000 7f0375ffb700 1 -- 172.21.15.29:0/2391754769 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0370021020 con 0x7f0360003fe0 2023-10-08T15:42:23.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0364066f30 msgr2=0x7f03640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0364066f30 0x7f03640693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f03780d1dc0 tx=0x7f036c015000 comp rx=0 tx=0).stop 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 msgr2=0x7f03780ab520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f03780ab520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0370011b90 tx=0x7f0370009120 comp rx=0 tx=0).stop 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 shutdown_connections 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f0364066f30 0x7f03640693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f03780ad590 0x7f03780ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0360003fe0 0x7f03780ab520 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 --2- 172.21.15.29:0/2391754769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f03781583c0 0x7f037809db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 >> 172.21.15.29:0/2391754769 conn(0x7f037809a0f0 msgr2=0x7f0378158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 shutdown_connections 2023-10-08T15:42:23.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.067+0000 7f037fa8c700 1 -- 172.21.15.29:0/2391754769 wait complete. 2023-10-08T15:42:23.079 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T15:42:23.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:23.126 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T15:42:23.174 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T15:42:23.175 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T15:42:23.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.299+0000 7fec122ce700 1 Processor -- start 2023-10-08T15:42:23.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.299+0000 7fec122ce700 1 -- start start 2023-10-08T15:42:23.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec122ce700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fec0c0cdab0 0x7fec0c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec122ce700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c0cb7c0 con 0x7fec0c0cd6e0 2023-10-08T15:42:23.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec122ce700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c15e290 con 0x7fec0c15dda0 2023-10-08T15:42:23.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec122ce700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c15e850 con 0x7fec0c0cdab0 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec112cc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fec0c0cd6e0 0x7fec0c0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47968/0 (socket says 172.21.15.29:47968) 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec112cc700 1 -- 172.21.15.29:0/3556677922 learned_addr learned my addr 172.21.15.29:0/3556677922 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec10acb700 1 --2- 172.21.15.29:0/3556677922 >> v2:172.21.15.183:3300/0 conn(0x7fec0c0cdab0 0x7fec0c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181632609 0 0) 0x7fec0c0cb7c0 con 0x7fec0c0cd6e0 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.300+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf4003570 con 0x7fec0c0cd6e0 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2469708239 0 0) 0x7febf4003570 con 0x7fec0c0cd6e0 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 >> v2:172.21.15.183:3300/0 conn(0x7fec0c0cdab0 msgr2=0x7fec0c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 --2- 172.21.15.29:0/3556677922 >> v2:172.21.15.183:3300/0 conn(0x7fec0c0cdab0 0x7fec0c15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 >> v1:172.21.15.183:6789/0 conn(0x7fec0c15dda0 legacy=0x7fec0c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c15e570 con 0x7fec0c0cd6e0 2023-10-08T15:42:23.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7febfc0017f0 con 0x7fec0c0cd6e0 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec10acb700 1 --2- 172.21.15.29:0/3556677922 >> v2:172.21.15.183:3300/0 conn(0x7fec0c0cdab0 0x7fec0c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 >> v1:172.21.15.29:6789/0 conn(0x7fec0c0cd6e0 legacy=0x7fec0c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf4003a60 0x7febf4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febf4004810 0x7febf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf40051c0 0x7febf400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c15e850 con 0x7febf4003a60 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf400c0d0 con 0x7febf40051c0 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf400c290 con 0x7febf4004810 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec112cc700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf4003a60 0x7febf4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec10acb700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febf4004810 0x7febf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec11acd700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf40051c0 0x7febf400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec112cc700 1 -- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febf4004810 msgr2=0x7febf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec112cc700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febf4004810 0x7febf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec112cc700 1 -- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf40051c0 msgr2=0x7febf400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec112cc700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf40051c0 0x7febf400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec112cc700 1 -- 172.21.15.29:0/3556677922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4003570 con 0x7febf4003a60 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec11acd700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf40051c0 0x7febf400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec11acd700 1 -- 172.21.15.29:0/3556677922 reap_dead start 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.301+0000 7fec112cc700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf4003a60 0x7febf4003e70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7febfc00a930 tx=0x7febfc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f9318b46647a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0070d0 con 0x7febf4003a60 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc007270 con 0x7febf4003a60 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec0bfff700 1 -- 172.21.15.29:0/3556677922 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc007630 con 0x7febf4003a60 2023-10-08T15:42:23.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec122ce700 1 -- 172.21.15.29:0/3556677922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf4003a60 msgr2=0x7febf4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec122ce700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf4003a60 0x7febf4003e70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7febfc00a930 tx=0x7febfc0021d0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec122ce700 1 -- 172.21.15.29:0/3556677922 shutdown_connections 2023-10-08T15:42:23.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec122ce700 1 --2- 172.21.15.29:0/3556677922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febf4003a60 0x7febf4003e70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec122ce700 1 -- 172.21.15.29:0/3556677922 >> 172.21.15.29:0/3556677922 conn(0x7fec0c067660 msgr2=0x7fec0c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:23.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec122ce700 1 -- 172.21.15.29:0/3556677922 shutdown_connections 2023-10-08T15:42:23.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.302+0000 7fec122ce700 1 -- 172.21.15.29:0/3556677922 wait complete. 2023-10-08T15:42:23.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.303+0000 7fec122ce700 1 Processor -- start 2023-10-08T15:42:23.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.303+0000 7fec122ce700 1 -- start start 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec122ce700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf4003a60 0x7fec0c0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec122ce700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec0c15b910 0x7fec0c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec122ce700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0c0b5b60 0x7fec0c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec122ce700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0cc360 con 0x7fec0c15b910 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec122ce700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c15c3f0 con 0x7febf4003a60 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec122ce700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0b6510 con 0x7fec0c0b5b60 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec10acb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec0c15b910 0x7fec0c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec10acb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec0c15b910 0x7fec0c15bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42066/0 (socket says 172.21.15.29:42066) 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec10acb700 1 -- 172.21.15.29:0/4031441259 learned_addr learned my addr 172.21.15.29:0/4031441259 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.304+0000 7fec112cc700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf4003a60 0x7fec0c0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec11acd700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0c0b5b60 0x7fec0c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec10acb700 1 -- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0c0b5b60 msgr2=0x7fec0c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec10acb700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0c0b5b60 0x7fec0c0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec10acb700 1 -- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf4003a60 msgr2=0x7fec0c0afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec10acb700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf4003a60 0x7fec0c0afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec10acb700 1 -- 172.21.15.29:0/4031441259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0c87f0 con 0x7fec0c15b910 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec11acd700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0c0b5b60 0x7fec0c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec10acb700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec0c15b910 0x7fec0c15bd80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fec00011d70 tx=0x7fec000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec097fa700 1 -- 172.21.15.29:0/4031441259 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000fcd0 con 0x7fec0c15b910 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec097fa700 1 -- 172.21.15.29:0/4031441259 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000fe30 con 0x7fec0c15b910 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec097fa700 1 -- 172.21.15.29:0/4031441259 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00014670 con 0x7fec0c15b910 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c0b01f0 con 0x7fec0c15b910 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.305+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c0c81a0 con 0x7fec0c15b910 2023-10-08T15:42:23.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.306+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c0c8980 con 0x7fec0c15b910 2023-10-08T15:42:23.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.306+0000 7fec097fa700 1 -- 172.21.15.29:0/4031441259 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec00014aa0 con 0x7fec0c15b910 2023-10-08T15:42:23.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.307+0000 7fec097fa700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7febf8066f30 0x7febf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.307+0000 7fec097fa700 1 -- 172.21.15.29:0/4031441259 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fec00018030 con 0x7fec0c15b910 2023-10-08T15:42:23.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.307+0000 7fec112cc700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7febf8066f30 0x7febf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.307+0000 7fec112cc700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7febf8066f30 0x7febf80693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7febfc00a930 tx=0x7febfc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.311+0000 7fec097fa700 1 -- 172.21.15.29:0/4031441259 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec00052790 con 0x7fec0c15b910 2023-10-08T15:42:23.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.553+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec0c156740 con 0x7fec0c15b910 2023-10-08T15:42:23.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.553+0000 7fec097fa700 1 -- 172.21.15.29:0/4031441259 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fec00022de0 con 0x7fec0c15b910 2023-10-08T15:42:23.554 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:23.554 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1059454089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1059454089},{"type":"v1","addr":"172.21.15.29:6835","nonce":1059454089}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5191,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/179069614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":179069614},{"type":"v1","addr":"172.21.15.183:6836","nonce":179069614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2535837227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":2535837227},{"type":"v1","addr":"172.21.15.183:6837","nonce":2535837227}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/1150036175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1150036175},{"type":"v1","addr":"172.21.15.29:6834","nonce":1150036175}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-10-08T15:42:23.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7febf8066f30 msgr2=0x7febf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7febf8066f30 0x7febf80693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7febfc00a930 tx=0x7febfc016000 comp rx=0 tx=0).stop 2023-10-08T15:42:23.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec0c15b910 msgr2=0x7fec0c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec0c15b910 0x7fec0c15bd80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fec00011d70 tx=0x7fec000091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 shutdown_connections 2023-10-08T15:42:23.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7febf8066f30 0x7febf80693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec0c0b5b60 0x7fec0c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febf4003a60 0x7fec0c0afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 --2- 172.21.15.29:0/4031441259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec0c15b910 0x7fec0c15bd80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 >> 172.21.15.29:0/4031441259 conn(0x7fec0c067660 msgr2=0x7fec0c0c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:23.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 shutdown_connections 2023-10-08T15:42:23.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.555+0000 7fec122ce700 1 -- 172.21.15.29:0/4031441259 wait complete. 2023-10-08T15:42:23.557 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2023-10-08T15:42:23.568 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T15:42:23.568 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T15:42:23.568 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T15:42:23.568 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:42:23.569 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T15:42:23.569 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T15:42:23.569 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T15:42:23.569 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:42:23.569 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T15:42:23.569 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T15:42:23.569 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T15:42:23.570 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:42:23.570 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T15:42:23.570 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T15:42:23.570 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T15:42:23.570 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T15:42:23.577 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T15:42:23.577 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T15:42:23.578 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T15:42:23.578 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T15:42:23.580 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T15:42:23.580 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T15:42:23.581 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T15:42:23.581 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T15:42:23.620 INFO:tasks.ceph.mds.a:Started 2023-10-08T15:42:23.620 DEBUG:teuthology.parallel:result is None 2023-10-08T15:42:23.620 INFO:tasks.ceph.mds.c:Started 2023-10-08T15:42:23.621 DEBUG:teuthology.parallel:result is None 2023-10-08T15:42:23.623 INFO:tasks.ceph.mds.b:Started 2023-10-08T15:42:23.623 DEBUG:teuthology.parallel:result is None 2023-10-08T15:42:23.624 INFO:tasks.ceph.mds.d:Started 2023-10-08T15:42:23.624 DEBUG:teuthology.parallel:result is None 2023-10-08T15:42:23.624 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T15:42:23.696 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2023-10-08T15:42:23.696 INFO:tasks.ceph.mds.c.smithi029.stdout:starting mds.c at 2023-10-08T15:42:23.704 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-10-08T15:42:23.704 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-10-08T15:42:23.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.749+0000 7f42f9d57700 1 Processor -- start 2023-10-08T15:42:23.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.749+0000 7f42f9d57700 1 -- start start 2023-10-08T15:42:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9d57700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9d57700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f42f4069210 0x7f42f40af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9d57700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f415ea70 con 0x7f42f415a170 2023-10-08T15:42:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9d57700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40b3990 con 0x7f42f4069210 2023-10-08T15:42:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9d57700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40b0b70 con 0x7f42f4159da0 2023-10-08T15:42:23.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9556700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f42f4069210 0x7f42f40af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f3fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f42f415a170 0x7f42f4068b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47992/0 (socket says 172.21.15.29:47992) 2023-10-08T15:42:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f3fff700 1 -- 172.21.15.29:0/4218812880 learned_addr learned my addr 172.21.15.29:0/4218812880 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f8d55700 1 --2- 172.21.15.29:0/4218812880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9556700 1 -- 172.21.15.29:0/4218812880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 msgr2=0x7f42f40b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9556700 1 --2- 172.21.15.29:0/4218812880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9556700 1 -- 172.21.15.29:0/4218812880 >> v1:172.21.15.29:6789/0 conn(0x7f42f415a170 legacy=0x7f42f4068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9556700 1 -- 172.21.15.29:0/4218812880 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f415def0 con 0x7f42f4069210 2023-10-08T15:42:23.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f8d55700 1 --2- 172.21.15.29:0/4218812880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.750+0000 7f42f9556700 1 --2- 172.21.15.29:0/4218812880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f4069210 0x7f42f40af4a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0098e0 tx=0x7f42ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60e3c04c8d65e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f37fe700 1 -- 172.21.15.29:0/4218812880 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec009e80 con 0x7f42f4069210 2023-10-08T15:42:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f37fe700 1 -- 172.21.15.29:0/4218812880 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec00b860 con 0x7f42f4069210 2023-10-08T15:42:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f37fe700 1 -- 172.21.15.29:0/4218812880 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec00bbe0 con 0x7f42f4069210 2023-10-08T15:42:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f9d57700 1 -- 172.21.15.29:0/4218812880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f4069210 msgr2=0x7f42f40af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f9d57700 1 --2- 172.21.15.29:0/4218812880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f4069210 0x7f42f40af4a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0098e0 tx=0x7f42ec0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f9d57700 1 -- 172.21.15.29:0/4218812880 shutdown_connections 2023-10-08T15:42:23.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f9d57700 1 --2- 172.21.15.29:0/4218812880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f4069210 0x7f42f40af4a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f9d57700 1 --2- 172.21.15.29:0/4218812880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f9d57700 1 -- 172.21.15.29:0/4218812880 >> 172.21.15.29:0/4218812880 conn(0x7f42f40d0bc0 msgr2=0x7f42f40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:23.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f9d57700 1 -- 172.21.15.29:0/4218812880 shutdown_connections 2023-10-08T15:42:23.755 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.751+0000 7f42f9d57700 1 -- 172.21.15.29:0/4218812880 wait complete. 2023-10-08T15:42:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.752+0000 7f42f9d57700 1 Processor -- start 2023-10-08T15:42:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9d57700 1 -- start start 2023-10-08T15:42:23.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9d57700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42f4069210 0x7f42f40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9d57700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9d57700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f415a170 0x7f42f40b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9d57700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40c8db0 con 0x7f42f415a170 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9d57700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40ca540 con 0x7f42f4069210 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9d57700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40ca820 con 0x7f42f4159da0 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9556700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f415a170 0x7f42f40b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9556700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f415a170 0x7f42f40b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42090/0 (socket says 172.21.15.29:42090) 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.753+0000 7f42f9556700 1 -- 172.21.15.29:0/871217342 learned_addr learned my addr 172.21.15.29:0/871217342 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f8d55700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42f4069210 0x7f42f40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f3fff700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f9556700 1 -- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 msgr2=0x7f42f40c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f9556700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f9556700 1 -- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42f4069210 msgr2=0x7f42f40c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f9556700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42f4069210 0x7f42f40c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f9556700 1 -- 172.21.15.29:0/871217342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec009420 con 0x7f42f415a170 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f9556700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f415a170 0x7f42f40b4490 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f42f406b5c0 tx=0x7f42ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f0ff9700 1 -- 172.21.15.29:0/871217342 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec01f070 con 0x7f42f415a170 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f0ff9700 1 -- 172.21.15.29:0/871217342 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec002f30 con 0x7f42f415a170 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f0ff9700 1 -- 172.21.15.29:0/871217342 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec025420 con 0x7f42f415a170 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f41584f0 con 0x7f42f415a170 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.754+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f40c7230 con 0x7f42f415a170 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.755+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f40caa40 con 0x7f42f415a170 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.755+0000 7f42f0ff9700 1 -- 172.21.15.29:0/871217342 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42ec023070 con 0x7f42f415a170 2023-10-08T15:42:23.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.756+0000 7f42f0ff9700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f42d4066f60 0x7f42d4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:23.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.756+0000 7f42f0ff9700 1 -- 172.21.15.29:0/871217342 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f42ec0857c0 con 0x7f42f415a170 2023-10-08T15:42:23.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.756+0000 7f42f8d55700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f42d4066f60 0x7f42d4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:23.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.757+0000 7f42f8d55700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f42d4066f60 0x7f42d4069410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00adc0 tx=0x7f42dc006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:23.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.761+0000 7f42f0ff9700 1 -- 172.21.15.29:0/871217342 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42ec052d30 con 0x7f42f415a170 2023-10-08T15:42:23.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:23.972+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f42f40c8ef0 con 0x7f42f415a170 2023-10-08T15:42:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.593+0000 7f42f0ff9700 1 -- 172.21.15.29:0/871217342 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f42ec02a080 con 0x7f42f415a170 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f42d4066f60 msgr2=0x7f42d4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f42d4066f60 0x7f42d4069410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00adc0 tx=0x7f42dc006f90 comp rx=0 tx=0).stop 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f415a170 msgr2=0x7f42f40b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f415a170 0x7f42f40b4490 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f42f406b5c0 tx=0x7f42ec017000 comp rx=0 tx=0).stop 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 shutdown_connections 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f42d4066f60 0x7f42d4069410 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42f415a170 0x7f42f40b4490 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42f4069210 0x7f42f40c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 --2- 172.21.15.29:0/871217342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42f4159da0 0x7f42f40c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 >> 172.21.15.29:0/871217342 conn(0x7f42f40d0bc0 msgr2=0x7f42f40cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 shutdown_connections 2023-10-08T15:42:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.595+0000 7f42f9d57700 1 -- 172.21.15.29:0/871217342 wait complete. 2023-10-08T15:42:24.597 INFO:teuthology.orchestra.run.smithi029.stderr: removed all blocklist entries 2023-10-08T15:42:24.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T15:42:24.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.733+0000 7f1e8817e700 1 Processor -- start 2023-10-08T15:42:24.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.733+0000 7f1e8817e700 1 -- start start 2023-10-08T15:42:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.733+0000 7f1e8817e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e8015a2b0 0x7f1e800b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e8817e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e800c5d80 con 0x7f1e800cfe20 2023-10-08T15:42:24.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e8817e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e800c6060 con 0x7f1e800d1c30 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e8817e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80068470 con 0x7f1e8015a2b0 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e8671b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1e800cfe20 0x7f1e800c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:47998/0 (socket says 172.21.15.29:47998) 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e8671b700 1 -- 172.21.15.29:0/600956737 learned_addr learned my addr 172.21.15.29:0/600956737 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e85f1a700 1 --2- 172.21.15.29:0/600956737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e8015a2b0 0x7f1e800b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e84f18700 1 -- 172.21.15.29:0/600956737 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220674568 0 0) 0x7f1e800c5d80 con 0x7f1e800cfe20 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e84f18700 1 -- 172.21.15.29:0/600956737 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e68003570 con 0x7f1e800cfe20 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e84f18700 1 -- 172.21.15.29:0/600956737 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216472748 0 0) 0x7f1e800c6060 con 0x7f1e800d1c30 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e84f18700 1 -- 172.21.15.29:0/600956737 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e800c5d80 con 0x7f1e800d1c30 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e85f1a700 1 -- 172.21.15.29:0/600956737 >> v1:172.21.15.183:6789/0 conn(0x7f1e800d1c30 legacy=0x7f1e800cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e84f18700 1 -- 172.21.15.29:0/600956737 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2289202202 0 0) 0x7f1e68003570 con 0x7f1e800cfe20 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e85f1a700 1 -- 172.21.15.29:0/600956737 >> v1:172.21.15.29:6789/0 conn(0x7f1e800cfe20 legacy=0x7f1e800c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e85f1a700 1 -- 172.21.15.29:0/600956737 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800c6340 con 0x7f1e8015a2b0 2023-10-08T15:42:24.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.734+0000 7f1e85f1a700 1 --2- 172.21.15.29:0/600956737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e8015a2b0 0x7f1e800b3da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009ee0 tx=0x7f1e78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89f2a3bb89ee9fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e84f18700 1 -- 172.21.15.29:0/600956737 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800e070 con 0x7f1e8015a2b0 2023-10-08T15:42:24.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e84f18700 1 -- 172.21.15.29:0/600956737 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7800b870 con 0x7f1e8015a2b0 2023-10-08T15:42:24.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e84f18700 1 -- 172.21.15.29:0/600956737 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70001470 con 0x7f1e8015a2b0 2023-10-08T15:42:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e8817e700 1 -- 172.21.15.29:0/600956737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e8015a2b0 msgr2=0x7f1e800b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e8817e700 1 --2- 172.21.15.29:0/600956737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e8015a2b0 0x7f1e800b3da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009ee0 tx=0x7f1e78009780 comp rx=0 tx=0).stop 2023-10-08T15:42:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e8817e700 1 -- 172.21.15.29:0/600956737 shutdown_connections 2023-10-08T15:42:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e8817e700 1 --2- 172.21.15.29:0/600956737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e8015a2b0 0x7f1e800b3da0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e8817e700 1 -- 172.21.15.29:0/600956737 >> 172.21.15.29:0/600956737 conn(0x7f1e80067e40 msgr2=0x7f1e800d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e8817e700 1 -- 172.21.15.29:0/600956737 shutdown_connections 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.735+0000 7f1e8817e700 1 -- 172.21.15.29:0/600956737 wait complete. 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.736+0000 7f1e8817e700 1 Processor -- start 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.736+0000 7f1e8817e700 1 -- start start 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e8817e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e800cfe20 0x7f1e80155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e8817e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e800d1c30 0x7f1e8015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e8817e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e8015a2b0 0x7f1e8015d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e8817e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8015fb90 con 0x7f1e800d1c30 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e8817e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800c8810 con 0x7f1e8015a2b0 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e8817e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8015f8b0 con 0x7f1e800cfe20 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e85719700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e800d1c30 0x7f1e8015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e85719700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e800d1c30 0x7f1e8015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42092/0 (socket says 172.21.15.29:42092) 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e85719700 1 -- 172.21.15.29:0/2856384387 learned_addr learned my addr 172.21.15.29:0/2856384387 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e85f1a700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e800cfe20 0x7f1e80155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.737+0000 7f1e8671b700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e8015a2b0 0x7f1e8015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e85719700 1 -- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e800cfe20 msgr2=0x7f1e80155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e85719700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e800cfe20 0x7f1e80155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e85719700 1 -- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e8015a2b0 msgr2=0x7f1e8015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e85719700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e8015a2b0 0x7f1e8015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e85719700 1 -- 172.21.15.29:0/2856384387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78009a20 con 0x7f1e800d1c30 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e8671b700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e8015a2b0 0x7f1e8015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e85719700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e800d1c30 0x7f1e8015d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c590 tx=0x7f1e74007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e7dffb700 1 -- 172.21.15.29:0/2856384387 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400f540 con 0x7f1e800d1c30 2023-10-08T15:42:24.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e7dffb700 1 -- 172.21.15.29:0/2856384387 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400f6c0 con 0x7f1e800d1c30 2023-10-08T15:42:24.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e800c81c0 con 0x7f1e800d1c30 2023-10-08T15:42:24.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e7dffb700 1 -- 172.21.15.29:0/2856384387 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400fa80 con 0x7f1e800d1c30 2023-10-08T15:42:24.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.738+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e80156180 con 0x7f1e800d1c30 2023-10-08T15:42:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.739+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8004c3c0 con 0x7f1e800d1c30 2023-10-08T15:42:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.739+0000 7f1e7dffb700 1 -- 172.21.15.29:0/2856384387 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e7401b3b0 con 0x7f1e800d1c30 2023-10-08T15:42:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.740+0000 7f1e7dffb700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e6c066f30 0x7f1e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.740+0000 7f1e7dffb700 1 -- 172.21.15.29:0/2856384387 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1e74083a20 con 0x7f1e800d1c30 2023-10-08T15:42:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.740+0000 7f1e85f1a700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e6c066f30 0x7f1e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:24.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.741+0000 7f1e85f1a700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e6c066f30 0x7f1e6c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097c0 tx=0x7f1e78017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:24.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:24.744+0000 7f1e7dffb700 1 -- 172.21.15.29:0/2856384387 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e74050fe0 con 0x7f1e800d1c30 2023-10-08T15:42:24.880 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:24.883 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T15:42:25.020 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.020+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1e80089fa0 con 0x7f1e800d1c30 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.020+0000 7f1e7dffb700 1 -- 172.21.15.29:0/2856384387 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1e74017020 con 0x7f1e800d1c30 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_dump": [ 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.a", 2023-10-08T15:42:25.021 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlYRZwCRAAGoAPqAnl5NDkgFSuSAb0dQ==", 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.b", 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlXJDaFBAAC2AbAwL8n7M+sYYTc2TPsw==", 2023-10-08T15:42:25.022 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.c", 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl2PBqEBAAFdiMT6RrjHdj7SRjAbP4sQ==", 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:42:25.023 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mds.d", 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlsZmxGxAA36NsIsK3XcPqbAnnT92G0Q==", 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:42:25.024 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.0", 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlbwxYCxAAi9e56N5uN63J7J+CFrotmQ==", 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.025 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.1", 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlrFhCEhAAkg2cwfL0v9izcWZW8IkKvA==", 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.026 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.2", 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlb/xdGxAAXhOqn1ZfBDqVNynmIESgsQ==", 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.3", 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBPzSJlmaSCJBAAD0mbJDLpY+XnpBfW+PxKwg==", 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.027 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.4", 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBSzSJlostbMhAADG+AgRpi1nAPh9OYWKfmXg==", 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.028 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.5", 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBSzSJlEG4vORAA0iGg702OP3gHtLsYax/jeg==", 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.6", 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTzSJlshaZBhAAe3VfHlxRqfigbN61EJnizg==", 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "osd.7", 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBTzSJlvFS/DxAAOFmLFOOLsMk+glMEkwb+0A==", 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.030 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow profile osd", 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile osd", 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.0", 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl89iQHxAA+CyqKmHWtMkmRiZd82Bm+A==", 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow r", 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T15:42:25.031 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.1", 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlldcVKBAAZKujKb3x/HYn/QzJ0/iUGA==", 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.032 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.2", 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlyMQQJRAA4Wz0XqtCvc38O4gm+T+Ipw==", 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.3", 2023-10-08T15:42:25.033 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJl5494LRAAMVyV+XR9M7FmtYcUMmZNSA==", 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow", 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow r", 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow rw", 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow rwx" 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "client.admin", 2023-10-08T15:42:25.034 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBMzSJlYMULKhAArem31P8khIAGuU9Fghu/tA==", 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": "allow *", 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow *", 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.x", 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlvI5NBhAAgIljkxa68BKP6MhsV8a5kA==", 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.035 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: "entity": "mgr.y", 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "AQBNzSJlAiPhAhAAP7NTLjG1tB3zd69Xz9z/Dw==", 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": { 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": "allow *", 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": "allow profile mgr", 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": "allow *" 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.036 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:25.037 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-10-08T15:42:25.037 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-10-08T15:42:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e6c066f30 msgr2=0x7f1e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e6c066f30 0x7f1e6c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097c0 tx=0x7f1e78017000 comp rx=0 tx=0).stop 2023-10-08T15:42:25.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e800d1c30 msgr2=0x7f1e8015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e800d1c30 0x7f1e8015d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c590 tx=0x7f1e74007de0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 shutdown_connections 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f1e6c066f30 0x7f1e6c0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e8015a2b0 0x7f1e8015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e800cfe20 0x7f1e80155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 --2- 172.21.15.29:0/2856384387 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e800d1c30 0x7f1e8015d330 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 >> 172.21.15.29:0/2856384387 conn(0x7f1e80067e40 msgr2=0x7f1e800cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 shutdown_connections 2023-10-08T15:42:25.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.023+0000 7f1e8817e700 1 -- 172.21.15.29:0/2856384387 wait complete. 2023-10-08T15:42:25.040 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:25.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.158+0000 7fd016c19700 1 Processor -- start 2023-10-08T15:42:25.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.158+0000 7fd016c19700 1 -- start start 2023-10-08T15:42:25.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.158+0000 7fd016c19700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd010164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.158+0000 7fd016c19700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01015db80 con 0x7fd01015a1e0 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.158+0000 7fd016c19700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01015de60 con 0x7fd010159e10 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.158+0000 7fd016c19700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01015e800 con 0x7fd0100b3430 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd01015a1e0 0x7fd0100cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48014/0 (socket says 172.21.15.29:48014) 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00ffff700 1 -- 172.21.15.29:0/138294608 learned_addr learned my addr 172.21.15.29:0/138294608 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd0151b6700 1 --2- 172.21.15.29:0/138294608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd010164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00f7fe700 1 -- 172.21.15.29:0/138294608 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154237839 0 0) 0x7fd01015db80 con 0x7fd01015a1e0 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00f7fe700 1 -- 172.21.15.29:0/138294608 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcffc003570 con 0x7fd01015a1e0 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00f7fe700 1 -- 172.21.15.29:0/138294608 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743689461 0 0) 0x7fd01015de60 con 0x7fd010159e10 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00f7fe700 1 -- 172.21.15.29:0/138294608 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd01015db80 con 0x7fd010159e10 2023-10-08T15:42:25.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd0151b6700 1 -- 172.21.15.29:0/138294608 >> v1:172.21.15.183:6789/0 conn(0x7fd010159e10 legacy=0x7fd0100b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd0151b6700 1 -- 172.21.15.29:0/138294608 >> v1:172.21.15.29:6789/0 conn(0x7fd01015a1e0 legacy=0x7fd0100cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd0151b6700 1 -- 172.21.15.29:0/138294608 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01015e140 con 0x7fd0100b3430 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd0151b6700 1 --2- 172.21.15.29:0/138294608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd010164e20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd008009e90 tx=0x7fd008009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ee2d0011e025d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00f7fe700 1 -- 172.21.15.29:0/138294608 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800e070 con 0x7fd0100b3430 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00f7fe700 1 -- 172.21.15.29:0/138294608 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00800bb80 con 0x7fd0100b3430 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.159+0000 7fd00f7fe700 1 -- 172.21.15.29:0/138294608 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008012430 con 0x7fd0100b3430 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.160+0000 7fd016c19700 1 -- 172.21.15.29:0/138294608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 msgr2=0x7fd010164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.160+0000 7fd016c19700 1 --2- 172.21.15.29:0/138294608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd010164e20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd008009e90 tx=0x7fd008009780 comp rx=0 tx=0).stop 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.160+0000 7fd016c19700 1 -- 172.21.15.29:0/138294608 shutdown_connections 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.160+0000 7fd016c19700 1 --2- 172.21.15.29:0/138294608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd010164e20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.160+0000 7fd016c19700 1 -- 172.21.15.29:0/138294608 >> 172.21.15.29:0/138294608 conn(0x7fd010067660 msgr2=0x7fd010067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:25.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.160+0000 7fd016c19700 1 -- 172.21.15.29:0/138294608 shutdown_connections 2023-10-08T15:42:25.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.160+0000 7fd016c19700 1 -- 172.21.15.29:0/138294608 wait complete. 2023-10-08T15:42:25.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.161+0000 7fd016c19700 1 Processor -- start 2023-10-08T15:42:25.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.161+0000 7fd016c19700 1 -- start start 2023-10-08T15:42:25.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd016c19700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd0100d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd016c19700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd010159e10 0x7fd010156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd016c19700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd01015a1e0 0x7fd01015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd016c19700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0100c6ae0 con 0x7fd01015a1e0 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd016c19700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0100c5ed0 con 0x7fd010159e10 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd016c19700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0100c61b0 con 0x7fd0100b3430 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd0151b6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd01015a1e0 0x7fd01015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd0151b6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd01015a1e0 0x7fd01015c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42094/0 (socket says 172.21.15.29:42094) 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd0151b6700 1 -- 172.21.15.29:0/648634313 learned_addr learned my addr 172.21.15.29:0/648634313 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd0149b5700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd0100d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd00ffff700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd010159e10 0x7fd010156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd0151b6700 1 -- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 msgr2=0x7fd0100d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd0151b6700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd0100d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd0151b6700 1 -- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd010159e10 msgr2=0x7fd010156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.162+0000 7fd0151b6700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd010159e10 0x7fd010156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.163+0000 7fd0151b6700 1 -- 172.21.15.29:0/648634313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008009a20 con 0x7fd01015a1e0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.163+0000 7fd0151b6700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd01015a1e0 0x7fd01015c900 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd010089c80 tx=0x7fd008019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.163+0000 7fd00cff9700 1 -- 172.21.15.29:0/648634313 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008012e00 con 0x7fd01015a1e0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.163+0000 7fd00cff9700 1 -- 172.21.15.29:0/648634313 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00801b630 con 0x7fd01015a1e0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.163+0000 7fd00cff9700 1 -- 172.21.15.29:0/648634313 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00801b9f0 con 0x7fd01015a1e0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.163+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0100c6490 con 0x7fd01015a1e0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.163+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0100c6f70 con 0x7fd01015a1e0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.164+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0100c6c90 con 0x7fd01015a1e0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.164+0000 7fd00cff9700 1 -- 172.21.15.29:0/648634313 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0080253f0 con 0x7fd01015a1e0 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.165+0000 7fd00cff9700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcff0066f30 0x7fcff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.165+0000 7fd00cff9700 1 -- 172.21.15.29:0/648634313 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd008085ba0 con 0x7fd01015a1e0 2023-10-08T15:42:25.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.165+0000 7fd0149b5700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcff0066f30 0x7fcff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.165+0000 7fd0149b5700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcff0066f30 0x7fcff00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcff8003870 tx=0x7fcff8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.169+0000 7fd00cff9700 1 -- 172.21.15.29:0/648634313 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0100c6c90 con 0x7fd01015a1e0 2023-10-08T15:42:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.361+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd01004c3c0 con 0x7fd01015a1e0 2023-10-08T15:42:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.362+0000 7fd00cff9700 1 -- 172.21.15.29:0/648634313 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fd008056ca0 con 0x7fd01015a1e0 2023-10-08T15:42:25.362 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:25.363 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":61,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:42:24.597716+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:25.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcff0066f30 msgr2=0x7fcff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcff0066f30 0x7fcff00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcff8003870 tx=0x7fcff8009040 comp rx=0 tx=0).stop 2023-10-08T15:42:25.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd01015a1e0 msgr2=0x7fd01015c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd01015a1e0 0x7fd01015c900 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd010089c80 tx=0x7fd008019000 comp rx=0 tx=0).stop 2023-10-08T15:42:25.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 shutdown_connections 2023-10-08T15:42:25.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcff0066f30 0x7fcff00693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd01015a1e0 0x7fd01015c900 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0100b3430 0x7fd0100d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 --2- 172.21.15.29:0/648634313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd010159e10 0x7fd010156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 >> 172.21.15.29:0/648634313 conn(0x7fd010067660 msgr2=0x7fd0100b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:25.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 shutdown_connections 2023-10-08T15:42:25.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.364+0000 7fd016c19700 1 -- 172.21.15.29:0/648634313 wait complete. 2023-10-08T15:42:25.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T15:40:12.381633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T15:42:25.377 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T15:42:25.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.498+0000 7fbd9e7f0700 1 Processor -- start 2023-10-08T15:42:25.499 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.498+0000 7fbd9e7f0700 1 -- start start 2023-10-08T15:42:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9e7f0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 0x7fbd9815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9e7f0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd9815ac10 0x7fbd980cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9e7f0700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbd980cb970 0x7fbd9815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9e7f0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd980cc760 con 0x7fbd9815ac10 2023-10-08T15:42:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9e7f0700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9815b460 con 0x7fbd980cb970 2023-10-08T15:42:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9e7f0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9815ba20 con 0x7fbd9815a300 2023-10-08T15:42:25.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd9815ac10 0x7fbd980cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbd9815ac10 0x7fbd980cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42098/0 (socket says 172.21.15.29:42098) 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 -- 172.21.15.29:0/4291845014 learned_addr learned my addr 172.21.15.29:0/4291845014 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9dfef700 1 --2- 172.21.15.29:0/4291845014 >> v2:172.21.15.183:3300/0 conn(0x7fbd980cb970 0x7fbd9815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9d7ee700 1 --2- 172.21.15.29:0/4291845014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 0x7fbd9815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 -- 172.21.15.29:0/4291845014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 msgr2=0x7fbd9815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 --2- 172.21.15.29:0/4291845014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 0x7fbd9815a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 -- 172.21.15.29:0/4291845014 >> v2:172.21.15.183:3300/0 conn(0x7fbd980cb970 msgr2=0x7fbd9815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 --2- 172.21.15.29:0/4291845014 >> v2:172.21.15.183:3300/0 conn(0x7fbd980cb970 0x7fbd9815beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 -- 172.21.15.29:0/4291845014 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd980cc1a0 con 0x7fbd9815ac10 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.499+0000 7fbd9cfed700 1 --2- 172.21.15.29:0/4291845014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd9815ac10 0x7fbd980cb430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbd9808aef0 tx=0x7fbd94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9af773b36bf597b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd8bfff700 1 -- 172.21.15.29:0/4291845014 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400b860 con 0x7fbd9815ac10 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd8bfff700 1 -- 172.21.15.29:0/4291845014 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9400b9c0 con 0x7fbd9815ac10 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd8bfff700 1 -- 172.21.15.29:0/4291845014 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400bd60 con 0x7fbd9815ac10 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/4291845014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd9815ac10 msgr2=0x7fbd980cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/4291845014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd9815ac10 0x7fbd980cb430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbd9808aef0 tx=0x7fbd94009250 comp rx=0 tx=0).stop 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/4291845014 shutdown_connections 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/4291845014 >> v2:172.21.15.183:3300/0 conn(0x7fbd980cb970 0x7fbd9815beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/4291845014 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 0x7fbd9815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/4291845014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd9815ac10 0x7fbd980cb430 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/4291845014 >> 172.21.15.29:0/4291845014 conn(0x7fbd98099f50 msgr2=0x7fbd98067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:25.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/4291845014 shutdown_connections 2023-10-08T15:42:25.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.500+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/4291845014 wait complete. 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.501+0000 7fbd9e7f0700 1 Processor -- start 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.501+0000 7fbd9e7f0700 1 -- start start 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9e7f0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd980cb970 0x7fbd981696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9e7f0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 0x7fbd980c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9e7f0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9815ac10 0x7fbd980aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9e7f0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980b1be0 con 0x7fbd980cb970 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9e7f0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980b1ec0 con 0x7fbd9815ac10 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9e7f0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd980b21a0 con 0x7fbd9815a300 2023-10-08T15:42:25.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9d7ee700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd980cb970 0x7fbd981696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9d7ee700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd980cb970 0x7fbd981696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42112/0 (socket says 172.21.15.29:42112) 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9cfed700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 0x7fbd980c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9d7ee700 1 -- 172.21.15.29:0/2798081746 learned_addr learned my addr 172.21.15.29:0/2798081746 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.502+0000 7fbd9dfef700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9815ac10 0x7fbd980aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd9d7ee700 1 -- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 msgr2=0x7fbd980c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd9d7ee700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 0x7fbd980c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd9d7ee700 1 -- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9815ac10 msgr2=0x7fbd980aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd9d7ee700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9815ac10 0x7fbd980aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd9d7ee700 1 -- 172.21.15.29:0/2798081746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd940094f0 con 0x7fbd980cb970 2023-10-08T15:42:25.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd9d7ee700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd980cb970 0x7fbd981696d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00d810 tx=0x7fbd8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd897fa700 1 -- 172.21.15.29:0/2798081746 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0125f0 con 0x7fbd980cb970 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd897fa700 1 -- 172.21.15.29:0/2798081746 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c012750 con 0x7fbd980cb970 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd897fa700 1 -- 172.21.15.29:0/2798081746 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c012b10 con 0x7fbd980cb970 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd980b2480 con 0x7fbd980cb970 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.503+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd98169c10 con 0x7fbd980cb970 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.504+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9806ada0 con 0x7fbd980cb970 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.505+0000 7fbd897fa700 1 -- 172.21.15.29:0/2798081746 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd8c01e460 con 0x7fbd980cb970 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.505+0000 7fbd897fa700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbd7c066f30 0x7fbd7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.505+0000 7fbd897fa700 1 -- 172.21.15.29:0/2798081746 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbd8c0847a0 con 0x7fbd980cb970 2023-10-08T15:42:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.505+0000 7fbd9cfed700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbd7c066f30 0x7fbd7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.506+0000 7fbd9cfed700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbd7c066f30 0x7fbd7c0693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd9808aef0 tx=0x7fbd94017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.509+0000 7fbd897fa700 1 -- 172.21.15.29:0/2798081746 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd8c051d60 con 0x7fbd980cb970 2023-10-08T15:42:25.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.703+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd980cc480 con 0x7fbd980cb970 2023-10-08T15:42:25.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.704+0000 7fbd897fa700 1 -- 172.21.15.29:0/2798081746 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd8c055380 con 0x7fbd980cb970 2023-10-08T15:42:25.704 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-10-08T15:42:25.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbd7c066f30 msgr2=0x7fbd7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbd7c066f30 0x7fbd7c0693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd9808aef0 tx=0x7fbd94017000 comp rx=0 tx=0).stop 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd980cb970 msgr2=0x7fbd981696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd980cb970 0x7fbd981696d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00d810 tx=0x7fbd8c008040 comp rx=0 tx=0).stop 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 shutdown_connections 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fbd7c066f30 0x7fbd7c0693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9815ac10 0x7fbd980aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd980cb970 0x7fbd981696d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 --2- 172.21.15.29:0/2798081746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9815a300 0x7fbd980c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 >> 172.21.15.29:0/2798081746 conn(0x7fbd98099f50 msgr2=0x7fbd980cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:25.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 shutdown_connections 2023-10-08T15:42:25.708 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.706+0000 7fbd9e7f0700 1 -- 172.21.15.29:0/2798081746 wait complete. 2023-10-08T15:42:25.718 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T15:42:25.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.837+0000 7f61fa061700 1 Processor -- start 2023-10-08T15:42:25.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.837+0000 7f61fa061700 1 -- start start 2023-10-08T15:42:25.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61fa061700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61f4157fd0 0x7f61f40cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61fa061700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f61f40ca2f0 0x7f61f40c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61fa061700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f40ca890 con 0x7f61f4157c00 2023-10-08T15:42:25.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61fa061700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f40cb4f0 con 0x7f61f4157fd0 2023-10-08T15:42:25.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61fa061700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f40cbec0 con 0x7f61f40ca2f0 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f2ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61f4157fd0 0x7f61f40cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f2ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f61f4157fd0 0x7f61f40cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42126/0 (socket says 172.21.15.29:42126) 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f2ffd700 1 -- 172.21.15.29:0/1838142231 learned_addr learned my addr 172.21.15.29:0/1838142231 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f3fff700 1 --2- 172.21.15.29:0/1838142231 >> v2:172.21.15.183:3300/0 conn(0x7f61f40ca2f0 0x7f61f40c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f2ffd700 1 -- 172.21.15.29:0/1838142231 >> v2:172.21.15.183:3300/0 conn(0x7f61f40ca2f0 msgr2=0x7f61f40c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f2ffd700 1 --2- 172.21.15.29:0/1838142231 >> v2:172.21.15.183:3300/0 conn(0x7f61f40ca2f0 0x7f61f40c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f2ffd700 1 -- 172.21.15.29:0/1838142231 >> v1:172.21.15.183:6789/0 conn(0x7f61f4157c00 legacy=0x7f61f415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f2ffd700 1 -- 172.21.15.29:0/1838142231 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40cabc0 con 0x7f61f4157fd0 2023-10-08T15:42:25.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f3fff700 1 --2- 172.21.15.29:0/1838142231 >> v2:172.21.15.183:3300/0 conn(0x7f61f40ca2f0 0x7f61f40c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.838+0000 7f61f2ffd700 1 --2- 172.21.15.29:0/1838142231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f4157fd0 0x7f61f40cb980 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f61f40c9060 tx=0x7f61e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc453a3d18ee2a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61f27fc700 1 -- 172.21.15.29:0/1838142231 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800b860 con 0x7f61f4157fd0 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61f27fc700 1 -- 172.21.15.29:0/1838142231 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e800b9c0 con 0x7f61f4157fd0 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61f27fc700 1 -- 172.21.15.29:0/1838142231 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800bd60 con 0x7f61f4157fd0 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61fa061700 1 -- 172.21.15.29:0/1838142231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f4157fd0 msgr2=0x7f61f40cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61fa061700 1 --2- 172.21.15.29:0/1838142231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f4157fd0 0x7f61f40cb980 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f61f40c9060 tx=0x7f61e8009250 comp rx=0 tx=0).stop 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61fa061700 1 -- 172.21.15.29:0/1838142231 shutdown_connections 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61fa061700 1 --2- 172.21.15.29:0/1838142231 >> v2:172.21.15.183:3300/0 conn(0x7f61f40ca2f0 0x7f61f40c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.842 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61fa061700 1 --2- 172.21.15.29:0/1838142231 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f4157fd0 0x7f61f40cb980 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61fa061700 1 -- 172.21.15.29:0/1838142231 >> 172.21.15.29:0/1838142231 conn(0x7f61f4069870 msgr2=0x7f61f4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:25.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61fa061700 1 -- 172.21.15.29:0/1838142231 shutdown_connections 2023-10-08T15:42:25.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.839+0000 7f61fa061700 1 -- 172.21.15.29:0/1838142231 wait complete. 2023-10-08T15:42:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.840+0000 7f61fa061700 1 Processor -- start 2023-10-08T15:42:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.840+0000 7f61fa061700 1 -- start start 2023-10-08T15:42:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61fa061700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f40ca2f0 0x7f61f40c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61fa061700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61f4157c00 0x7f61f40c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61fa061700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61f4157fd0 0x7f61f4145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61fa061700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40c3ca0 con 0x7f61f40ca2f0 2023-10-08T15:42:25.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61fa061700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40c3f80 con 0x7f61f4157c00 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61fa061700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40c4260 con 0x7f61f4157fd0 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61f37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f40ca2f0 0x7f61f40c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61f37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f40ca2f0 0x7f61f40c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42134/0 (socket says 172.21.15.29:42134) 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61f37fe700 1 -- 172.21.15.29:0/2922665891 learned_addr learned my addr 172.21.15.29:0/2922665891 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61f2ffd700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61f4157c00 0x7f61f40c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.841+0000 7f61f3fff700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61f4157fd0 0x7f61f4145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61f37fe700 1 -- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61f4157fd0 msgr2=0x7f61f4145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61f37fe700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61f4157fd0 0x7f61f4145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61f37fe700 1 -- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61f4157c00 msgr2=0x7f61f40c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61f37fe700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61f4157c00 0x7f61f40c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61f37fe700 1 -- 172.21.15.29:0/2922665891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80094f0 con 0x7f61f40ca2f0 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61f37fe700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f40ca2f0 0x7f61f40c36c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c590 tx=0x7f61e400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61db7fe700 1 -- 172.21.15.29:0/2922665891 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4011590 con 0x7f61f40ca2f0 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61db7fe700 1 -- 172.21.15.29:0/2922665891 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4011710 con 0x7f61f40ca2f0 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f40c4540 con 0x7f61f40ca2f0 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61db7fe700 1 -- 172.21.15.29:0/2922665891 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4011ad0 con 0x7f61f40ca2f0 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.842+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f40c88d0 con 0x7f61f40ca2f0 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.843+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f40c4a60 con 0x7f61f40ca2f0 2023-10-08T15:42:25.848 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.843+0000 7f61db7fe700 1 -- 172.21.15.29:0/2922665891 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61e401b3b0 con 0x7f61f40ca2f0 2023-10-08T15:42:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.844+0000 7f61db7fe700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f61e0066f30 0x7f61e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.844+0000 7f61db7fe700 1 -- 172.21.15.29:0/2922665891 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f61e4083710 con 0x7f61f40ca2f0 2023-10-08T15:42:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.844+0000 7f61f2ffd700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f61e0066f30 0x7f61e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.844+0000 7f61f2ffd700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f61e0066f30 0x7f61e00693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f61f40c9060 tx=0x7f61e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:25.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:25.848+0000 7f61db7fe700 1 -- 172.21.15.29:0/2922665891 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61f40c4a60 con 0x7f61f40ca2f0 2023-10-08T15:42:26.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.042+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f61f40c4a60 con 0x7f61f40ca2f0 2023-10-08T15:42:26.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.042+0000 7f61db7fe700 1 -- 172.21.15.29:0/2922665891 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+65 (secure 0 0 0) 0x7f61f40c4a60 con 0x7f61f40ca2f0 2023-10-08T15:42:26.043 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:26.043 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2023-10-08T15:42:26.043 INFO:teuthology.orchestra.run.smithi029.stdout: { 2023-10-08T15:42:26.043 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2023-10-08T15:42:26.043 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2023-10-08T15:42:26.043 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-10-08T15:42:26.044 INFO:teuthology.orchestra.run.smithi029.stdout:] 2023-10-08T15:42:26.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f61e0066f30 msgr2=0x7f61e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f61e0066f30 0x7f61e00693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f61f40c9060 tx=0x7f61e8017000 comp rx=0 tx=0).stop 2023-10-08T15:42:26.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f40ca2f0 msgr2=0x7f61f40c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f40ca2f0 0x7f61f40c36c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c590 tx=0x7f61e400c8a0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 shutdown_connections 2023-10-08T15:42:26.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f61e0066f30 0x7f61e00693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61f4157fd0 0x7f61f4145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61f40ca2f0 0x7f61f40c36c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 --2- 172.21.15.29:0/2922665891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61f4157c00 0x7f61f40c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 >> 172.21.15.29:0/2922665891 conn(0x7f61f4069870 msgr2=0x7f61f40c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 shutdown_connections 2023-10-08T15:42:26.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.044+0000 7f61fa061700 1 -- 172.21.15.29:0/2922665891 wait complete. 2023-10-08T15:42:26.057 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T15:42:26.057 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T15:42:26.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.179+0000 7fac2aff8700 1 Processor -- start 2023-10-08T15:42:26.180 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.179+0000 7fac2aff8700 1 -- start start 2023-10-08T15:42:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.180+0000 7fac2aff8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac2415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.180+0000 7fac2aff8700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fac24067d70 0x7fac240cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.180+0000 7fac2aff8700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240cf350 con 0x7fac2415aee0 2023-10-08T15:42:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.180+0000 7fac2aff8700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2415e9e0 con 0x7fac24067d70 2023-10-08T15:42:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.180+0000 7fac2aff8700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac24157ee0 con 0x7fac24157b10 2023-10-08T15:42:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac29595700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fac24067d70 0x7fac240cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac28d94700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac2415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac23fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fac2415aee0 0x7fac24067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:36194/0 (socket says 172.21.15.29:36194) 2023-10-08T15:42:26.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac23fff700 1 -- 172.21.15.29:0/2174053545 learned_addr learned my addr 172.21.15.29:0/2174053545 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac28d94700 1 -- 172.21.15.29:0/2174053545 >> v2:172.21.15.183:3300/0 conn(0x7fac24067d70 msgr2=0x7fac240cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac28d94700 1 --2- 172.21.15.29:0/2174053545 >> v2:172.21.15.183:3300/0 conn(0x7fac24067d70 0x7fac240cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac28d94700 1 -- 172.21.15.29:0/2174053545 >> v1:172.21.15.183:6789/0 conn(0x7fac2415aee0 legacy=0x7fac24067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac28d94700 1 -- 172.21.15.29:0/2174053545 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2415e140 con 0x7fac24157b10 2023-10-08T15:42:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac28d94700 1 --2- 172.21.15.29:0/2174053545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac2415dab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac140098e0 tx=0x7fac140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d86209d4bae1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac237fe700 1 -- 172.21.15.29:0/2174053545 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400b640 con 0x7fac24157b10 2023-10-08T15:42:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac237fe700 1 -- 172.21.15.29:0/2174053545 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1400b7a0 con 0x7fac24157b10 2023-10-08T15:42:26.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.181+0000 7fac237fe700 1 -- 172.21.15.29:0/2174053545 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400bb40 con 0x7fac24157b10 2023-10-08T15:42:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.182+0000 7fac2aff8700 1 -- 172.21.15.29:0/2174053545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 msgr2=0x7fac2415dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.182+0000 7fac2aff8700 1 --2- 172.21.15.29:0/2174053545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac2415dab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac140098e0 tx=0x7fac140091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.182+0000 7fac2aff8700 1 -- 172.21.15.29:0/2174053545 shutdown_connections 2023-10-08T15:42:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.182+0000 7fac2aff8700 1 --2- 172.21.15.29:0/2174053545 >> v2:172.21.15.183:3300/0 conn(0x7fac24067d70 0x7fac240cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.182+0000 7fac2aff8700 1 --2- 172.21.15.29:0/2174053545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac2415dab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.182+0000 7fac2aff8700 1 -- 172.21.15.29:0/2174053545 >> 172.21.15.29:0/2174053545 conn(0x7fac240d0de0 msgr2=0x7fac240d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.182+0000 7fac2aff8700 1 -- 172.21.15.29:0/2174053545 shutdown_connections 2023-10-08T15:42:26.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.182+0000 7fac2aff8700 1 -- 172.21.15.29:0/2174053545 wait complete. 2023-10-08T15:42:26.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.183+0000 7fac2aff8700 1 Processor -- start 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.183+0000 7fac2aff8700 1 -- start start 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac2aff8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac24067d70 0x7fac240b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac2aff8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac241587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac2aff8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac2415aee0 0x7fac24158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac2aff8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac241433b0 con 0x7fac2415aee0 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac2aff8700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240b3c10 con 0x7fac24067d70 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac2aff8700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac240b1190 con 0x7fac24157b10 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac29595700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac2415aee0 0x7fac24158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac29595700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac2415aee0 0x7fac24158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42138/0 (socket says 172.21.15.29:42138) 2023-10-08T15:42:26.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac23fff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac241587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac29595700 1 -- 172.21.15.29:0/3780654976 learned_addr learned my addr 172.21.15.29:0/3780654976 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac28d94700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac24067d70 0x7fac240b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac29595700 1 -- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 msgr2=0x7fac241587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac29595700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac241587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac29595700 1 -- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac24067d70 msgr2=0x7fac240b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac29595700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac24067d70 0x7fac240b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.184+0000 7fac29595700 1 -- 172.21.15.29:0/3780654976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14009420 con 0x7fac2415aee0 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.185+0000 7fac29595700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac2415aee0 0x7fac24158cf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009ef0 tx=0x7fac1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.185+0000 7fac20ff9700 1 -- 172.21.15.29:0/3780654976 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00cb70 con 0x7fac2415aee0 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.185+0000 7fac20ff9700 1 -- 172.21.15.29:0/3780654976 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c00f040 con 0x7fac2415aee0 2023-10-08T15:42:26.188 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.185+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac240b1470 con 0x7fac2415aee0 2023-10-08T15:42:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.185+0000 7fac20ff9700 1 -- 172.21.15.29:0/3780654976 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c014480 con 0x7fac2415aee0 2023-10-08T15:42:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.185+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac240b1a30 con 0x7fac2415aee0 2023-10-08T15:42:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.186+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac240b3da0 con 0x7fac2415aee0 2023-10-08T15:42:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.186+0000 7fac20ff9700 1 -- 172.21.15.29:0/3780654976 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac1c014830 con 0x7fac2415aee0 2023-10-08T15:42:26.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.187+0000 7fac20ff9700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fac10066f30 0x7fac100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.187+0000 7fac20ff9700 1 -- 172.21.15.29:0/3780654976 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fac1c084f10 con 0x7fac2415aee0 2023-10-08T15:42:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.187+0000 7fac28d94700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fac10066f30 0x7fac100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.187+0000 7fac28d94700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fac10066f30 0x7fac100693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fac140091e0 tx=0x7fac14017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.191+0000 7fac20ff9700 1 -- 172.21.15.29:0/3780654976 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac1c052430 con 0x7fac2415aee0 2023-10-08T15:42:26.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.384+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fac2404c3c0 con 0x7fac2415aee0 2023-10-08T15:42:26.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.596+0000 7fac20ff9700 1 -- 172.21.15.29:0/3780654976 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7fac1c055a50 con 0x7fac2415aee0 2023-10-08T15:42:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.600+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fac10066f30 msgr2=0x7fac100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.600+0000 7fac2aff8700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fac10066f30 0x7fac100693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fac140091e0 tx=0x7fac14017000 comp rx=0 tx=0).stop 2023-10-08T15:42:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.600+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac2415aee0 msgr2=0x7fac24158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.600+0000 7fac2aff8700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac2415aee0 0x7fac24158cf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009ef0 tx=0x7fac1c00b040 comp rx=0 tx=0).stop 2023-10-08T15:42:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.601+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 shutdown_connections 2023-10-08T15:42:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.601+0000 7fac2aff8700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fac10066f30 0x7fac100693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.601+0000 7fac2aff8700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac2415aee0 0x7fac24158cf0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.601+0000 7fac2aff8700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac24067d70 0x7fac240b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.601+0000 7fac2aff8700 1 --2- 172.21.15.29:0/3780654976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac24157b10 0x7fac241587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.601+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 >> 172.21.15.29:0/3780654976 conn(0x7fac240d0de0 msgr2=0x7fac240c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.601+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 shutdown_connections 2023-10-08T15:42:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.601+0000 7fac2aff8700 1 -- 172.21.15.29:0/3780654976 wait complete. 2023-10-08T15:42:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2023-10-08T15:42:26.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T15:42:26.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.739+0000 7faef0078700 1 Processor -- start 2023-10-08T15:42:26.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.739+0000 7faef0078700 1 -- start start 2023-10-08T15:42:26.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faef0078700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faee8152300 0x7faee815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faef0078700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faee8158df0 0x7faee80caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faef0078700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee815c8d0 con 0x7faee806d370 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faef0078700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee80b1400 con 0x7faee8158df0 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faef0078700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee80c9370 con 0x7faee8152300 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faeed613700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faee8158df0 0x7faee80caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faeee615700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faee806d370 0x7faee806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:48024/0 (socket says 172.21.15.29:48024) 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faeee615700 1 -- 172.21.15.29:0/1105955318 learned_addr learned my addr 172.21.15.29:0/1105955318 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.740+0000 7faeed613700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faee8158df0 0x7faee80caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42142/0 (socket says 172.21.15.29:42142) 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeede14700 1 --2- 172.21.15.29:0/1105955318 >> v2:172.21.15.183:3300/0 conn(0x7faee8152300 0x7faee815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeed613700 1 -- 172.21.15.29:0/1105955318 >> v2:172.21.15.183:3300/0 conn(0x7faee8152300 msgr2=0x7faee815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeed613700 1 --2- 172.21.15.29:0/1105955318 >> v2:172.21.15.183:3300/0 conn(0x7faee8152300 0x7faee815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.743 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeed613700 1 -- 172.21.15.29:0/1105955318 >> v1:172.21.15.29:6789/0 conn(0x7faee806d370 legacy=0x7faee806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeece12700 1 -- 172.21.15.29:0/1105955318 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060653935 0 0) 0x7faee815c8d0 con 0x7faee806d370 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeed613700 1 -- 172.21.15.29:0/1105955318 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee815c030 con 0x7faee8158df0 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeede14700 1 --2- 172.21.15.29:0/1105955318 >> v2:172.21.15.183:3300/0 conn(0x7faee8152300 0x7faee815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeed613700 1 --2- 172.21.15.29:0/1105955318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80caaf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faee80cdc10 tx=0x7faedc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696268da521b915b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeece12700 1 -- 172.21.15.29:0/1105955318 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00b6b0 con 0x7faee8158df0 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeece12700 1 -- 172.21.15.29:0/1105955318 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00b810 con 0x7faee8158df0 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.741+0000 7faeece12700 1 -- 172.21.15.29:0/1105955318 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00bbb0 con 0x7faee8158df0 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.742+0000 7faef0078700 1 -- 172.21.15.29:0/1105955318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 msgr2=0x7faee80caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.742+0000 7faef0078700 1 --2- 172.21.15.29:0/1105955318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80caaf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faee80cdc10 tx=0x7faedc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.744 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.742+0000 7faef0078700 1 -- 172.21.15.29:0/1105955318 shutdown_connections 2023-10-08T15:42:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.742+0000 7faef0078700 1 --2- 172.21.15.29:0/1105955318 >> v2:172.21.15.183:3300/0 conn(0x7faee8152300 0x7faee815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.742+0000 7faef0078700 1 --2- 172.21.15.29:0/1105955318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80caaf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.742+0000 7faef0078700 1 -- 172.21.15.29:0/1105955318 >> 172.21.15.29:0/1105955318 conn(0x7faee8069870 msgr2=0x7faee8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.742+0000 7faef0078700 1 -- 172.21.15.29:0/1105955318 shutdown_connections 2023-10-08T15:42:26.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.742+0000 7faef0078700 1 -- 172.21.15.29:0/1105955318 wait complete. 2023-10-08T15:42:26.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.743+0000 7faef0078700 1 Processor -- start 2023-10-08T15:42:26.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.743+0000 7faef0078700 1 -- start start 2023-10-08T15:42:26.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faef0078700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faee806d370 0x7faee80b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faef0078700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faee8152300 0x7faee8150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faef0078700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faef0078700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80c8270 con 0x7faee8158df0 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faef0078700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80c7f20 con 0x7faee8152300 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faef0078700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b4910 con 0x7faee806d370 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42156/0 (socket says 172.21.15.29:42156) 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 -- 172.21.15.29:0/591747041 learned_addr learned my addr 172.21.15.29:0/591747041 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeed613700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faee8152300 0x7faee8150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeede14700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faee806d370 0x7faee80b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 -- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faee806d370 msgr2=0x7faee80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faee806d370 0x7faee80b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 -- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faee8152300 msgr2=0x7faee8150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faee8152300 0x7faee8150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 -- 172.21.15.29:0/591747041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc009420 con 0x7faee8158df0 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeed613700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faee8152300 0x7faee8150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faeee615700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80cafe0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faed800cc90 tx=0x7faed8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faee5ffb700 1 -- 172.21.15.29:0/591747041 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800cea0 con 0x7faee8158df0 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faee5ffb700 1 -- 172.21.15.29:0/591747041 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed800ab30 con 0x7faee8158df0 2023-10-08T15:42:26.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee80c7070 con 0x7faee8158df0 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.744+0000 7faee5ffb700 1 -- 172.21.15.29:0/591747041 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80070f0 con 0x7faee8158df0 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.745+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee80c7670 con 0x7faee8158df0 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.745+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee80c80b0 con 0x7faee8158df0 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.746+0000 7faee5ffb700 1 -- 172.21.15.29:0/591747041 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faed80074a0 con 0x7faee8158df0 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.746+0000 7faee5ffb700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faed4066f30 0x7faed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.747+0000 7faee5ffb700 1 -- 172.21.15.29:0/591747041 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5223+0+0 (secure 0 0 0) 0x7faed80848d0 con 0x7faee8158df0 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.747+0000 7faeede14700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faed4066f30 0x7faed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:26.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.747+0000 7faeede14700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faed4066f30 0x7faed40693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faee0008a50 tx=0x7faee0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:26.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.751+0000 7faee5ffb700 1 -- 172.21.15.29:0/591747041 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faed8051d00 con 0x7faee8158df0 2023-10-08T15:42:26.944 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:26.943+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7faee804c3c0 con 0x7faee8158df0 2023-10-08T15:42:27.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.598+0000 7faee5ffb700 1 -- 172.21.15.29:0/591747041 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7faed8055320 con 0x7faee8158df0 2023-10-08T15:42:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.606+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faed4066f30 msgr2=0x7faed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faed4066f30 0x7faed40693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faee0008a50 tx=0x7faee0008040 comp rx=0 tx=0).stop 2023-10-08T15:42:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 msgr2=0x7faee80cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80cafe0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faed800cc90 tx=0x7faed8001a20 comp rx=0 tx=0).stop 2023-10-08T15:42:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 shutdown_connections 2023-10-08T15:42:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7faed4066f30 0x7faed40693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faee8158df0 0x7faee80cafe0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faee806d370 0x7faee80b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 --2- 172.21.15.29:0/591747041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faee8152300 0x7faee8150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.607+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 >> 172.21.15.29:0/591747041 conn(0x7faee8069870 msgr2=0x7faee8069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:27.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.608+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 shutdown_connections 2023-10-08T15:42:27.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.608+0000 7faef0078700 1 -- 172.21.15.29:0/591747041 wait complete. 2023-10-08T15:42:27.612 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2023-10-08T15:42:27.626 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T15:42:27.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.752+0000 7fa2157f8700 1 Processor -- start 2023-10-08T15:42:27.753 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.752+0000 7fa2157f8700 1 -- start start 2023-10-08T15:42:27.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.753+0000 7fa2157f8700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2100678b0 0x7fa21015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.753+0000 7fa2157f8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa21015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.753+0000 7fa2157f8700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2100cae70 con 0x7fa2100c9390 2023-10-08T15:42:27.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.753+0000 7fa2157f8700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2100cb150 con 0x7fa2100678b0 2023-10-08T15:42:27.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.753+0000 7fa2157f8700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100cb430 con 0x7fa2100cbf10 2023-10-08T15:42:27.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.753+0000 7fa20effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2100678b0 0x7fa21015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.753+0000 7fa20effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2100678b0 0x7fa21015db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42162/0 (socket says 172.21.15.29:42162) 2023-10-08T15:42:27.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.753+0000 7fa20effd700 1 -- 172.21.15.29:0/4045074718 learned_addr learned my addr 172.21.15.29:0/4045074718 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:27.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20e7fc700 1 --2- 172.21.15.29:0/4045074718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa21015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20effd700 1 -- 172.21.15.29:0/4045074718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 msgr2=0x7fa21015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:27.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20effd700 1 --2- 172.21.15.29:0/4045074718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa21015e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20effd700 1 -- 172.21.15.29:0/4045074718 >> v1:172.21.15.183:6789/0 conn(0x7fa2100c9390 legacy=0x7fa21006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:27.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20effd700 1 -- 172.21.15.29:0/4045074718 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2100cb710 con 0x7fa2100678b0 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20e7fc700 1 --2- 172.21.15.29:0/4045074718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa21015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20effd700 1 --2- 172.21.15.29:0/4045074718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa21015db80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa200009f20 tx=0x7fa200009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33119f2cc7c52c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20dffb700 1 -- 172.21.15.29:0/4045074718 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20000e070 con 0x7fa2100678b0 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20dffb700 1 -- 172.21.15.29:0/4045074718 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20000ba40 con 0x7fa2100678b0 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa20dffb700 1 -- 172.21.15.29:0/4045074718 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000092e0 con 0x7fa2100678b0 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa2157f8700 1 -- 172.21.15.29:0/4045074718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 msgr2=0x7fa21015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa2157f8700 1 --2- 172.21.15.29:0/4045074718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa21015db80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa200009f20 tx=0x7fa200009840 comp rx=0 tx=0).stop 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa2157f8700 1 -- 172.21.15.29:0/4045074718 shutdown_connections 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa2157f8700 1 --2- 172.21.15.29:0/4045074718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa21015db80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.758 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa2157f8700 1 --2- 172.21.15.29:0/4045074718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa21015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.754+0000 7fa2157f8700 1 -- 172.21.15.29:0/4045074718 >> 172.21.15.29:0/4045074718 conn(0x7fa210069870 msgr2=0x7fa210069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:27.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.755+0000 7fa2157f8700 1 -- 172.21.15.29:0/4045074718 shutdown_connections 2023-10-08T15:42:27.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.755+0000 7fa2157f8700 1 -- 172.21.15.29:0/4045074718 wait complete. 2023-10-08T15:42:27.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.756+0000 7fa2157f8700 1 Processor -- start 2023-10-08T15:42:27.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.756+0000 7fa2157f8700 1 -- start start 2023-10-08T15:42:27.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.756+0000 7fa2157f8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa210146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.756+0000 7fa2157f8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2100c9390 0x7fa2100ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.756+0000 7fa2157f8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa2100b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.756+0000 7fa2157f8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100ac260 con 0x7fa2100678b0 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.756+0000 7fa2157f8700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa210147520 con 0x7fa2100c9390 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.756+0000 7fa2157f8700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100ab610 con 0x7fa2100cbf10 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa210146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa210146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42174/0 (socket says 172.21.15.29:42174) 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 -- 172.21.15.29:0/2761051150 learned_addr learned my addr 172.21.15.29:0/2761051150 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20f7fe700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa2100b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20e7fc700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2100c9390 0x7fa2100ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 -- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 msgr2=0x7fa2100b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa2100b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 -- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2100c9390 msgr2=0x7fa2100ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2100c9390 0x7fa2100ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 -- 172.21.15.29:0/2761051150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200009ae0 con 0x7fa2100678b0 2023-10-08T15:42:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20f7fe700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa2100b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa20effd700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa210146fe0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa21006a380 tx=0x7fa200017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa206ffd700 1 -- 172.21.15.29:0/2761051150 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000129d0 con 0x7fa2100678b0 2023-10-08T15:42:27.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa206ffd700 1 -- 172.21.15.29:0/2761051150 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa200012b30 con 0x7fa2100678b0 2023-10-08T15:42:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2100ab8f0 con 0x7fa2100678b0 2023-10-08T15:42:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa206ffd700 1 -- 172.21.15.29:0/2761051150 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20001d420 con 0x7fa2100678b0 2023-10-08T15:42:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.757+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2100ae3d0 con 0x7fa2100678b0 2023-10-08T15:42:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.758+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2100abd50 con 0x7fa2100678b0 2023-10-08T15:42:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.759+0000 7fa206ffd700 1 -- 172.21.15.29:0/2761051150 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa20001d850 con 0x7fa2100678b0 2023-10-08T15:42:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.759+0000 7fa206ffd700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa1f0066f30 0x7fa1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:27.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.759+0000 7fa206ffd700 1 -- 172.21.15.29:0/2761051150 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fa200085ab0 con 0x7fa2100678b0 2023-10-08T15:42:27.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.759+0000 7fa20e7fc700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa1f0066f30 0x7fa1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:27.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.760+0000 7fa20e7fc700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa1f0066f30 0x7fa1f00693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa2100ad660 tx=0x7fa1f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:27.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:27.764+0000 7fa206ffd700 1 -- 172.21.15.29:0/2761051150 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2100abd50 con 0x7fa2100678b0 2023-10-08T15:42:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.000+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa2100abd50 con 0x7fa2100678b0 2023-10-08T15:42:28.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.626+0000 7fa206ffd700 1 -- 172.21.15.29:0/2761051150 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa2100abd50 con 0x7fa2100678b0 2023-10-08T15:42:28.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.631+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa1f0066f30 msgr2=0x7fa1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.631+0000 7fa2157f8700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa1f0066f30 0x7fa1f00693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa2100ad660 tx=0x7fa1f8008040 comp rx=0 tx=0).stop 2023-10-08T15:42:28.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.631+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 msgr2=0x7fa210146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.631+0000 7fa2157f8700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa210146fe0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa21006a380 tx=0x7fa200017000 comp rx=0 tx=0).stop 2023-10-08T15:42:28.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.631+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 shutdown_connections 2023-10-08T15:42:28.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.631+0000 7fa2157f8700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa1f0066f30 0x7fa1f00693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.631+0000 7fa2157f8700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2100cbf10 0x7fa2100b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.631+0000 7fa2157f8700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2100678b0 0x7fa210146fe0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.632+0000 7fa2157f8700 1 --2- 172.21.15.29:0/2761051150 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2100c9390 0x7fa2100ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.632+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 >> 172.21.15.29:0/2761051150 conn(0x7fa210069870 msgr2=0x7fa2100c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:28.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.632+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 shutdown_connections 2023-10-08T15:42:28.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.632+0000 7fa2157f8700 1 -- 172.21.15.29:0/2761051150 wait complete. 2023-10-08T15:42:28.638 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 8 and data pool 9 2023-10-08T15:42:28.650 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.770+0000 7f4ef57e9700 1 Processor -- start 2023-10-08T15:42:28.771 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.770+0000 7f4ef57e9700 1 -- start start 2023-10-08T15:42:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4ef57e9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef00b09c0 0x7f4ef00b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.772 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4ef57e9700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4ef00c8f30 0x7f4ef0158b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4ef57e9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef00ca050 con 0x7f4ef006f0a0 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4ef57e9700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef00b12d0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4ef57e9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0159070 con 0x7f4ef00b09c0 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4eef7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4ef00c8f30 0x7f4ef0158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4eef7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4ef00c8f30 0x7f4ef0158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51418/0 (socket says 172.21.15.29:51418) 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4eef7fe700 1 -- 172.21.15.29:0/3304758048 learned_addr learned my addr 172.21.15.29:0/3304758048 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.771+0000 7f4eeffff700 1 --2- 172.21.15.29:0/3304758048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef00b09c0 0x7f4ef00b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eef7fe700 1 -- 172.21.15.29:0/3304758048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef00b09c0 msgr2=0x7f4ef00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eef7fe700 1 --2- 172.21.15.29:0/3304758048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef00b09c0 0x7f4ef00b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.773 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eef7fe700 1 -- 172.21.15.29:0/3304758048 >> v1:172.21.15.183:6789/0 conn(0x7f4ef006f0a0 legacy=0x7f4ef00ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eef7fe700 1 -- 172.21.15.29:0/3304758048 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00c94d0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eeffff700 1 --2- 172.21.15.29:0/3304758048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef00b09c0 0x7f4ef00b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eef7fe700 1 --2- 172.21.15.29:0/3304758048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef0158b30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80099b0 tx=0x7f4ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c0c6d6637a8db4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eeeffd700 1 -- 172.21.15.29:0/3304758048 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800b860 con 0x7f4ef00c8f30 2023-10-08T15:42:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eeeffd700 1 -- 172.21.15.29:0/3304758048 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800b9c0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.774 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.772+0000 7f4eeeffd700 1 -- 172.21.15.29:0/3304758048 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800bd80 con 0x7f4ef00c8f30 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.773+0000 7f4ef57e9700 1 -- 172.21.15.29:0/3304758048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 msgr2=0x7f4ef0158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.773+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/3304758048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef0158b30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80099b0 tx=0x7f4ed8009250 comp rx=0 tx=0).stop 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.773+0000 7f4ef57e9700 1 -- 172.21.15.29:0/3304758048 shutdown_connections 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.773+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/3304758048 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef00b09c0 0x7f4ef00b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.773+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/3304758048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef0158b30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.773+0000 7f4ef57e9700 1 -- 172.21.15.29:0/3304758048 >> 172.21.15.29:0/3304758048 conn(0x7f4ef0069870 msgr2=0x7f4ef0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.773+0000 7f4ef57e9700 1 -- 172.21.15.29:0/3304758048 shutdown_connections 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.773+0000 7f4ef57e9700 1 -- 172.21.15.29:0/3304758048 wait complete. 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.774+0000 7f4ef57e9700 1 Processor -- start 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.774+0000 7f4ef57e9700 1 -- start start 2023-10-08T15:42:28.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef57e9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef006f0a0 0x7f4ef00cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef57e9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ef00b09c0 0x7f4ef0144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef57e9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef00c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef57e9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00b3510 con 0x7f4ef00c8f30 2023-10-08T15:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef57e9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00b37f0 con 0x7f4ef00b09c0 2023-10-08T15:42:28.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef57e9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00b3ad0 con 0x7f4ef006f0a0 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef00c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef00c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51434/0 (socket says 172.21.15.29:51434) 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 -- 172.21.15.29:0/2795141640 learned_addr learned my addr 172.21.15.29:0/2795141640 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4eeffff700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef006f0a0 0x7f4ef00cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4eef7fe700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ef00b09c0 0x7f4ef0144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 -- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef006f0a0 msgr2=0x7f4ef00cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef006f0a0 0x7f4ef00cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 -- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ef00b09c0 msgr2=0x7f4ef0144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ef00b09c0 0x7f4ef0144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 -- 172.21.15.29:0/2795141640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80094f0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ef4fe8700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef00c7200 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c840 tx=0x7f4ee8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ee7fff700 1 -- 172.21.15.29:0/2795141640 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8012630 con 0x7f4ef00c8f30 2023-10-08T15:42:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.775+0000 7f4ee7fff700 1 -- 172.21.15.29:0/2795141640 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee80127b0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.776+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef00b3db0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.776+0000 7f4ee7fff700 1 -- 172.21.15.29:0/2795141640 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8012b70 con 0x7f4ef00c8f30 2023-10-08T15:42:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.776+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef01451a0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.777+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef00b42d0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.777+0000 7f4ee7fff700 1 -- 172.21.15.29:0/2795141640 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ee801a3a0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.777+0000 7f4ee7fff700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.777+0000 7f4ee7fff700 1 -- 172.21.15.29:0/2795141640 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ee8084660 con 0x7f4ef00c8f30 2023-10-08T15:42:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.778+0000 7f4eeffff700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:28.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.778+0000 7f4eeffff700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4ed0066f30 0x7f4ed00693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0006f00 tx=0x7f4ee0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.782+0000 7f4ee7fff700 1 -- 172.21.15.29:0/2795141640 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ef00b42d0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.975+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef00b42d0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.976+0000 7f4ee7fff700 1 -- 172.21.15.29:0/2795141640 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f4ef00b42d0 con 0x7f4ef00c8f30 2023-10-08T15:42:28.976 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:28.976 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":64,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:42:28.001393+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:42:26.414968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:42:26.974018+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4ed0066f30 msgr2=0x7f4ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4ed0066f30 0x7f4ed00693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0006f00 tx=0x7f4ee0008040 comp rx=0 tx=0).stop 2023-10-08T15:42:28.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 msgr2=0x7f4ef00c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef00c7200 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c840 tx=0x7f4ee8001670 comp rx=0 tx=0).stop 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 shutdown_connections 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ef00c8f30 0x7f4ef00c7200 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ef006f0a0 0x7f4ef00cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 --2- 172.21.15.29:0/2795141640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ef00b09c0 0x7f4ef0144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.977+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 >> 172.21.15.29:0/2795141640 conn(0x7f4ef0069870 msgr2=0x7f4ef00ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.978+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 shutdown_connections 2023-10-08T15:42:28.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:28.978+0000 7f4ef57e9700 1 -- 172.21.15.29:0/2795141640 wait complete. 2023-10-08T15:42:28.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:29.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.109+0000 7f881fb2d700 1 Processor -- start 2023-10-08T15:42:29.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.109+0000 7f881fb2d700 1 -- start start 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881fb2d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f88180d1c30 0x7f88180ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881fb2d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 0x7f88180cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881fb2d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88180c5d80 con 0x7f881815a2b0 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881fb2d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8818068470 con 0x7f88180d1c30 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881fb2d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88180c6060 con 0x7f881815a680 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881d8c9700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f881815a2b0 0x7f88180b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43872/0 (socket says 172.21.15.29:43872) 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881d8c9700 1 -- 172.21.15.29:0/2739162779 learned_addr learned my addr 172.21.15.29:0/2739162779 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881d0c8700 1 --2- 172.21.15.29:0/2739162779 >> v2:172.21.15.183:3300/0 conn(0x7f88180d1c30 0x7f88180ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881e0ca700 1 --2- 172.21.15.29:0/2739162779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 0x7f88180cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881c8c7700 1 -- 172.21.15.29:0/2739162779 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192900020 0 0) 0x7f88180c5d80 con 0x7f881815a2b0 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881c8c7700 1 -- 172.21.15.29:0/2739162779 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8804003570 con 0x7f881815a2b0 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881c8c7700 1 -- 172.21.15.29:0/2739162779 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251289327 0 0) 0x7f8804003570 con 0x7f881815a2b0 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881e0ca700 1 -- 172.21.15.29:0/2739162779 >> v2:172.21.15.183:3300/0 conn(0x7f88180d1c30 msgr2=0x7f88180ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881e0ca700 1 --2- 172.21.15.29:0/2739162779 >> v2:172.21.15.183:3300/0 conn(0x7f88180d1c30 0x7f88180ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881e0ca700 1 -- 172.21.15.29:0/2739162779 >> v1:172.21.15.29:6789/0 conn(0x7f881815a2b0 legacy=0x7f88180b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881e0ca700 1 -- 172.21.15.29:0/2739162779 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88180c6340 con 0x7f881815a680 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.110+0000 7f881d0c8700 1 --2- 172.21.15.29:0/2739162779 >> v2:172.21.15.183:3300/0 conn(0x7f88180d1c30 0x7f88180ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881e0ca700 1 --2- 172.21.15.29:0/2739162779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 0x7f88180cf710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8810009e60 tx=0x7f8810009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53788f26d21bb27e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881c8c7700 1 -- 172.21.15.29:0/2739162779 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000e070 con 0x7f881815a680 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881c8c7700 1 -- 172.21.15.29:0/2739162779 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881000b7a0 con 0x7f881815a680 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881c8c7700 1 -- 172.21.15.29:0/2739162779 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140015f0 con 0x7f881815a680 2023-10-08T15:42:29.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881fb2d700 1 -- 172.21.15.29:0/2739162779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 msgr2=0x7f88180cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881fb2d700 1 --2- 172.21.15.29:0/2739162779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 0x7f88180cf710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8810009e60 tx=0x7f8810009780 comp rx=0 tx=0).stop 2023-10-08T15:42:29.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881fb2d700 1 -- 172.21.15.29:0/2739162779 shutdown_connections 2023-10-08T15:42:29.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881fb2d700 1 --2- 172.21.15.29:0/2739162779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 0x7f88180cf710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881fb2d700 1 --2- 172.21.15.29:0/2739162779 >> v2:172.21.15.183:3300/0 conn(0x7f88180d1c30 0x7f88180ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881fb2d700 1 -- 172.21.15.29:0/2739162779 >> 172.21.15.29:0/2739162779 conn(0x7f8818067e40 msgr2=0x7f88180d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:29.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881fb2d700 1 -- 172.21.15.29:0/2739162779 shutdown_connections 2023-10-08T15:42:29.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.111+0000 7f881fb2d700 1 -- 172.21.15.29:0/2739162779 wait complete. 2023-10-08T15:42:29.116 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.112+0000 7f881fb2d700 1 Processor -- start 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.112+0000 7f881fb2d700 1 -- start start 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881fb2d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88180d1c30 0x7f881815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881fb2d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f881815a2b0 0x7f8818157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881fb2d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 0x7f881815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881fb2d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881815c4c0 con 0x7f88180d1c30 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881fb2d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881815c7a0 con 0x7f881815a2b0 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881fb2d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881815ca80 con 0x7f881815a680 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881d8c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88180d1c30 0x7f881815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881d8c9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88180d1c30 0x7f881815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51448/0 (socket says 172.21.15.29:51448) 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881d8c9700 1 -- 172.21.15.29:0/141292429 learned_addr learned my addr 172.21.15.29:0/141292429 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881d8c9700 1 -- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 msgr2=0x7f881815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.113+0000 7f881d8c9700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 0x7f881815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f881d8c9700 1 -- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f881815a2b0 msgr2=0x7f8818157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f881d0c8700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f881815a2b0 0x7f8818157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f881d8c9700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f881815a2b0 0x7f8818157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f881d8c9700 1 -- 172.21.15.29:0/141292429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808009420 con 0x7f88180d1c30 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f881d0c8700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f881815a2b0 0x7f8818157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f881d8c9700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88180d1c30 0x7f881815d560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f881400cb60 tx=0x7f88140013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f880dffb700 1 -- 172.21.15.29:0/141292429 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140070f0 con 0x7f88180d1c30 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f880dffb700 1 -- 172.21.15.29:0/141292429 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8814007270 con 0x7f88180d1c30 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8810009a20 con 0x7f88180d1c30 2023-10-08T15:42:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f880dffb700 1 -- 172.21.15.29:0/141292429 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814007630 con 0x7f88180d1c30 2023-10-08T15:42:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.114+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881815d0c0 con 0x7f88180d1c30 2023-10-08T15:42:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.115+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881815db60 con 0x7f88180d1c30 2023-10-08T15:42:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.115+0000 7f880dffb700 1 -- 172.21.15.29:0/141292429 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8814005a00 con 0x7f88180d1c30 2023-10-08T15:42:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.116+0000 7f880dffb700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f87fc066f30 0x7f87fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.116+0000 7f880dffb700 1 -- 172.21.15.29:0/141292429 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8814084240 con 0x7f88180d1c30 2023-10-08T15:42:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.116+0000 7f881d0c8700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f87fc066f30 0x7f87fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.116+0000 7f881d0c8700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f87fc066f30 0x7f87fc0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f88080093f0 tx=0x7f8808008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.120+0000 7f880dffb700 1 -- 172.21.15.29:0/141292429 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f881815db60 con 0x7f88180d1c30 2023-10-08T15:42:29.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.318+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f881815db60 con 0x7f88180d1c30 2023-10-08T15:42:29.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.319+0000 7f880dffb700 1 -- 172.21.15.29:0/141292429 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f881815db60 con 0x7f88180d1c30 2023-10-08T15:42:29.320 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:29.320 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":64,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:42:28.001393+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:42:26.414968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:42:26.974018+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:29.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f87fc066f30 msgr2=0x7f87fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f87fc066f30 0x7f87fc0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f88080093f0 tx=0x7f8808008040 comp rx=0 tx=0).stop 2023-10-08T15:42:29.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88180d1c30 msgr2=0x7f881815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88180d1c30 0x7f881815d560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f881400cb60 tx=0x7f88140013b0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 shutdown_connections 2023-10-08T15:42:29.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f87fc066f30 0x7f87fc0693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f881815a680 0x7f881815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88180d1c30 0x7f881815d560 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.321+0000 7f881fb2d700 1 --2- 172.21.15.29:0/141292429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f881815a2b0 0x7f8818157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.322+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 >> 172.21.15.29:0/141292429 conn(0x7f8818067e40 msgr2=0x7f88180cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:29.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.322+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 shutdown_connections 2023-10-08T15:42:29.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.322+0000 7f881fb2d700 1 -- 172.21.15.29:0/141292429 wait complete. 2023-10-08T15:42:29.334 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T15:42:29.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.456+0000 7ffa73575700 1 Processor -- start 2023-10-08T15:42:29.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.456+0000 7ffa73575700 1 -- start start 2023-10-08T15:42:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa73575700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffa6c0cce30 0x7ffa6c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa73575700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa6c0b6580 0x7ffa6c06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa73575700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c06ac90 con 0x7ffa6c06a830 2023-10-08T15:42:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa73575700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0b4d70 con 0x7ffa6c0b6580 2023-10-08T15:42:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa73575700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0cd8d0 con 0x7ffa6c0cce30 2023-10-08T15:42:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa71d72700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa6c0b6580 0x7ffa6c06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa71d72700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa6c0b6580 0x7ffa6c06a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51458/0 (socket says 172.21.15.29:51458) 2023-10-08T15:42:29.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa71d72700 1 -- 172.21.15.29:0/1622830599 learned_addr learned my addr 172.21.15.29:0/1622830599 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa72d74700 1 --1- 172.21.15.29:0/1622830599 >> v1:172.21.15.29:6789/0 conn(0x7ffa6c06a830 0x7ffa6c15d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43886/0 (socket says 172.21.15.29:43886) 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa72573700 1 --2- 172.21.15.29:0/1622830599 >> v2:172.21.15.183:3300/0 conn(0x7ffa6c0cce30 0x7ffa6c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa71d72700 1 -- 172.21.15.29:0/1622830599 >> v2:172.21.15.183:3300/0 conn(0x7ffa6c0cce30 msgr2=0x7ffa6c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa71d72700 1 --2- 172.21.15.29:0/1622830599 >> v2:172.21.15.183:3300/0 conn(0x7ffa6c0cce30 0x7ffa6c15aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa71d72700 1 -- 172.21.15.29:0/1622830599 >> v1:172.21.15.29:6789/0 conn(0x7ffa6c06a830 legacy=0x7ffa6c15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa71d72700 1 -- 172.21.15.29:0/1622830599 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0b4440 con 0x7ffa6c0b6580 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.457+0000 7ffa71571700 1 -- 172.21.15.29:0/1622830599 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105803673 0 0) 0x7ffa64001490 con 0x7ffa6c06a830 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa71d72700 1 --2- 172.21.15.29:0/1622830599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c0b6580 0x7ffa6c06a2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b3770 tx=0x7ffa5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4980b67c1ccee9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa71571700 1 -- 172.21.15.29:0/1622830599 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00b860 con 0x7ffa6c0b6580 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa71571700 1 -- 172.21.15.29:0/1622830599 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00b9c0 con 0x7ffa6c0b6580 2023-10-08T15:42:29.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa71571700 1 -- 172.21.15.29:0/1622830599 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00bd60 con 0x7ffa6c0b6580 2023-10-08T15:42:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa73575700 1 -- 172.21.15.29:0/1622830599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c0b6580 msgr2=0x7ffa6c06a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa73575700 1 --2- 172.21.15.29:0/1622830599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c0b6580 0x7ffa6c06a2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b3770 tx=0x7ffa5c009250 comp rx=0 tx=0).stop 2023-10-08T15:42:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa73575700 1 -- 172.21.15.29:0/1622830599 shutdown_connections 2023-10-08T15:42:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa73575700 1 --2- 172.21.15.29:0/1622830599 >> v2:172.21.15.183:3300/0 conn(0x7ffa6c0cce30 0x7ffa6c15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa73575700 1 --2- 172.21.15.29:0/1622830599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c0b6580 0x7ffa6c06a2f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa73575700 1 -- 172.21.15.29:0/1622830599 >> 172.21.15.29:0/1622830599 conn(0x7ffa6c068cb0 msgr2=0x7ffa6c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa73575700 1 -- 172.21.15.29:0/1622830599 shutdown_connections 2023-10-08T15:42:29.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.458+0000 7ffa73575700 1 -- 172.21.15.29:0/1622830599 wait complete. 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.459+0000 7ffa73575700 1 Processor -- start 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.459+0000 7ffa73575700 1 -- start start 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa73575700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c06a830 0x7ffa6c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa73575700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa6c0b6580 0x7ffa6c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa73575700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa6c0cce30 0x7ffa6c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa73575700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c16a5e0 con 0x7ffa6c06a830 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa73575700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c16a8c0 con 0x7ffa6c0cce30 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa73575700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c16aba0 con 0x7ffa6c0b6580 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa72573700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c06a830 0x7ffa6c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa72573700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c06a830 0x7ffa6c158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51474/0 (socket says 172.21.15.29:51474) 2023-10-08T15:42:29.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa72573700 1 -- 172.21.15.29:0/2248156097 learned_addr learned my addr 172.21.15.29:0/2248156097 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa72573700 1 -- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa6c0b6580 msgr2=0x7ffa6c154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa72573700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa6c0b6580 0x7ffa6c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa72573700 1 -- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa6c0cce30 msgr2=0x7ffa6c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.460+0000 7ffa72573700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa6c0cce30 0x7ffa6c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.461+0000 7ffa72573700 1 -- 172.21.15.29:0/2248156097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0094f0 con 0x7ffa6c06a830 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.461+0000 7ffa72573700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c06a830 0x7ffa6c158f80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ffa6800d860 tx=0x7ffa68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.461+0000 7ffa627fc700 1 -- 172.21.15.29:0/2248156097 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68009610 con 0x7ffa6c06a830 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.461+0000 7ffa627fc700 1 -- 172.21.15.29:0/2248156097 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa68009770 con 0x7ffa6c06a830 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.461+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c16ae80 con 0x7ffa6c06a830 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.461+0000 7ffa627fc700 1 -- 172.21.15.29:0/2248156097 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68009b30 con 0x7ffa6c06a830 2023-10-08T15:42:29.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.461+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c14eca0 con 0x7ffa6c06a830 2023-10-08T15:42:29.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.462+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c16b320 con 0x7ffa6c06a830 2023-10-08T15:42:29.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.462+0000 7ffa627fc700 1 -- 172.21.15.29:0/2248156097 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa6801e460 con 0x7ffa6c06a830 2023-10-08T15:42:29.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.463+0000 7ffa627fc700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ffa50066f30 0x7ffa500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:29.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.463+0000 7ffa627fc700 1 -- 172.21.15.29:0/2248156097 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa68084ba0 con 0x7ffa6c06a830 2023-10-08T15:42:29.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.463+0000 7ffa71d72700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ffa50066f30 0x7ffa500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:29.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.463+0000 7ffa71d72700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ffa50066f30 0x7ffa500693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b3770 tx=0x7ffa5c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:29.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.467+0000 7ffa627fc700 1 -- 172.21.15.29:0/2248156097 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa68051e10 con 0x7ffa6c06a830 2023-10-08T15:42:29.709 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:29.709+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffa6c0b4720 con 0x7ffa6c06a830 2023-10-08T15:42:30.596 INFO:tasks.ceph.mds.c.smithi029.stderr:2023-10-08T15:42:30.595+0000 7f7885bfc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T15:42:30.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.634+0000 7ffa627fc700 1 -- 172.21.15.29:0/2248156097 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffa68055430 con 0x7ffa6c06a830 2023-10-08T15:42:30.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ffa50066f30 msgr2=0x7ffa500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ffa50066f30 0x7ffa500693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b3770 tx=0x7ffa5c017000 comp rx=0 tx=0).stop 2023-10-08T15:42:30.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c06a830 msgr2=0x7ffa6c158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c06a830 0x7ffa6c158f80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ffa6800d860 tx=0x7ffa68008040 comp rx=0 tx=0).stop 2023-10-08T15:42:30.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 shutdown_connections 2023-10-08T15:42:30.637 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ffa50066f30 0x7ffa500693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa6c0cce30 0x7ffa6c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa6c06a830 0x7ffa6c158f80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 --2- 172.21.15.29:0/2248156097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa6c0b6580 0x7ffa6c154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.636+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 >> 172.21.15.29:0/2248156097 conn(0x7ffa6c068cb0 msgr2=0x7ffa6c1507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:30.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.637+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 shutdown_connections 2023-10-08T15:42:30.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.637+0000 7ffa73575700 1 -- 172.21.15.29:0/2248156097 wait complete. 2023-10-08T15:42:30.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.782+0000 7fcde2b31700 1 Processor -- start 2023-10-08T15:42:30.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.782+0000 7fcde2b31700 1 -- start start 2023-10-08T15:42:30.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcde2b31700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcddc159e60 0x7fcddc15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcde2b31700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc15a230 0x7fcddc0690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcde2b31700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc15ea90 con 0x7fcddc0695f0 2023-10-08T15:42:30.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcde2b31700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcddc0d1cf0 con 0x7fcddc159e60 2023-10-08T15:42:30.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcde2b31700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc069a70 con 0x7fcddc15a230 2023-10-08T15:42:30.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcddbfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc15a230 0x7fcddc0690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcde08cd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcddc159e60 0x7fcddc15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcde10ce700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fcddc0695f0 0x7fcddc0af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.29:48010/0 (socket says 172.21.15.29:48010) 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.783+0000 7fcde10ce700 1 -- 172.21.15.29:0/1696256868 learned_addr learned my addr 172.21.15.29:0/1696256868 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcddb7fe700 1 -- 172.21.15.29:0/1696256868 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850957097 0 0) 0x7fcddc15ea90 con 0x7fcddc0695f0 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcddb7fe700 1 -- 172.21.15.29:0/1696256868 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdc4003570 con 0x7fcddc0695f0 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcde08cd700 1 -- 172.21.15.29:0/1696256868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc15a230 msgr2=0x7fcddc0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:30.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcde08cd700 1 --2- 172.21.15.29:0/1696256868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc15a230 0x7fcddc0690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcde08cd700 1 -- 172.21.15.29:0/1696256868 >> v1:172.21.15.183:6789/0 conn(0x7fcddc0695f0 legacy=0x7fcddc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcde08cd700 1 -- 172.21.15.29:0/1696256868 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc0b3100 con 0x7fcddc159e60 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcddbfff700 1 --2- 172.21.15.29:0/1696256868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc15a230 0x7fcddc0690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcde08cd700 1 --2- 172.21.15.29:0/1696256868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc159e60 0x7fcddc15e550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0098e0 tx=0x7fcdcc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34590a16b223edb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcddb7fe700 1 -- 172.21.15.29:0/1696256868 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc011630 con 0x7fcddc159e60 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcddb7fe700 1 -- 172.21.15.29:0/1696256868 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc011790 con 0x7fcddc159e60 2023-10-08T15:42:30.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.784+0000 7fcddb7fe700 1 -- 172.21.15.29:0/1696256868 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc011b30 con 0x7fcddc159e60 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.785+0000 7fcde2b31700 1 -- 172.21.15.29:0/1696256868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc159e60 msgr2=0x7fcddc15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.785+0000 7fcde2b31700 1 --2- 172.21.15.29:0/1696256868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc159e60 0x7fcddc15e550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0098e0 tx=0x7fcdcc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.785+0000 7fcde2b31700 1 -- 172.21.15.29:0/1696256868 shutdown_connections 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.785+0000 7fcde2b31700 1 --2- 172.21.15.29:0/1696256868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc159e60 0x7fcddc15e550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.785+0000 7fcde2b31700 1 --2- 172.21.15.29:0/1696256868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc15a230 0x7fcddc0690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.785+0000 7fcde2b31700 1 -- 172.21.15.29:0/1696256868 >> 172.21.15.29:0/1696256868 conn(0x7fcddc070700 msgr2=0x7fcddc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.785+0000 7fcde2b31700 1 -- 172.21.15.29:0/1696256868 shutdown_connections 2023-10-08T15:42:30.789 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.785+0000 7fcde2b31700 1 -- 172.21.15.29:0/1696256868 wait complete. 2023-10-08T15:42:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.786+0000 7fcde2b31700 1 Processor -- start 2023-10-08T15:42:30.792 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.786+0000 7fcde2b31700 1 -- start start 2023-10-08T15:42:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde2b31700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcddc0695f0 0x7fcddc0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde2b31700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc159e60 0x7fcddc0c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde2b31700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc15a230 0x7fcddc14bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde2b31700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc16aa60 con 0x7fcddc0695f0 2023-10-08T15:42:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde2b31700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc16ad40 con 0x7fcddc15a230 2023-10-08T15:42:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde2b31700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc16b020 con 0x7fcddc159e60 2023-10-08T15:42:30.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcddc0695f0 0x7fcddc0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcddc0695f0 0x7fcddc0c51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51488/0 (socket says 172.21.15.29:51488) 2023-10-08T15:42:30.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 -- 172.21.15.29:0/3778427268 learned_addr learned my addr 172.21.15.29:0/3778427268 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:30.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde10ce700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc15a230 0x7fcddc14bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcddbfff700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc159e60 0x7fcddc0c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 -- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc159e60 msgr2=0x7fcddc0c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc159e60 0x7fcddc0c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 -- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc15a230 msgr2=0x7fcddc14bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:30.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc15a230 0x7fcddc14bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:30.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 -- 172.21.15.29:0/3778427268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0009420 con 0x7fcddc0695f0 2023-10-08T15:42:30.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde10ce700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc15a230 0x7fcddc14bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:30.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.787+0000 7fcde08cd700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcddc0695f0 0x7fcddc0c51a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcddc069e20 tx=0x7fcdcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.788+0000 7fcdd8ff9700 1 -- 172.21.15.29:0/3778427268 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc011b10 con 0x7fcddc0695f0 2023-10-08T15:42:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.788+0000 7fcdd8ff9700 1 -- 172.21.15.29:0/3778427268 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc0253f0 con 0x7fcddc0695f0 2023-10-08T15:42:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.788+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc009420 con 0x7fcddc0695f0 2023-10-08T15:42:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.788+0000 7fcdd8ff9700 1 -- 172.21.15.29:0/3778427268 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0257d0 con 0x7fcddc0695f0 2023-10-08T15:42:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.788+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcddc16b5e0 con 0x7fcddc0695f0 2023-10-08T15:42:30.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.789+0000 7fcdd8ff9700 1 -- 172.21.15.29:0/3778427268 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdcc025c00 con 0x7fcddc0695f0 2023-10-08T15:42:30.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.789+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcddc16b7d0 con 0x7fcddc0695f0 2023-10-08T15:42:30.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.790+0000 7fcdd8ff9700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:30.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.790+0000 7fcdd8ff9700 1 -- 172.21.15.29:0/3778427268 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdcc085e30 con 0x7fcddc0695f0 2023-10-08T15:42:30.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.790+0000 7fcddbfff700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:30.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.790+0000 7fcddbfff700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcdc8066f30 0x7fcdc80693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0b5bd0 tx=0x7fcdd00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:30.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:30.794+0000 7fcdd8ff9700 1 -- 172.21.15.29:0/3778427268 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdcc053040 con 0x7fcddc0695f0 2023-10-08T15:42:31.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.031+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcddc04c3c0 con 0x7fcddc0695f0 2023-10-08T15:42:31.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.634+0000 7fcdd8ff9700 1 -- 172.21.15.29:0/3778427268 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcdcc0150c0 con 0x7fcddc0695f0 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcdc8066f30 msgr2=0x7fcdc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcdc8066f30 0x7fcdc80693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0b5bd0 tx=0x7fcdd00091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcddc0695f0 msgr2=0x7fcddc0c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcddc0695f0 0x7fcddc0c51a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcddc069e20 tx=0x7fcdcc017000 comp rx=0 tx=0).stop 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 shutdown_connections 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fcdc8066f30 0x7fcdc80693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcddc15a230 0x7fcddc14bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcddc0695f0 0x7fcddc0c51a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 --2- 172.21.15.29:0/3778427268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcddc159e60 0x7fcddc0c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 >> 172.21.15.29:0/3778427268 conn(0x7fcddc070700 msgr2=0x7fcddc0c9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 shutdown_connections 2023-10-08T15:42:31.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.637+0000 7fcde2b31700 1 -- 172.21.15.29:0/3778427268 wait complete. 2023-10-08T15:42:31.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T15:42:31.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.777+0000 7fc8da11e700 1 Processor -- start 2023-10-08T15:42:31.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.777+0000 7fc8da11e700 1 -- start start 2023-10-08T15:42:31.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.777+0000 7fc8da11e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8d415a2b0 0x7fc8d40b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.777+0000 7fc8da11e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d40d1c30 0x7fc8d40cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8da11e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d40c5d80 con 0x7fc8d415a680 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8da11e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d4068470 con 0x7fc8d415a2b0 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8da11e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40c6060 con 0x7fc8d40d1c30 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8d415a2b0 0x7fc8d40b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d3fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc8d415a680 0x7fc8d40c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43900/0 (socket says 172.21.15.29:43900) 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d3fff700 1 -- 172.21.15.29:0/2575259212 learned_addr learned my addr 172.21.15.29:0/2575259212 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d37fe700 1 -- 172.21.15.29:0/2575259212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d40d1c30 msgr2=0x7fc8d40cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d37fe700 1 --2- 172.21.15.29:0/2575259212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d40d1c30 0x7fc8d40cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d37fe700 1 -- 172.21.15.29:0/2575259212 >> v1:172.21.15.29:6789/0 conn(0x7fc8d415a680 legacy=0x7fc8d40c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d37fe700 1 -- 172.21.15.29:0/2575259212 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40c6340 con 0x7fc8d415a2b0 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d27fc700 1 -- 172.21.15.29:0/2575259212 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273759120 0 0) 0x7fc8d40c5d80 con 0x7fc8d415a680 2023-10-08T15:42:31.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d37fe700 1 --2- 172.21.15.29:0/2575259212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d40b3da0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40098d0 tx=0x7fc8c4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8109d822d6747160 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d27fc700 1 -- 172.21.15.29:0/2575259212 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4009e70 con 0x7fc8d415a2b0 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d27fc700 1 -- 172.21.15.29:0/2575259212 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c4005c10 con 0x7fc8d415a2b0 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.778+0000 7fc8d27fc700 1 -- 172.21.15.29:0/2575259212 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400b650 con 0x7fc8d415a2b0 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.779+0000 7fc8da11e700 1 -- 172.21.15.29:0/2575259212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 msgr2=0x7fc8d40b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.779+0000 7fc8da11e700 1 --2- 172.21.15.29:0/2575259212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d40b3da0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40098d0 tx=0x7fc8c4009120 comp rx=0 tx=0).stop 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.779+0000 7fc8da11e700 1 -- 172.21.15.29:0/2575259212 shutdown_connections 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.779+0000 7fc8da11e700 1 --2- 172.21.15.29:0/2575259212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d40b3da0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.779+0000 7fc8da11e700 1 --2- 172.21.15.29:0/2575259212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d40d1c30 0x7fc8d40cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.779+0000 7fc8da11e700 1 -- 172.21.15.29:0/2575259212 >> 172.21.15.29:0/2575259212 conn(0x7fc8d4067e40 msgr2=0x7fc8d40d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.779+0000 7fc8da11e700 1 -- 172.21.15.29:0/2575259212 shutdown_connections 2023-10-08T15:42:31.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.779+0000 7fc8da11e700 1 -- 172.21.15.29:0/2575259212 wait complete. 2023-10-08T15:42:31.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.780+0000 7fc8da11e700 1 Processor -- start 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.780+0000 7fc8da11e700 1 -- start start 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8da11e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d40d1c30 0x7fc8d40ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8da11e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d416b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8da11e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d415a680 0x7fc8d416bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8da11e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4144700 con 0x7fc8d415a2b0 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8da11e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d415e6d0 con 0x7fc8d40d1c30 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8da11e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40c9a70 con 0x7fc8d415a680 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d416b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d416b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51506/0 (socket says 172.21.15.29:51506) 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d2ffd700 1 -- 172.21.15.29:0/756282363 learned_addr learned my addr 172.21.15.29:0/756282363 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d37fe700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d40d1c30 0x7fc8d40ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d3fff700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d415a680 0x7fc8d416bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d2ffd700 1 -- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d415a680 msgr2=0x7fc8d416bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d2ffd700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d415a680 0x7fc8d416bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d2ffd700 1 -- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d40d1c30 msgr2=0x7fc8d40ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d2ffd700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d40d1c30 0x7fc8d40ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d2ffd700 1 -- 172.21.15.29:0/756282363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40093c0 con 0x7fc8d415a2b0 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.781+0000 7fc8d3fff700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d415a680 0x7fc8d416bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.782+0000 7fc8d2ffd700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d416b750 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800b5e0 tx=0x7fc8c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.782+0000 7fc8bb7fe700 1 -- 172.21.15.29:0/756282363 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800f510 con 0x7fc8d415a2b0 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.782+0000 7fc8bb7fe700 1 -- 172.21.15.29:0/756282363 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c800f670 con 0x7fc8d415a2b0 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.782+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d40c9ff0 con 0x7fc8d415a2b0 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.782+0000 7fc8bb7fe700 1 -- 172.21.15.29:0/756282363 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800fa30 con 0x7fc8d415a2b0 2023-10-08T15:42:31.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.782+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d415e3f0 con 0x7fc8d415a2b0 2023-10-08T15:42:31.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.783+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d40ca180 con 0x7fc8d415a2b0 2023-10-08T15:42:31.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.783+0000 7fc8bb7fe700 1 -- 172.21.15.29:0/756282363 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8c801a400 con 0x7fc8d415a2b0 2023-10-08T15:42:31.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.783+0000 7fc8bb7fe700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc8c0066f30 0x7fc8c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:31.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.784+0000 7fc8bb7fe700 1 -- 172.21.15.29:0/756282363 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8c8084060 con 0x7fc8d415a2b0 2023-10-08T15:42:31.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.784+0000 7fc8d37fe700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc8c0066f30 0x7fc8c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:31.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.784+0000 7fc8d37fe700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc8c0066f30 0x7fc8c00693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009160 tx=0x7fc8c4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:31.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:31.788+0000 7fc8bb7fe700 1 -- 172.21.15.29:0/756282363 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8c8051350 con 0x7fc8d415a2b0 2023-10-08T15:42:32.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.025+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8d404c3c0 con 0x7fc8d415a2b0 2023-10-08T15:42:32.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.025+0000 7fc8bb7fe700 1 -- 172.21.15.29:0/756282363 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fc8c8054970 con 0x7fc8d415a2b0 2023-10-08T15:42:32.026 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:32.026 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5159,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1628528750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1628528750},{"type":"v1","addr":"172.21.15.29:6835","nonce":1628528750}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/395273217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6835","nonce":395273217},{"type":"v1","addr":"172.21.15.183:6837","nonce":395273217}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/2201771630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2201771630},{"type":"v1","addr":"172.21.15.183:6836","nonce":2201771630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T15:42:28.001704+0000","modified":"2023-10-08T15:42:31.633429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5706},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5706":{"gid":5706,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/1782686429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":1782686429},{"type":"v1","addr":"172.21.15.29:6834","nonce":1782686429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T15:42:32.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.027+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc8c0066f30 msgr2=0x7fc8c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.027+0000 7fc8da11e700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc8c0066f30 0x7fc8c00693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009160 tx=0x7fc8c4016000 comp rx=0 tx=0).stop 2023-10-08T15:42:32.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.027+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 msgr2=0x7fc8d416b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.027+0000 7fc8da11e700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d416b750 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800b5e0 tx=0x7fc8c80091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.028+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 shutdown_connections 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.028+0000 7fc8da11e700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc8c0066f30 0x7fc8c00693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.028+0000 7fc8da11e700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8d415a680 0x7fc8d416bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.028+0000 7fc8da11e700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8d40d1c30 0x7fc8d40ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.028+0000 7fc8da11e700 1 --2- 172.21.15.29:0/756282363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8d415a2b0 0x7fc8d416b750 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.028+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 >> 172.21.15.29:0/756282363 conn(0x7fc8d4067e40 msgr2=0x7fc8d4069300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.028+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 shutdown_connections 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.028+0000 7fc8da11e700 1 -- 172.21.15.29:0/756282363 wait complete. 2023-10-08T15:42:32.029 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 34 2023-10-08T15:42:32.040 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T15:42:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.158+0000 7efcac963700 1 Processor -- start 2023-10-08T15:42:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.159+0000 7efcac963700 1 -- start start 2023-10-08T15:42:32.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.159+0000 7efcac963700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efca80b3430 0x7efca8164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.159+0000 7efcac963700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca815db80 con 0x7efca8159e10 2023-10-08T15:42:32.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.159+0000 7efcac963700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca815de60 con 0x7efca815a1e0 2023-10-08T15:42:32.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.159+0000 7efcac963700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca815e800 con 0x7efca80b3430 2023-10-08T15:42:32.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca6d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efca80b3430 0x7efca8164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca659c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efca8159e10 0x7efca80b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43904/0 (socket says 172.21.15.29:43904) 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca659c700 1 -- 172.21.15.29:0/3169075252 learned_addr learned my addr 172.21.15.29:0/3169075252 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca6d9d700 1 -- 172.21.15.29:0/3169075252 >> v1:172.21.15.183:6789/0 conn(0x7efca815a1e0 legacy=0x7efca80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca6d9d700 1 -- 172.21.15.29:0/3169075252 >> v1:172.21.15.29:6789/0 conn(0x7efca8159e10 legacy=0x7efca80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca6d9d700 1 -- 172.21.15.29:0/3169075252 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca815e140 con 0x7efca80b3430 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca559a700 1 -- 172.21.15.29:0/3169075252 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294206130 0 0) 0x7efca815db80 con 0x7efca8159e10 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca6d9d700 1 --2- 172.21.15.29:0/3169075252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca8164e20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efc98009e60 tx=0x7efc98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c346418f66274e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca559a700 1 -- 172.21.15.29:0/3169075252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800e070 con 0x7efca80b3430 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca559a700 1 -- 172.21.15.29:0/3169075252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9800bc30 con 0x7efca80b3430 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.160+0000 7efca559a700 1 -- 172.21.15.29:0/3169075252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98012430 con 0x7efca80b3430 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.161+0000 7efcac963700 1 -- 172.21.15.29:0/3169075252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 msgr2=0x7efca8164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.161+0000 7efcac963700 1 --2- 172.21.15.29:0/3169075252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca8164e20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efc98009e60 tx=0x7efc98009780 comp rx=0 tx=0).stop 2023-10-08T15:42:32.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.161+0000 7efcac963700 1 -- 172.21.15.29:0/3169075252 shutdown_connections 2023-10-08T15:42:32.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.161+0000 7efcac963700 1 --2- 172.21.15.29:0/3169075252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca8164e20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.161+0000 7efcac963700 1 -- 172.21.15.29:0/3169075252 >> 172.21.15.29:0/3169075252 conn(0x7efca8067660 msgr2=0x7efca8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.161+0000 7efcac963700 1 -- 172.21.15.29:0/3169075252 shutdown_connections 2023-10-08T15:42:32.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.161+0000 7efcac963700 1 -- 172.21.15.29:0/3169075252 wait complete. 2023-10-08T15:42:32.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.162+0000 7efcac963700 1 Processor -- start 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.162+0000 7efcac963700 1 -- start start 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efcac963700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca80d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efcac963700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efca8159e10 0x7efca816d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efcac963700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efca815a1e0 0x7efca816d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efcac963700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80c93d0 con 0x7efca80b3430 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efcac963700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80c8dc0 con 0x7efca815a1e0 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efcac963700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80d18a0 con 0x7efca8159e10 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca80d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca80d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51524/0 (socket says 172.21.15.29:51524) 2023-10-08T15:42:32.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 -- 172.21.15.29:0/1103132902 learned_addr learned my addr 172.21.15.29:0/1103132902 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca5d9b700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efca8159e10 0x7efca816d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca6d9d700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efca815a1e0 0x7efca816d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 -- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efca8159e10 msgr2=0x7efca816d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efca8159e10 0x7efca816d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 -- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efca815a1e0 msgr2=0x7efca816d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efca815a1e0 0x7efca816d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 -- 172.21.15.29:0/1103132902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009a20 con 0x7efca80b3430 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca6d9d700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efca815a1e0 0x7efca816d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efca659c700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca80d0d90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7efca000c7e0 tx=0x7efca0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efc9e7fc700 1 -- 172.21.15.29:0/1103132902 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0005b30 con 0x7efca80b3430 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efc9e7fc700 1 -- 172.21.15.29:0/1103132902 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0005c90 con 0x7efca80b3430 2023-10-08T15:42:32.168 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca80c9060 con 0x7efca80b3430 2023-10-08T15:42:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efc9e7fc700 1 -- 172.21.15.29:0/1103132902 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0007300 con 0x7efca80b3430 2023-10-08T15:42:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.163+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca80d1b80 con 0x7efca80b3430 2023-10-08T15:42:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.164+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca80c91f0 con 0x7efca80b3430 2023-10-08T15:42:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.165+0000 7efc9e7fc700 1 -- 172.21.15.29:0/1103132902 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efca00076b0 con 0x7efca80b3430 2023-10-08T15:42:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.165+0000 7efc9e7fc700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc88066f30 0x7efc880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.165+0000 7efc9e7fc700 1 -- 172.21.15.29:0/1103132902 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efca0083aa0 con 0x7efca80b3430 2023-10-08T15:42:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.166+0000 7efca5d9b700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc88066f30 0x7efc880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.169 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.166+0000 7efca5d9b700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc88066f30 0x7efc880693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efca80b5ea0 tx=0x7efc90007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.170 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.170+0000 7efc9e7fc700 1 -- 172.21.15.29:0/1103132902 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efca0050d10 con 0x7efca80b3430 2023-10-08T15:42:32.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.364+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efca804c3c0 con 0x7efca80b3430 2023-10-08T15:42:32.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.365+0000 7efc9e7fc700 1 -- 172.21.15.29:0/1103132902 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+15350 (secure 0 0 0) 0x7efca0017020 con 0x7efca80b3430 2023-10-08T15:42:32.365 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:32.365 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":65,"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","created":"2023-10-08T15:40:06.698823+0000","modified":"2023-10-08T15:42:29.613850+0000","last_up_change":"2023-10-08T15:40:12.124600+0000","last_in_change":"2023-10-08T15:40:09.117651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T15:40:12.381633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T15:42:26.414968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T15:42:26.974018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":86356},{"type":"v1","addr":"172.21.15.29:6801","nonce":86356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":86356},{"type":"v1","addr":"172.21.15.29:6803","nonce":86356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":86356},{"type":"v1","addr":"172.21.15.29:6807","nonce":86356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":86356},{"type":"v1","addr":"172.21.15.29:6805","nonce":86356}]},"public_addr":"172.21.15.29:6801/86356","cluster_addr":"172.21.15.29:6803/86356","heartbeat_back_addr":"172.21.15.29:6807/86356","heartbeat_front_addr":"172.21.15.29:6805/86356","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":86358},{"type":"v1","addr":"172.21.15.29:6809","nonce":86358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":86358},{"type":"v1","addr":"172.21.15.29:6811","nonce":86358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":86358},{"type":"v1","addr":"172.21.15.29:6815","nonce":86358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":86358},{"type":"v1","addr":"172.21.15.29:6813","nonce":86358}]},"public_addr":"172.21.15.29:6809/86358","cluster_addr":"172.21.15.29:6811/86358","heartbeat_back_addr":"172.21.15.29:6815/86358","heartbeat_front_addr":"172.21.15.29:6813/86358","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":86359},{"type":"v1","addr":"172.21.15.29:6817","nonce":86359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":86359},{"type":"v1","addr":"172.21.15.29:6819","nonce":86359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6823","nonce":86359},{"type":"v1","addr":"172.21.15.29:6825","nonce":86359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":86359},{"type":"v1","addr":"172.21.15.29:6821","nonce":86359}]},"public_addr":"172.21.15.29:6817/86359","cluster_addr":"172.21.15.29:6819/86359","heartbeat_back_addr":"172.21.15.29:6825/86359","heartbeat_front_addr":"172.21.15.29:6821/86359","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":86379},{"type":"v1","addr":"172.21.15.29:6824","nonce":86379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":86379},{"type":"v1","addr":"172.21.15.29:6827","nonce":86379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":86379},{"type":"v1","addr":"172.21.15.29:6831","nonce":86379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":86379},{"type":"v1","addr":"172.21.15.29:6829","nonce":86379}]},"public_addr":"172.21.15.29:6824/86379","cluster_addr":"172.21.15.29:6827/86379","heartbeat_back_addr":"172.21.15.29:6831/86379","heartbeat_front_addr":"172.21.15.29:6829/86379","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6819","nonce":86587},{"type":"v1","addr":"172.21.15.183:6821","nonce":86587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6823","nonce":86587},{"type":"v1","addr":"172.21.15.183:6826","nonce":86587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":86587},{"type":"v1","addr":"172.21.15.183:6831","nonce":86587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":86587},{"type":"v1","addr":"172.21.15.183:6829","nonce":86587}]},"public_addr":"172.21.15.183:6821/86587","cluster_addr":"172.21.15.183:6826/86587","heartbeat_back_addr":"172.21.15.183:6831/86587","heartbeat_front_addr":"172.21.15.183:6829/86587","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":86596},{"type":"v1","addr":"172.21.15.183:6817","nonce":86596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":86596},{"type":"v1","addr":"172.21.15.183:6820","nonce":86596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6825","nonce":86596},{"type":"v1","addr":"172.21.15.183:6827","nonce":86596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":86596},{"type":"v1","addr":"172.21.15.183:6824","nonce":86596}]},"public_addr":"172.21.15.183:6817/86596","cluster_addr":"172.21.15.183:6820/86596","heartbeat_back_addr":"172.21.15.183:6827/86596","heartbeat_front_addr":"172.21.15.183:6824/86596","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":86585},{"type":"v1","addr":"172.21.15.183:6801","nonce":86585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":86585},{"type":"v1","addr":"172.21.15.183:6803","nonce":86585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":86585},{"type":"v1","addr":"172.21.15.183:6807","nonce":86585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":86585},{"type":"v1","addr":"172.21.15.183:6805","nonce":86585}]},"public_addr":"172.21.15.183:6801/86585","cluster_addr":"172.21.15.183:6803/86585","heartbeat_back_addr":"172.21.15.183:6807/86585","heartbeat_front_addr":"172.21.15.183:6805/86585","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":86586},{"type":"v1","addr":"172.21.15.183:6809","nonce":86586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":86586},{"type":"v1","addr":"172.21.15.183:6811","nonce":86586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":86586},{"type":"v1","addr":"172.21.15.183:6815","nonce":86586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":86586},{"type":"v1","addr":"172.21.15.183:6813","nonce":86586}]},"public_addr":"172.21.15.183:6809/86586","cluster_addr":"172.21.15.183:6811/86586","heartbeat_back_addr":"172.21.15.183:6815/86586","heartbeat_front_addr":"172.21.15.183:6813/86586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.252513+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.293514+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.271170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.272577+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.317440+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.309422+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.276770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T15:40:10.222500+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T15:42:32.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.366+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc88066f30 msgr2=0x7efc880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.366+0000 7efcac963700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc88066f30 0x7efc880693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efca80b5ea0 tx=0x7efc90007ea0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.367 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.366+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 msgr2=0x7efca80d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.366+0000 7efcac963700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca80d0d90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7efca000c7e0 tx=0x7efca0007df0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.367+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 shutdown_connections 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.367+0000 7efcac963700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7efc88066f30 0x7efc880693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.367+0000 7efcac963700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efca815a1e0 0x7efca816d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.367+0000 7efcac963700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efca80b3430 0x7efca80d0d90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.367+0000 7efcac963700 1 --2- 172.21.15.29:0/1103132902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efca8159e10 0x7efca816d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.367+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 >> 172.21.15.29:0/1103132902 conn(0x7efca8067660 msgr2=0x7efca815a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.367+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 shutdown_connections 2023-10-08T15:42:32.368 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.367+0000 7efcac963700 1 -- 172.21.15.29:0/1103132902 wait complete. 2023-10-08T15:42:32.379 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T15:42:32.379 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:42:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.498+0000 7f99c0245700 1 Processor -- start 2023-10-08T15:42:32.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.498+0000 7f99c0245700 1 -- start start 2023-10-08T15:42:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.498+0000 7f99c0245700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 0x7f99b80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.498+0000 7f99c0245700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99b815a1e0 0x7f99b80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.498+0000 7f99c0245700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99b80b1610 0x7f99b80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.498+0000 7f99c0245700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b815e800 con 0x7f99b815a1e0 2023-10-08T15:42:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99c0245700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b815db80 con 0x7f99b80b1610 2023-10-08T15:42:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99c0245700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815de60 con 0x7f99b8159e10 2023-10-08T15:42:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99b815a1e0 0x7f99b80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.500 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f99b815a1e0 0x7f99b80b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51538/0 (socket says 172.21.15.29:51538) 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 -- 172.21.15.29:0/1645793790 learned_addr learned my addr 172.21.15.29:0/1645793790 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99be7e2700 1 --2- 172.21.15.29:0/1645793790 >> v2:172.21.15.183:3300/0 conn(0x7f99b80b1610 0x7f99b80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bdfe1700 1 --2- 172.21.15.29:0/1645793790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 0x7f99b80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 -- 172.21.15.29:0/1645793790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 msgr2=0x7f99b80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 --2- 172.21.15.29:0/1645793790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 0x7f99b80b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 -- 172.21.15.29:0/1645793790 >> v2:172.21.15.183:3300/0 conn(0x7f99b80b1610 msgr2=0x7f99b80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 --2- 172.21.15.29:0/1645793790 >> v2:172.21.15.183:3300/0 conn(0x7f99b80b1610 0x7f99b80cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 -- 172.21.15.29:0/1645793790 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b815e140 con 0x7f99b815a1e0 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99be7e2700 1 --2- 172.21.15.29:0/1645793790 >> v2:172.21.15.183:3300/0 conn(0x7f99b80b1610 0x7f99b80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bd7e0700 1 --2- 172.21.15.29:0/1645793790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b80b3260 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f99b8069d00 tx=0x7f99ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a27a7f2da6a4ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bcfdf700 1 -- 172.21.15.29:0/1645793790 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac009e70 con 0x7f99b815a1e0 2023-10-08T15:42:32.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bcfdf700 1 -- 172.21.15.29:0/1645793790 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00b860 con 0x7f99b815a1e0 2023-10-08T15:42:32.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.499+0000 7f99bcfdf700 1 -- 172.21.15.29:0/1645793790 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00bc00 con 0x7f99b815a1e0 2023-10-08T15:42:32.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 -- 172.21.15.29:0/1645793790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 msgr2=0x7f99b80b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 --2- 172.21.15.29:0/1645793790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b80b3260 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f99b8069d00 tx=0x7f99ac009250 comp rx=0 tx=0).stop 2023-10-08T15:42:32.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 -- 172.21.15.29:0/1645793790 shutdown_connections 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 --2- 172.21.15.29:0/1645793790 >> v2:172.21.15.183:3300/0 conn(0x7f99b80b1610 0x7f99b80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 --2- 172.21.15.29:0/1645793790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 0x7f99b80b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 --2- 172.21.15.29:0/1645793790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b80b3260 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 -- 172.21.15.29:0/1645793790 >> 172.21.15.29:0/1645793790 conn(0x7f99b8067660 msgr2=0x7f99b8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 -- 172.21.15.29:0/1645793790 shutdown_connections 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.500+0000 7f99c0245700 1 -- 172.21.15.29:0/1645793790 wait complete. 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.501+0000 7f99c0245700 1 Processor -- start 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.501+0000 7f99c0245700 1 -- start start 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99c0245700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b80b1610 0x7f99b80cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99c0245700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 0x7f99b8156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99c0245700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99c0245700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80c4900 con 0x7f99b815a1e0 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99c0245700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80c7d50 con 0x7f99b80b1610 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99c0245700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80c8d60 con 0x7f99b8159e10 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99be7e2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99be7e2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b81565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51544/0 (socket says 172.21.15.29:51544) 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99be7e2700 1 -- 172.21.15.29:0/437935345 learned_addr learned my addr 172.21.15.29:0/437935345 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99bd7e0700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 0x7f99b8156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99bdfe1700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b80b1610 0x7f99b80cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99be7e2700 1 -- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 msgr2=0x7f99b8156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99be7e2700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 0x7f99b8156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99be7e2700 1 -- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b80b1610 msgr2=0x7f99b80cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99be7e2700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b80b1610 0x7f99b80cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.502+0000 7f99be7e2700 1 -- 172.21.15.29:0/437935345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0094f0 con 0x7f99b815a1e0 2023-10-08T15:42:32.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.503+0000 7f99be7e2700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b81565b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f99a800d180 tx=0x7f99a8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.503+0000 7f99b5ffb700 1 -- 172.21.15.29:0/437935345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800de20 con 0x7f99b815a1e0 2023-10-08T15:42:32.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.503+0000 7f99b5ffb700 1 -- 172.21.15.29:0/437935345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800f040 con 0x7f99b815a1e0 2023-10-08T15:42:32.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.503+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b80c7fa0 con 0x7f99b815a1e0 2023-10-08T15:42:32.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.503+0000 7f99b5ffb700 1 -- 172.21.15.29:0/437935345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8015690 con 0x7f99b815a1e0 2023-10-08T15:42:32.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.503+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b80c8560 con 0x7f99b815a1e0 2023-10-08T15:42:32.507 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.504+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b804c3c0 con 0x7f99b815a1e0 2023-10-08T15:42:32.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.504+0000 7f99b5ffb700 1 -- 172.21.15.29:0/437935345 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99a801e3b0 con 0x7f99b815a1e0 2023-10-08T15:42:32.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.505+0000 7f99b5ffb700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a4066f30 0x7f99a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.505+0000 7f99b5ffb700 1 -- 172.21.15.29:0/437935345 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99a8084b10 con 0x7f99b815a1e0 2023-10-08T15:42:32.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.505+0000 7f99bdfe1700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a4066f30 0x7f99a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.508 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.505+0000 7f99bdfe1700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a4066f30 0x7f99a40693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99b00093f0 tx=0x7f99b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.509 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.509+0000 7f99b5ffb700 1 -- 172.21.15.29:0/437935345 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99a8051d80 con 0x7f99b815a1e0 2023-10-08T15:42:32.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.702+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99b815e420 con 0x7f99a4066f30 2023-10-08T15:42:32.712 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.711+0000 7f99b5ffb700 1 -- 172.21.15.29:0/437935345 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282077 (secure 0 0 0) 0x7f99b815e420 con 0x7f99a4066f30 2023-10-08T15:42:32.715 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:32.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a4066f30 msgr2=0x7f99a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a4066f30 0x7f99a40693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99b00093f0 tx=0x7f99b0008040 comp rx=0 tx=0).stop 2023-10-08T15:42:32.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 msgr2=0x7f99b81565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b81565b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f99a800d180 tx=0x7f99a8009a50 comp rx=0 tx=0).stop 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 shutdown_connections 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7f99a4066f30 0x7f99a40693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99b815a1e0 0x7f99b81565b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99b80b1610 0x7f99b80cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 --2- 172.21.15.29:0/437935345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99b8159e10 0x7f99b8156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 >> 172.21.15.29:0/437935345 conn(0x7f99b8067660 msgr2=0x7f99b8063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 shutdown_connections 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.715+0000 7f99c0245700 1 -- 172.21.15.29:0/437935345 wait complete. 2023-10-08T15:42:32.718 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:42:32.727 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T15:42:32.331886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558859,"statfs":{"total":1600000000,"available":1596272197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.736567"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601687+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:55.570870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.607221+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:27.352801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600112+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603556+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601537+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:23.538777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604309+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609114+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604009+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.912660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609243+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601952+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:18.203834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602669+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:53:46.032289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606649+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.598789+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:08.078340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608838+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608523+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:08.654848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603897+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606862+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:28.903245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601477+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:13.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601923+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:00.938697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602385+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:55.487938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601623+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604457+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:46.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601106+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:43.244678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.599077+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601152+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:04.459275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603368+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604222+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601020+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:26.101902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602846+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:45.541087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602092+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601319+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:43.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603844+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606249+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611920+0000","last_change":"2023-10-08T15:42:27.611920+0000","last_active":"2023-10-08T15:42:27.611920+0000","last_peered":"2023-10-08T15:42:27.611920+0000","last_clean":"2023-10-08T15:42:27.611920+0000","last_became_active":"2023-10-08T15:42:27.611355+0000","last_became_peered":"2023-10-08T15:42:27.611355+0000","last_unstale":"2023-10-08T15:42:27.611920+0000","last_undegraded":"2023-10-08T15:42:27.611920+0000","last_fullsized":"2023-10-08T15:42:27.611920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601458+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606608+0000","last_change":"2023-10-08T15:42:27.606608+0000","last_active":"2023-10-08T15:42:27.606608+0000","last_peered":"2023-10-08T15:42:27.606608+0000","last_clean":"2023-10-08T15:42:27.606608+0000","last_became_active":"2023-10-08T15:42:27.604697+0000","last_became_peered":"2023-10-08T15:42:27.604697+0000","last_unstale":"2023-10-08T15:42:27.606608+0000","last_undegraded":"2023-10-08T15:42:27.606608+0000","last_fullsized":"2023-10-08T15:42:27.606608+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:51.458648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603012+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.607668+0000","last_change":"2023-10-08T15:42:27.607668+0000","last_active":"2023-10-08T15:42:27.607668+0000","last_peered":"2023-10-08T15:42:27.607668+0000","last_clean":"2023-10-08T15:42:27.607668+0000","last_became_active":"2023-10-08T15:42:27.607433+0000","last_became_peered":"2023-10-08T15:42:27.607433+0000","last_unstale":"2023-10-08T15:42:27.607668+0000","last_undegraded":"2023-10-08T15:42:27.607668+0000","last_fullsized":"2023-10-08T15:42:27.607668+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603465+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608294+0000","last_change":"2023-10-08T15:42:27.608294+0000","last_active":"2023-10-08T15:42:27.608294+0000","last_peered":"2023-10-08T15:42:27.608294+0000","last_clean":"2023-10-08T15:42:27.608294+0000","last_became_active":"2023-10-08T15:42:27.607485+0000","last_became_peered":"2023-10-08T15:42:27.607485+0000","last_unstale":"2023-10-08T15:42:27.608294+0000","last_undegraded":"2023-10-08T15:42:27.608294+0000","last_fullsized":"2023-10-08T15:42:27.608294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603629+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:47.705816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606991+0000","last_change":"2023-10-08T15:42:27.606991+0000","last_active":"2023-10-08T15:42:27.606991+0000","last_peered":"2023-10-08T15:42:27.606991+0000","last_clean":"2023-10-08T15:42:27.606991+0000","last_became_active":"2023-10-08T15:42:27.605095+0000","last_became_peered":"2023-10-08T15:42:27.605095+0000","last_unstale":"2023-10-08T15:42:27.606991+0000","last_undegraded":"2023-10-08T15:42:27.606991+0000","last_fullsized":"2023-10-08T15:42:27.606991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604097+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:17.846696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611581+0000","last_change":"2023-10-08T15:42:27.611581+0000","last_active":"2023-10-08T15:42:27.611581+0000","last_peered":"2023-10-08T15:42:27.611581+0000","last_clean":"2023-10-08T15:42:27.611581+0000","last_became_active":"2023-10-08T15:42:27.610685+0000","last_became_peered":"2023-10-08T15:42:27.610685+0000","last_unstale":"2023-10-08T15:42:27.611581+0000","last_undegraded":"2023-10-08T15:42:27.611581+0000","last_fullsized":"2023-10-08T15:42:27.611581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:31.175452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.598953+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606948+0000","last_change":"2023-10-08T15:42:27.606948+0000","last_active":"2023-10-08T15:42:27.606948+0000","last_peered":"2023-10-08T15:42:27.606948+0000","last_clean":"2023-10-08T15:42:27.606948+0000","last_became_active":"2023-10-08T15:42:27.606480+0000","last_became_peered":"2023-10-08T15:42:27.606480+0000","last_unstale":"2023-10-08T15:42:27.606948+0000","last_undegraded":"2023-10-08T15:42:27.606948+0000","last_fullsized":"2023-10-08T15:42:27.606948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602459+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:44.805051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611515+0000","last_change":"2023-10-08T15:42:27.611515+0000","last_active":"2023-10-08T15:42:27.611515+0000","last_peered":"2023-10-08T15:42:27.611515+0000","last_clean":"2023-10-08T15:42:27.611515+0000","last_became_active":"2023-10-08T15:42:27.611282+0000","last_became_peered":"2023-10-08T15:42:27.611282+0000","last_unstale":"2023-10-08T15:42:27.611515+0000","last_undegraded":"2023-10-08T15:42:27.611515+0000","last_fullsized":"2023-10-08T15:42:27.611515+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:32.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608500+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:17.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610407+0000","last_change":"2023-10-08T15:42:27.610407+0000","last_active":"2023-10-08T15:42:27.610407+0000","last_peered":"2023-10-08T15:42:27.610407+0000","last_clean":"2023-10-08T15:42:27.610407+0000","last_became_active":"2023-10-08T15:42:27.610216+0000","last_became_peered":"2023-10-08T15:42:27.610216+0000","last_unstale":"2023-10-08T15:42:27.610407+0000","last_undegraded":"2023-10-08T15:42:27.610407+0000","last_fullsized":"2023-10-08T15:42:27.610407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:07.651992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601242+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:01.687127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612937+0000","last_change":"2023-10-08T15:42:27.612937+0000","last_active":"2023-10-08T15:42:27.612937+0000","last_peered":"2023-10-08T15:42:27.612937+0000","last_clean":"2023-10-08T15:42:27.612937+0000","last_became_active":"2023-10-08T15:42:27.611760+0000","last_became_peered":"2023-10-08T15:42:27.611760+0000","last_unstale":"2023-10-08T15:42:27.612937+0000","last_undegraded":"2023-10-08T15:42:27.612937+0000","last_fullsized":"2023-10-08T15:42:27.612937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:00.974267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602300+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:57.494832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608865+0000","last_change":"2023-10-08T15:42:27.608865+0000","last_active":"2023-10-08T15:42:27.608865+0000","last_peered":"2023-10-08T15:42:27.608865+0000","last_clean":"2023-10-08T15:42:27.608865+0000","last_became_active":"2023-10-08T15:42:27.608647+0000","last_became_peered":"2023-10-08T15:42:27.608647+0000","last_unstale":"2023-10-08T15:42:27.608865+0000","last_undegraded":"2023-10-08T15:42:27.608865+0000","last_fullsized":"2023-10-08T15:42:27.608865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600569+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612650+0000","last_change":"2023-10-08T15:42:27.612650+0000","last_active":"2023-10-08T15:42:27.612650+0000","last_peered":"2023-10-08T15:42:27.612650+0000","last_clean":"2023-10-08T15:42:27.612650+0000","last_became_active":"2023-10-08T15:42:27.612488+0000","last_became_peered":"2023-10-08T15:42:27.612488+0000","last_unstale":"2023-10-08T15:42:27.612650+0000","last_undegraded":"2023-10-08T15:42:27.612650+0000","last_fullsized":"2023-10-08T15:42:27.612650+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:28.756571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602996+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610802+0000","last_change":"2023-10-08T15:42:27.610802+0000","last_active":"2023-10-08T15:42:27.610802+0000","last_peered":"2023-10-08T15:42:27.610802+0000","last_clean":"2023-10-08T15:42:27.610802+0000","last_became_active":"2023-10-08T15:42:27.610563+0000","last_became_peered":"2023-10-08T15:42:27.610563+0000","last_unstale":"2023-10-08T15:42:27.610802+0000","last_undegraded":"2023-10-08T15:42:27.610802+0000","last_fullsized":"2023-10-08T15:42:27.610802+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:41.327009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600707+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.603910+0000","last_change":"2023-10-08T15:42:27.603910+0000","last_active":"2023-10-08T15:42:27.603910+0000","last_peered":"2023-10-08T15:42:27.603910+0000","last_clean":"2023-10-08T15:42:27.603910+0000","last_became_active":"2023-10-08T15:42:27.603674+0000","last_became_peered":"2023-10-08T15:42:27.603674+0000","last_unstale":"2023-10-08T15:42:27.603910+0000","last_undegraded":"2023-10-08T15:42:27.603910+0000","last_fullsized":"2023-10-08T15:42:27.603910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:38.140823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609074+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610059+0000","last_change":"2023-10-08T15:42:27.610059+0000","last_active":"2023-10-08T15:42:27.610059+0000","last_peered":"2023-10-08T15:42:27.610059+0000","last_clean":"2023-10-08T15:42:27.610059+0000","last_became_active":"2023-10-08T15:42:27.609836+0000","last_became_peered":"2023-10-08T15:42:27.609836+0000","last_unstale":"2023-10-08T15:42:27.610059+0000","last_undegraded":"2023-10-08T15:42:27.610059+0000","last_fullsized":"2023-10-08T15:42:27.610059+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:56.732723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600106+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610874+0000","last_change":"2023-10-08T15:42:27.610874+0000","last_active":"2023-10-08T15:42:27.610874+0000","last_peered":"2023-10-08T15:42:27.610874+0000","last_clean":"2023-10-08T15:42:27.610874+0000","last_became_active":"2023-10-08T15:42:27.610604+0000","last_became_peered":"2023-10-08T15:42:27.610604+0000","last_unstale":"2023-10-08T15:42:27.610874+0000","last_undegraded":"2023-10-08T15:42:27.610874+0000","last_fullsized":"2023-10-08T15:42:27.610874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600168+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611354+0000","last_change":"2023-10-08T15:42:27.611354+0000","last_active":"2023-10-08T15:42:27.611354+0000","last_peered":"2023-10-08T15:42:27.611354+0000","last_clean":"2023-10-08T15:42:27.611354+0000","last_became_active":"2023-10-08T15:42:27.611057+0000","last_became_peered":"2023-10-08T15:42:27.611057+0000","last_unstale":"2023-10-08T15:42:27.611354+0000","last_undegraded":"2023-10-08T15:42:27.611354+0000","last_fullsized":"2023-10-08T15:42:27.611354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:33.021077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603169+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609472+0000","last_change":"2023-10-08T15:42:27.609472+0000","last_active":"2023-10-08T15:42:27.609472+0000","last_peered":"2023-10-08T15:42:27.609472+0000","last_clean":"2023-10-08T15:42:27.609472+0000","last_became_active":"2023-10-08T15:42:27.608911+0000","last_became_peered":"2023-10-08T15:42:27.608911+0000","last_unstale":"2023-10-08T15:42:27.609472+0000","last_undegraded":"2023-10-08T15:42:27.609472+0000","last_fullsized":"2023-10-08T15:42:27.609472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603716+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:41.709042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.607991+0000","last_change":"2023-10-08T15:42:27.607991+0000","last_active":"2023-10-08T15:42:27.607991+0000","last_peered":"2023-10-08T15:42:27.607991+0000","last_clean":"2023-10-08T15:42:27.607991+0000","last_became_active":"2023-10-08T15:42:27.607138+0000","last_became_peered":"2023-10-08T15:42:27.607138+0000","last_unstale":"2023-10-08T15:42:27.607991+0000","last_undegraded":"2023-10-08T15:42:27.607991+0000","last_fullsized":"2023-10-08T15:42:27.607991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:31.175452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600894+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610071+0000","last_change":"2023-10-08T15:42:27.610071+0000","last_active":"2023-10-08T15:42:27.610071+0000","last_peered":"2023-10-08T15:42:27.610071+0000","last_clean":"2023-10-08T15:42:27.610071+0000","last_became_active":"2023-10-08T15:42:27.609559+0000","last_became_peered":"2023-10-08T15:42:27.609559+0000","last_unstale":"2023-10-08T15:42:27.610071+0000","last_undegraded":"2023-10-08T15:42:27.610071+0000","last_fullsized":"2023-10-08T15:42:27.610071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602794+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612790+0000","last_change":"2023-10-08T15:42:27.612790+0000","last_active":"2023-10-08T15:42:27.612790+0000","last_peered":"2023-10-08T15:42:27.612790+0000","last_clean":"2023-10-08T15:42:27.612790+0000","last_became_active":"2023-10-08T15:42:27.612554+0000","last_became_peered":"2023-10-08T15:42:27.612554+0000","last_unstale":"2023-10-08T15:42:27.612790+0000","last_undegraded":"2023-10-08T15:42:27.612790+0000","last_fullsized":"2023-10-08T15:42:27.612790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:12.141956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604615+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.605851+0000","last_change":"2023-10-08T15:42:27.605851+0000","last_active":"2023-10-08T15:42:27.605851+0000","last_peered":"2023-10-08T15:42:27.605851+0000","last_clean":"2023-10-08T15:42:27.605851+0000","last_became_active":"2023-10-08T15:42:27.605608+0000","last_became_peered":"2023-10-08T15:42:27.605608+0000","last_unstale":"2023-10-08T15:42:27.605851+0000","last_undegraded":"2023-10-08T15:42:27.605851+0000","last_fullsized":"2023-10-08T15:42:27.605851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.375934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603082+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611050+0000","last_change":"2023-10-08T15:42:27.611050+0000","last_active":"2023-10-08T15:42:27.611050+0000","last_peered":"2023-10-08T15:42:27.611050+0000","last_clean":"2023-10-08T15:42:27.611050+0000","last_became_active":"2023-10-08T15:42:27.610828+0000","last_became_peered":"2023-10-08T15:42:27.610828+0000","last_unstale":"2023-10-08T15:42:27.611050+0000","last_undegraded":"2023-10-08T15:42:27.611050+0000","last_fullsized":"2023-10-08T15:42:27.611050+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601943+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609930+0000","last_change":"2023-10-08T15:42:27.609930+0000","last_active":"2023-10-08T15:42:27.609930+0000","last_peered":"2023-10-08T15:42:27.609930+0000","last_clean":"2023-10-08T15:42:27.609930+0000","last_became_active":"2023-10-08T15:42:27.609628+0000","last_became_peered":"2023-10-08T15:42:27.609628+0000","last_unstale":"2023-10-08T15:42:27.609930+0000","last_undegraded":"2023-10-08T15:42:27.609930+0000","last_fullsized":"2023-10-08T15:42:27.609930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:38.140823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606284+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611758+0000","last_change":"2023-10-08T15:42:27.611758+0000","last_active":"2023-10-08T15:42:27.611758+0000","last_peered":"2023-10-08T15:42:27.611758+0000","last_clean":"2023-10-08T15:42:27.611758+0000","last_became_active":"2023-10-08T15:42:27.610993+0000","last_became_peered":"2023-10-08T15:42:27.610993+0000","last_unstale":"2023-10-08T15:42:27.611758+0000","last_undegraded":"2023-10-08T15:42:27.611758+0000","last_fullsized":"2023-10-08T15:42:27.611758+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:56.732723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601542+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608823+0000","last_change":"2023-10-08T15:42:27.608823+0000","last_active":"2023-10-08T15:42:27.608823+0000","last_peered":"2023-10-08T15:42:27.608823+0000","last_clean":"2023-10-08T15:42:27.608823+0000","last_became_active":"2023-10-08T15:42:27.608592+0000","last_became_peered":"2023-10-08T15:42:27.608592+0000","last_unstale":"2023-10-08T15:42:27.608823+0000","last_undegraded":"2023-10-08T15:42:27.608823+0000","last_fullsized":"2023-10-08T15:42:27.608823+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.375934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.605112+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609511+0000","last_change":"2023-10-08T15:42:27.609511+0000","last_active":"2023-10-08T15:42:27.609511+0000","last_peered":"2023-10-08T15:42:27.609511+0000","last_clean":"2023-10-08T15:42:27.609511+0000","last_became_active":"2023-10-08T15:42:27.609249+0000","last_became_peered":"2023-10-08T15:42:27.609249+0000","last_unstale":"2023-10-08T15:42:27.609511+0000","last_undegraded":"2023-10-08T15:42:27.609511+0000","last_fullsized":"2023-10-08T15:42:27.609511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603342+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:50.886815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606761+0000","last_change":"2023-10-08T15:42:27.606761+0000","last_active":"2023-10-08T15:42:27.606761+0000","last_peered":"2023-10-08T15:42:27.606761+0000","last_clean":"2023-10-08T15:42:27.606761+0000","last_became_active":"2023-10-08T15:42:27.606539+0000","last_became_peered":"2023-10-08T15:42:27.606539+0000","last_unstale":"2023-10-08T15:42:27.606761+0000","last_undegraded":"2023-10-08T15:42:27.606761+0000","last_fullsized":"2023-10-08T15:42:27.606761+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:58.871512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600519+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611631+0000","last_change":"2023-10-08T15:42:27.611631+0000","last_active":"2023-10-08T15:42:27.611631+0000","last_peered":"2023-10-08T15:42:27.611631+0000","last_clean":"2023-10-08T15:42:27.611631+0000","last_became_active":"2023-10-08T15:42:27.611438+0000","last_became_peered":"2023-10-08T15:42:27.611438+0000","last_unstale":"2023-10-08T15:42:27.611631+0000","last_undegraded":"2023-10-08T15:42:27.611631+0000","last_fullsized":"2023-10-08T15:42:27.611631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601913+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:40:27.513848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.605559+0000","last_change":"2023-10-08T15:42:27.605559+0000","last_active":"2023-10-08T15:42:27.605559+0000","last_peered":"2023-10-08T15:42:27.605559+0000","last_clean":"2023-10-08T15:42:27.605559+0000","last_became_active":"2023-10-08T15:42:27.605319+0000","last_became_peered":"2023-10-08T15:42:27.605319+0000","last_unstale":"2023-10-08T15:42:27.605559+0000","last_undegraded":"2023-10-08T15:42:27.605559+0000","last_fullsized":"2023-10-08T15:42:27.605559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:57.757560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603273+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:10.469412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606745+0000","last_change":"2023-10-08T15:42:27.606745+0000","last_active":"2023-10-08T15:42:27.606745+0000","last_peered":"2023-10-08T15:42:27.606745+0000","last_clean":"2023-10-08T15:42:27.606745+0000","last_became_active":"2023-10-08T15:42:27.605869+0000","last_became_peered":"2023-10-08T15:42:27.605869+0000","last_unstale":"2023-10-08T15:42:27.606745+0000","last_undegraded":"2023-10-08T15:42:27.606745+0000","last_fullsized":"2023-10-08T15:42:27.606745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:00.684271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602215+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:20.240936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608140+0000","last_change":"2023-10-08T15:42:27.608140+0000","last_active":"2023-10-08T15:42:27.608140+0000","last_peered":"2023-10-08T15:42:27.608140+0000","last_clean":"2023-10-08T15:42:27.608140+0000","last_became_active":"2023-10-08T15:42:27.607915+0000","last_became_peered":"2023-10-08T15:42:27.607915+0000","last_unstale":"2023-10-08T15:42:27.608140+0000","last_undegraded":"2023-10-08T15:42:27.608140+0000","last_fullsized":"2023-10-08T15:42:27.608140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:58.871512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T15:42:26.598021+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:42:26.598021+0000","last_peered":"2023-10-08T15:42:26.598021+0000","last_clean":"2023-10-08T15:42:26.598021+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:42:26.598021+0000","last_undegraded":"2023-10-08T15:42:26.598021+0000","last_fullsized":"2023-10-08T15:42:26.598021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088903,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.40000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.40699999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.505,"15min":0.505},"min":{"1min":0.36399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.69999999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41299999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.441},{"interface":"front","average":{"1min":0.626,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.39000000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70699999999999996,"5min":1.135,"15min":1.135},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72099999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68799999999999994,"5min":1.238,"15min":1.238},"last":0.36899999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59499999999999997,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67700000000000005,"5min":1.486,"15min":1.486},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70499999999999996,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51200000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.253}]},{"osd":5,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.626,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.61199999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.38100000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.752,"15min":0.752},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.437}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.314},{"interface":"front","average":{"1min":0.314,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44400000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.23899999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.46500000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48499999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.29899999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.435,"15min":0.438},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.374},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56599999999999995,"5min":1.046,"15min":1.046},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86799999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.40100000000000002}]},{"osd":5,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89000000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40899999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58599999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78600000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.439}]},{"osd":7,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85499999999999998,"5min":1.012,"15min":1.012},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088903,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.5,"5min":2.794,"15min":2.794},"last":0.377},{"interface":"front","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.25,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51900000000000002,"5min":2.073,"15min":2.073},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.496,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61799999999999999,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60299999999999998,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":2.863,"15min":2.863},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.754,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.70299999999999996,"15min":0.71799999999999997},"min":{"1min":0.45200000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82499999999999996,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.73299999999999998,"15min":0.751},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85999999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":2.004,"15min":2.004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83499999999999996,"5min":1.014,"15min":1.014},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48499999999999999,"5min":1.171,"15min":1.171},"last":0.252},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60699999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.373}]},{"osd":1,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48699999999999999,"5min":1.111,"15min":1.111},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53500000000000003,"5min":1.232,"15min":1.232},"last":0.33600000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51800000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.434,"15min":0.441},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68600000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84199999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83899999999999997,"5min":1.085,"15min":1.085},"last":0.40799999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82399999999999995,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.748,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51400000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.87,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.74199999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":1.286,"15min":1.286},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.32700000000000001,"15min":0.32100000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28100000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46500000000000002}]},{"osd":5,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83299999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.42899999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.505},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69499999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68999999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65600000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58499999999999996,"15min":0.59799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.34799999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.434}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.438},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.35999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.61099999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.48899999999999999,"15min":0.47299999999999998},"min":{"1min":0.38600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.35999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.622}]},{"osd":3,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.49099999999999999,"15min":0.47899999999999998},"min":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.505}]},{"osd":6,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79600000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65900000000000003}]}]}],"pool_statfs":[]}} 2023-10-08T15:42:32.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:42:32.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.887+0000 7fca0d454700 1 Processor -- start 2023-10-08T15:42:32.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.887+0000 7fca0d454700 1 -- start start 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca0d454700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca08156570 0x7fca0806d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca0d454700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca0815a330 0x7fca0806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca0d454700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca08157c30 con 0x7fca08156940 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca0d454700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca081584f0 con 0x7fca0815a330 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca0d454700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca08157670 con 0x7fca08156570 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca067fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca0815a330 0x7fca0806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca077fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fca08156940 0x7fca08156da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43908/0 (socket says 172.21.15.29:43908) 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca077fe700 1 -- 172.21.15.29:0/2536972000 learned_addr learned my addr 172.21.15.29:0/2536972000 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca06ffd700 1 --2- 172.21.15.29:0/2536972000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca08156570 0x7fca0806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca067fc700 1 -- 172.21.15.29:0/2536972000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca08156570 msgr2=0x7fca0806d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca067fc700 1 --2- 172.21.15.29:0/2536972000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca08156570 0x7fca0806d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca067fc700 1 -- 172.21.15.29:0/2536972000 >> v1:172.21.15.29:6789/0 conn(0x7fca08156940 legacy=0x7fca08156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca05ffb700 1 -- 172.21.15.29:0/2536972000 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458604845 0 0) 0x7fca08157c30 con 0x7fca08156940 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca067fc700 1 -- 172.21.15.29:0/2536972000 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08157950 con 0x7fca0815a330 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca067fc700 1 --2- 172.21.15.29:0/2536972000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca0815a330 0x7fca0806d8c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0098e0 tx=0x7fc9fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74646ec109b6866c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca05ffb700 1 -- 172.21.15.29:0/2536972000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc009e80 con 0x7fca0815a330 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca05ffb700 1 -- 172.21.15.29:0/2536972000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc00b860 con 0x7fca0815a330 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.888+0000 7fca05ffb700 1 -- 172.21.15.29:0/2536972000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00bbe0 con 0x7fca0815a330 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.889+0000 7fca0d454700 1 -- 172.21.15.29:0/2536972000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca0815a330 msgr2=0x7fca0806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.889+0000 7fca0d454700 1 --2- 172.21.15.29:0/2536972000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca0815a330 0x7fca0806d8c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0098e0 tx=0x7fc9fc0091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.889+0000 7fca0d454700 1 -- 172.21.15.29:0/2536972000 shutdown_connections 2023-10-08T15:42:32.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.889+0000 7fca0d454700 1 --2- 172.21.15.29:0/2536972000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca08156570 0x7fca0806d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.889+0000 7fca0d454700 1 --2- 172.21.15.29:0/2536972000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca0815a330 0x7fca0806d8c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.889+0000 7fca0d454700 1 -- 172.21.15.29:0/2536972000 >> 172.21.15.29:0/2536972000 conn(0x7fca08067660 msgr2=0x7fca08067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:32.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.889+0000 7fca0d454700 1 -- 172.21.15.29:0/2536972000 shutdown_connections 2023-10-08T15:42:32.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.889+0000 7fca0d454700 1 -- 172.21.15.29:0/2536972000 wait complete. 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.890+0000 7fca0d454700 1 Processor -- start 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.890+0000 7fca0d454700 1 -- start start 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca0d454700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca08156570 0x7fca080c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca0d454700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca08156940 0x7fca080adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca0d454700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca0815a330 0x7fca080b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca0d454700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c46b0 con 0x7fca08156570 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca0d454700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c5700 con 0x7fca08156940 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca0d454700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c3aa0 con 0x7fca0815a330 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca06ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca08156570 0x7fca080c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca06ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca08156570 0x7fca080c51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51556/0 (socket says 172.21.15.29:51556) 2023-10-08T15:42:32.896 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca06ffd700 1 -- 172.21.15.29:0/1892584483 learned_addr learned my addr 172.21.15.29:0/1892584483 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca06ffd700 1 -- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca0815a330 msgr2=0x7fca080b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca06ffd700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca0815a330 0x7fca080b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca06ffd700 1 -- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca08156940 msgr2=0x7fca080adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.891+0000 7fca06ffd700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca08156940 0x7fca080adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.892+0000 7fca06ffd700 1 -- 172.21.15.29:0/1892584483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009420 con 0x7fca08156570 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.892+0000 7fca06ffd700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca08156570 0x7fca080c51c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800d990 tx=0x7fc9f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.892+0000 7fc9eeffd700 1 -- 172.21.15.29:0/1892584483 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8007610 con 0x7fca08156570 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.892+0000 7fc9eeffd700 1 -- 172.21.15.29:0/1892584483 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f8007770 con 0x7fca08156570 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.892+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca080c3d80 con 0x7fca08156570 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.892+0000 7fc9eeffd700 1 -- 172.21.15.29:0/1892584483 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8007b30 con 0x7fca08156570 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.892+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca080c4340 con 0x7fca08156570 2023-10-08T15:42:32.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.893+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0804c3c0 con 0x7fca08156570 2023-10-08T15:42:32.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.893+0000 7fc9eeffd700 1 -- 172.21.15.29:0/1892584483 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9f8011460 con 0x7fca08156570 2023-10-08T15:42:32.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.893+0000 7fc9eeffd700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc9f4066f30 0x7fc9f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:32.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.894+0000 7fc9eeffd700 1 -- 172.21.15.29:0/1892584483 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9f8084720 con 0x7fca08156570 2023-10-08T15:42:32.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.894+0000 7fca067fc700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc9f4066f30 0x7fc9f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:32.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.894+0000 7fca067fc700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc9f4066f30 0x7fc9f40693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fca0815a700 tx=0x7fc9fc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:32.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:32.898+0000 7fc9eeffd700 1 -- 172.21.15.29:0/1892584483 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9f8051990 con 0x7fca08156570 2023-10-08T15:42:33.085 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.085+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca080ca130 con 0x7fc9f4066f30 2023-10-08T15:42:33.093 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.093+0000 7fc9eeffd700 1 -- 172.21.15.29:0/1892584483 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282077 (secure 0 0 0) 0x7fca080ca130 con 0x7fc9f4066f30 2023-10-08T15:42:33.097 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc9f4066f30 msgr2=0x7fc9f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc9f4066f30 0x7fc9f40693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fca0815a700 tx=0x7fc9fc017000 comp rx=0 tx=0).stop 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca08156570 msgr2=0x7fca080c51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca08156570 0x7fca080c51c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800d990 tx=0x7fc9f8008040 comp rx=0 tx=0).stop 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 shutdown_connections 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fc9f4066f30 0x7fc9f40693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca0815a330 0x7fca080b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca08156570 0x7fca080c51c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 --2- 172.21.15.29:0/1892584483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca08156940 0x7fca080adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 >> 172.21.15.29:0/1892584483 conn(0x7fca08067660 msgr2=0x7fca080caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 shutdown_connections 2023-10-08T15:42:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.096+0000 7fca0d454700 1 -- 172.21.15.29:0/1892584483 wait complete. 2023-10-08T15:42:33.101 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:42:33.109 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T15:42:32.331886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558859,"statfs":{"total":1600000000,"available":1596272197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.736567"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601687+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:55.570870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.607221+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:27.352801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600112+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603556+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601537+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:23.538777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604309+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609114+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604009+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.912660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609243+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601952+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:18.203834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602669+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:53:46.032289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606649+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.598789+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:08.078340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608838+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608523+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:08.654848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603897+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606862+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:28.903245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601477+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:13.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601923+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:00.938697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602385+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:55.487938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601623+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604457+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:46.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601106+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:43.244678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.599077+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601152+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:04.459275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603368+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604222+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601020+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:26.101902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602846+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:45.541087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602092+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601319+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:43.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603844+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606249+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611920+0000","last_change":"2023-10-08T15:42:27.611920+0000","last_active":"2023-10-08T15:42:27.611920+0000","last_peered":"2023-10-08T15:42:27.611920+0000","last_clean":"2023-10-08T15:42:27.611920+0000","last_became_active":"2023-10-08T15:42:27.611355+0000","last_became_peered":"2023-10-08T15:42:27.611355+0000","last_unstale":"2023-10-08T15:42:27.611920+0000","last_undegraded":"2023-10-08T15:42:27.611920+0000","last_fullsized":"2023-10-08T15:42:27.611920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601458+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606608+0000","last_change":"2023-10-08T15:42:27.606608+0000","last_active":"2023-10-08T15:42:27.606608+0000","last_peered":"2023-10-08T15:42:27.606608+0000","last_clean":"2023-10-08T15:42:27.606608+0000","last_became_active":"2023-10-08T15:42:27.604697+0000","last_became_peered":"2023-10-08T15:42:27.604697+0000","last_unstale":"2023-10-08T15:42:27.606608+0000","last_undegraded":"2023-10-08T15:42:27.606608+0000","last_fullsized":"2023-10-08T15:42:27.606608+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:51.458648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603012+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.607668+0000","last_change":"2023-10-08T15:42:27.607668+0000","last_active":"2023-10-08T15:42:27.607668+0000","last_peered":"2023-10-08T15:42:27.607668+0000","last_clean":"2023-10-08T15:42:27.607668+0000","last_became_active":"2023-10-08T15:42:27.607433+0000","last_became_peered":"2023-10-08T15:42:27.607433+0000","last_unstale":"2023-10-08T15:42:27.607668+0000","last_undegraded":"2023-10-08T15:42:27.607668+0000","last_fullsized":"2023-10-08T15:42:27.607668+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603465+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608294+0000","last_change":"2023-10-08T15:42:27.608294+0000","last_active":"2023-10-08T15:42:27.608294+0000","last_peered":"2023-10-08T15:42:27.608294+0000","last_clean":"2023-10-08T15:42:27.608294+0000","last_became_active":"2023-10-08T15:42:27.607485+0000","last_became_peered":"2023-10-08T15:42:27.607485+0000","last_unstale":"2023-10-08T15:42:27.608294+0000","last_undegraded":"2023-10-08T15:42:27.608294+0000","last_fullsized":"2023-10-08T15:42:27.608294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603629+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:47.705816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606991+0000","last_change":"2023-10-08T15:42:27.606991+0000","last_active":"2023-10-08T15:42:27.606991+0000","last_peered":"2023-10-08T15:42:27.606991+0000","last_clean":"2023-10-08T15:42:27.606991+0000","last_became_active":"2023-10-08T15:42:27.605095+0000","last_became_peered":"2023-10-08T15:42:27.605095+0000","last_unstale":"2023-10-08T15:42:27.606991+0000","last_undegraded":"2023-10-08T15:42:27.606991+0000","last_fullsized":"2023-10-08T15:42:27.606991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604097+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:17.846696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611581+0000","last_change":"2023-10-08T15:42:27.611581+0000","last_active":"2023-10-08T15:42:27.611581+0000","last_peered":"2023-10-08T15:42:27.611581+0000","last_clean":"2023-10-08T15:42:27.611581+0000","last_became_active":"2023-10-08T15:42:27.610685+0000","last_became_peered":"2023-10-08T15:42:27.610685+0000","last_unstale":"2023-10-08T15:42:27.611581+0000","last_undegraded":"2023-10-08T15:42:27.611581+0000","last_fullsized":"2023-10-08T15:42:27.611581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:31.175452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.598953+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606948+0000","last_change":"2023-10-08T15:42:27.606948+0000","last_active":"2023-10-08T15:42:27.606948+0000","last_peered":"2023-10-08T15:42:27.606948+0000","last_clean":"2023-10-08T15:42:27.606948+0000","last_became_active":"2023-10-08T15:42:27.606480+0000","last_became_peered":"2023-10-08T15:42:27.606480+0000","last_unstale":"2023-10-08T15:42:27.606948+0000","last_undegraded":"2023-10-08T15:42:27.606948+0000","last_fullsized":"2023-10-08T15:42:27.606948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602459+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:44.805051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611515+0000","last_change":"2023-10-08T15:42:27.611515+0000","last_active":"2023-10-08T15:42:27.611515+0000","last_peered":"2023-10-08T15:42:27.611515+0000","last_clean":"2023-10-08T15:42:27.611515+0000","last_became_active":"2023-10-08T15:42:27.611282+0000","last_became_peered":"2023-10-08T15:42:27.611282+0000","last_unstale":"2023-10-08T15:42:27.611515+0000","last_undegraded":"2023-10-08T15:42:27.611515+0000","last_fullsized":"2023-10-08T15:42:27.611515+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:32.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608500+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:17.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610407+0000","last_change":"2023-10-08T15:42:27.610407+0000","last_active":"2023-10-08T15:42:27.610407+0000","last_peered":"2023-10-08T15:42:27.610407+0000","last_clean":"2023-10-08T15:42:27.610407+0000","last_became_active":"2023-10-08T15:42:27.610216+0000","last_became_peered":"2023-10-08T15:42:27.610216+0000","last_unstale":"2023-10-08T15:42:27.610407+0000","last_undegraded":"2023-10-08T15:42:27.610407+0000","last_fullsized":"2023-10-08T15:42:27.610407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:07.651992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601242+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:01.687127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612937+0000","last_change":"2023-10-08T15:42:27.612937+0000","last_active":"2023-10-08T15:42:27.612937+0000","last_peered":"2023-10-08T15:42:27.612937+0000","last_clean":"2023-10-08T15:42:27.612937+0000","last_became_active":"2023-10-08T15:42:27.611760+0000","last_became_peered":"2023-10-08T15:42:27.611760+0000","last_unstale":"2023-10-08T15:42:27.612937+0000","last_undegraded":"2023-10-08T15:42:27.612937+0000","last_fullsized":"2023-10-08T15:42:27.612937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:00.974267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602300+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:57.494832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608865+0000","last_change":"2023-10-08T15:42:27.608865+0000","last_active":"2023-10-08T15:42:27.608865+0000","last_peered":"2023-10-08T15:42:27.608865+0000","last_clean":"2023-10-08T15:42:27.608865+0000","last_became_active":"2023-10-08T15:42:27.608647+0000","last_became_peered":"2023-10-08T15:42:27.608647+0000","last_unstale":"2023-10-08T15:42:27.608865+0000","last_undegraded":"2023-10-08T15:42:27.608865+0000","last_fullsized":"2023-10-08T15:42:27.608865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600569+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612650+0000","last_change":"2023-10-08T15:42:27.612650+0000","last_active":"2023-10-08T15:42:27.612650+0000","last_peered":"2023-10-08T15:42:27.612650+0000","last_clean":"2023-10-08T15:42:27.612650+0000","last_became_active":"2023-10-08T15:42:27.612488+0000","last_became_peered":"2023-10-08T15:42:27.612488+0000","last_unstale":"2023-10-08T15:42:27.612650+0000","last_undegraded":"2023-10-08T15:42:27.612650+0000","last_fullsized":"2023-10-08T15:42:27.612650+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:28.756571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602996+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610802+0000","last_change":"2023-10-08T15:42:27.610802+0000","last_active":"2023-10-08T15:42:27.610802+0000","last_peered":"2023-10-08T15:42:27.610802+0000","last_clean":"2023-10-08T15:42:27.610802+0000","last_became_active":"2023-10-08T15:42:27.610563+0000","last_became_peered":"2023-10-08T15:42:27.610563+0000","last_unstale":"2023-10-08T15:42:27.610802+0000","last_undegraded":"2023-10-08T15:42:27.610802+0000","last_fullsized":"2023-10-08T15:42:27.610802+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:41.327009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600707+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.603910+0000","last_change":"2023-10-08T15:42:27.603910+0000","last_active":"2023-10-08T15:42:27.603910+0000","last_peered":"2023-10-08T15:42:27.603910+0000","last_clean":"2023-10-08T15:42:27.603910+0000","last_became_active":"2023-10-08T15:42:27.603674+0000","last_became_peered":"2023-10-08T15:42:27.603674+0000","last_unstale":"2023-10-08T15:42:27.603910+0000","last_undegraded":"2023-10-08T15:42:27.603910+0000","last_fullsized":"2023-10-08T15:42:27.603910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:38.140823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609074+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610059+0000","last_change":"2023-10-08T15:42:27.610059+0000","last_active":"2023-10-08T15:42:27.610059+0000","last_peered":"2023-10-08T15:42:27.610059+0000","last_clean":"2023-10-08T15:42:27.610059+0000","last_became_active":"2023-10-08T15:42:27.609836+0000","last_became_peered":"2023-10-08T15:42:27.609836+0000","last_unstale":"2023-10-08T15:42:27.610059+0000","last_undegraded":"2023-10-08T15:42:27.610059+0000","last_fullsized":"2023-10-08T15:42:27.610059+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:56.732723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600106+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610874+0000","last_change":"2023-10-08T15:42:27.610874+0000","last_active":"2023-10-08T15:42:27.610874+0000","last_peered":"2023-10-08T15:42:27.610874+0000","last_clean":"2023-10-08T15:42:27.610874+0000","last_became_active":"2023-10-08T15:42:27.610604+0000","last_became_peered":"2023-10-08T15:42:27.610604+0000","last_unstale":"2023-10-08T15:42:27.610874+0000","last_undegraded":"2023-10-08T15:42:27.610874+0000","last_fullsized":"2023-10-08T15:42:27.610874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600168+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611354+0000","last_change":"2023-10-08T15:42:27.611354+0000","last_active":"2023-10-08T15:42:27.611354+0000","last_peered":"2023-10-08T15:42:27.611354+0000","last_clean":"2023-10-08T15:42:27.611354+0000","last_became_active":"2023-10-08T15:42:27.611057+0000","last_became_peered":"2023-10-08T15:42:27.611057+0000","last_unstale":"2023-10-08T15:42:27.611354+0000","last_undegraded":"2023-10-08T15:42:27.611354+0000","last_fullsized":"2023-10-08T15:42:27.611354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:33.021077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603169+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609472+0000","last_change":"2023-10-08T15:42:27.609472+0000","last_active":"2023-10-08T15:42:27.609472+0000","last_peered":"2023-10-08T15:42:27.609472+0000","last_clean":"2023-10-08T15:42:27.609472+0000","last_became_active":"2023-10-08T15:42:27.608911+0000","last_became_peered":"2023-10-08T15:42:27.608911+0000","last_unstale":"2023-10-08T15:42:27.609472+0000","last_undegraded":"2023-10-08T15:42:27.609472+0000","last_fullsized":"2023-10-08T15:42:27.609472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603716+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:41.709042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.607991+0000","last_change":"2023-10-08T15:42:27.607991+0000","last_active":"2023-10-08T15:42:27.607991+0000","last_peered":"2023-10-08T15:42:27.607991+0000","last_clean":"2023-10-08T15:42:27.607991+0000","last_became_active":"2023-10-08T15:42:27.607138+0000","last_became_peered":"2023-10-08T15:42:27.607138+0000","last_unstale":"2023-10-08T15:42:27.607991+0000","last_undegraded":"2023-10-08T15:42:27.607991+0000","last_fullsized":"2023-10-08T15:42:27.607991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:31.175452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600894+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610071+0000","last_change":"2023-10-08T15:42:27.610071+0000","last_active":"2023-10-08T15:42:27.610071+0000","last_peered":"2023-10-08T15:42:27.610071+0000","last_clean":"2023-10-08T15:42:27.610071+0000","last_became_active":"2023-10-08T15:42:27.609559+0000","last_became_peered":"2023-10-08T15:42:27.609559+0000","last_unstale":"2023-10-08T15:42:27.610071+0000","last_undegraded":"2023-10-08T15:42:27.610071+0000","last_fullsized":"2023-10-08T15:42:27.610071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602794+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612790+0000","last_change":"2023-10-08T15:42:27.612790+0000","last_active":"2023-10-08T15:42:27.612790+0000","last_peered":"2023-10-08T15:42:27.612790+0000","last_clean":"2023-10-08T15:42:27.612790+0000","last_became_active":"2023-10-08T15:42:27.612554+0000","last_became_peered":"2023-10-08T15:42:27.612554+0000","last_unstale":"2023-10-08T15:42:27.612790+0000","last_undegraded":"2023-10-08T15:42:27.612790+0000","last_fullsized":"2023-10-08T15:42:27.612790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:12.141956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604615+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.605851+0000","last_change":"2023-10-08T15:42:27.605851+0000","last_active":"2023-10-08T15:42:27.605851+0000","last_peered":"2023-10-08T15:42:27.605851+0000","last_clean":"2023-10-08T15:42:27.605851+0000","last_became_active":"2023-10-08T15:42:27.605608+0000","last_became_peered":"2023-10-08T15:42:27.605608+0000","last_unstale":"2023-10-08T15:42:27.605851+0000","last_undegraded":"2023-10-08T15:42:27.605851+0000","last_fullsized":"2023-10-08T15:42:27.605851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.375934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603082+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611050+0000","last_change":"2023-10-08T15:42:27.611050+0000","last_active":"2023-10-08T15:42:27.611050+0000","last_peered":"2023-10-08T15:42:27.611050+0000","last_clean":"2023-10-08T15:42:27.611050+0000","last_became_active":"2023-10-08T15:42:27.610828+0000","last_became_peered":"2023-10-08T15:42:27.610828+0000","last_unstale":"2023-10-08T15:42:27.611050+0000","last_undegraded":"2023-10-08T15:42:27.611050+0000","last_fullsized":"2023-10-08T15:42:27.611050+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601943+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609930+0000","last_change":"2023-10-08T15:42:27.609930+0000","last_active":"2023-10-08T15:42:27.609930+0000","last_peered":"2023-10-08T15:42:27.609930+0000","last_clean":"2023-10-08T15:42:27.609930+0000","last_became_active":"2023-10-08T15:42:27.609628+0000","last_became_peered":"2023-10-08T15:42:27.609628+0000","last_unstale":"2023-10-08T15:42:27.609930+0000","last_undegraded":"2023-10-08T15:42:27.609930+0000","last_fullsized":"2023-10-08T15:42:27.609930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:38.140823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606284+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611758+0000","last_change":"2023-10-08T15:42:27.611758+0000","last_active":"2023-10-08T15:42:27.611758+0000","last_peered":"2023-10-08T15:42:27.611758+0000","last_clean":"2023-10-08T15:42:27.611758+0000","last_became_active":"2023-10-08T15:42:27.610993+0000","last_became_peered":"2023-10-08T15:42:27.610993+0000","last_unstale":"2023-10-08T15:42:27.611758+0000","last_undegraded":"2023-10-08T15:42:27.611758+0000","last_fullsized":"2023-10-08T15:42:27.611758+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:56.732723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601542+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608823+0000","last_change":"2023-10-08T15:42:27.608823+0000","last_active":"2023-10-08T15:42:27.608823+0000","last_peered":"2023-10-08T15:42:27.608823+0000","last_clean":"2023-10-08T15:42:27.608823+0000","last_became_active":"2023-10-08T15:42:27.608592+0000","last_became_peered":"2023-10-08T15:42:27.608592+0000","last_unstale":"2023-10-08T15:42:27.608823+0000","last_undegraded":"2023-10-08T15:42:27.608823+0000","last_fullsized":"2023-10-08T15:42:27.608823+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.375934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.605112+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609511+0000","last_change":"2023-10-08T15:42:27.609511+0000","last_active":"2023-10-08T15:42:27.609511+0000","last_peered":"2023-10-08T15:42:27.609511+0000","last_clean":"2023-10-08T15:42:27.609511+0000","last_became_active":"2023-10-08T15:42:27.609249+0000","last_became_peered":"2023-10-08T15:42:27.609249+0000","last_unstale":"2023-10-08T15:42:27.609511+0000","last_undegraded":"2023-10-08T15:42:27.609511+0000","last_fullsized":"2023-10-08T15:42:27.609511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603342+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:50.886815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606761+0000","last_change":"2023-10-08T15:42:27.606761+0000","last_active":"2023-10-08T15:42:27.606761+0000","last_peered":"2023-10-08T15:42:27.606761+0000","last_clean":"2023-10-08T15:42:27.606761+0000","last_became_active":"2023-10-08T15:42:27.606539+0000","last_became_peered":"2023-10-08T15:42:27.606539+0000","last_unstale":"2023-10-08T15:42:27.606761+0000","last_undegraded":"2023-10-08T15:42:27.606761+0000","last_fullsized":"2023-10-08T15:42:27.606761+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:58.871512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600519+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611631+0000","last_change":"2023-10-08T15:42:27.611631+0000","last_active":"2023-10-08T15:42:27.611631+0000","last_peered":"2023-10-08T15:42:27.611631+0000","last_clean":"2023-10-08T15:42:27.611631+0000","last_became_active":"2023-10-08T15:42:27.611438+0000","last_became_peered":"2023-10-08T15:42:27.611438+0000","last_unstale":"2023-10-08T15:42:27.611631+0000","last_undegraded":"2023-10-08T15:42:27.611631+0000","last_fullsized":"2023-10-08T15:42:27.611631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601913+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:40:27.513848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.605559+0000","last_change":"2023-10-08T15:42:27.605559+0000","last_active":"2023-10-08T15:42:27.605559+0000","last_peered":"2023-10-08T15:42:27.605559+0000","last_clean":"2023-10-08T15:42:27.605559+0000","last_became_active":"2023-10-08T15:42:27.605319+0000","last_became_peered":"2023-10-08T15:42:27.605319+0000","last_unstale":"2023-10-08T15:42:27.605559+0000","last_undegraded":"2023-10-08T15:42:27.605559+0000","last_fullsized":"2023-10-08T15:42:27.605559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:57.757560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603273+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:10.469412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606745+0000","last_change":"2023-10-08T15:42:27.606745+0000","last_active":"2023-10-08T15:42:27.606745+0000","last_peered":"2023-10-08T15:42:27.606745+0000","last_clean":"2023-10-08T15:42:27.606745+0000","last_became_active":"2023-10-08T15:42:27.605869+0000","last_became_peered":"2023-10-08T15:42:27.605869+0000","last_unstale":"2023-10-08T15:42:27.606745+0000","last_undegraded":"2023-10-08T15:42:27.606745+0000","last_fullsized":"2023-10-08T15:42:27.606745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:00.684271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602215+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:20.240936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608140+0000","last_change":"2023-10-08T15:42:27.608140+0000","last_active":"2023-10-08T15:42:27.608140+0000","last_peered":"2023-10-08T15:42:27.608140+0000","last_clean":"2023-10-08T15:42:27.608140+0000","last_became_active":"2023-10-08T15:42:27.607915+0000","last_became_peered":"2023-10-08T15:42:27.607915+0000","last_unstale":"2023-10-08T15:42:27.608140+0000","last_undegraded":"2023-10-08T15:42:27.608140+0000","last_fullsized":"2023-10-08T15:42:27.608140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:58.871512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T15:42:26.598021+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:42:26.598021+0000","last_peered":"2023-10-08T15:42:26.598021+0000","last_clean":"2023-10-08T15:42:26.598021+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:42:26.598021+0000","last_undegraded":"2023-10-08T15:42:26.598021+0000","last_fullsized":"2023-10-08T15:42:26.598021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088903,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.40000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.40699999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.505,"15min":0.505},"min":{"1min":0.36399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.69999999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41299999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.441},{"interface":"front","average":{"1min":0.626,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.39000000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70699999999999996,"5min":1.135,"15min":1.135},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72099999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68799999999999994,"5min":1.238,"15min":1.238},"last":0.36899999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59499999999999997,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67700000000000005,"5min":1.486,"15min":1.486},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70499999999999996,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51200000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.253}]},{"osd":5,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.626,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.61199999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.38100000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.752,"15min":0.752},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.437}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.314},{"interface":"front","average":{"1min":0.314,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44400000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.23899999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.46500000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48499999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.29899999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.435,"15min":0.438},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.374},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56599999999999995,"5min":1.046,"15min":1.046},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86799999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.40100000000000002}]},{"osd":5,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89000000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40899999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58599999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78600000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.439}]},{"osd":7,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85499999999999998,"5min":1.012,"15min":1.012},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088903,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.5,"5min":2.794,"15min":2.794},"last":0.377},{"interface":"front","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.25,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51900000000000002,"5min":2.073,"15min":2.073},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.496,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61799999999999999,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60299999999999998,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":2.863,"15min":2.863},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.754,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.70299999999999996,"15min":0.71799999999999997},"min":{"1min":0.45200000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82499999999999996,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.73299999999999998,"15min":0.751},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85999999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":2.004,"15min":2.004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83499999999999996,"5min":1.014,"15min":1.014},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48499999999999999,"5min":1.171,"15min":1.171},"last":0.252},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60699999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.373}]},{"osd":1,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48699999999999999,"5min":1.111,"15min":1.111},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53500000000000003,"5min":1.232,"15min":1.232},"last":0.33600000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51800000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.434,"15min":0.441},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68600000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84199999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83899999999999997,"5min":1.085,"15min":1.085},"last":0.40799999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82399999999999995,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.748,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51400000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.87,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.74199999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":1.286,"15min":1.286},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.32700000000000001,"15min":0.32100000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28100000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46500000000000002}]},{"osd":5,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83299999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.42899999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.505},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69499999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68999999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65600000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58499999999999996,"15min":0.59799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.34799999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.434}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.438},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.35999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.61099999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.48899999999999999,"15min":0.47299999999999998},"min":{"1min":0.38600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.35999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.622}]},{"osd":3,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.49099999999999999,"15min":0.47899999999999998},"min":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.505}]},{"osd":6,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79600000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65900000000000003}]}]}],"pool_statfs":[]}} 2023-10-08T15:42:33.115 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:42:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.268+0000 7fde549d0700 1 Processor -- start 2023-10-08T15:42:33.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.268+0000 7fde549d0700 1 -- start start 2023-10-08T15:42:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde549d0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde500cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde549d0700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fde5015cbd0 0x7fde5015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde549d0700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500cb7c0 con 0x7fde500cdab0 2023-10-08T15:42:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde549d0700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5015e850 con 0x7fde5015cbd0 2023-10-08T15:42:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde549d0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500cd030 con 0x7fde500cd6e0 2023-10-08T15:42:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fde5015cbd0 0x7fde5015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4effd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fde500cdab0 0x7fde5015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43920/0 (socket says 172.21.15.29:43920) 2023-10-08T15:42:33.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4effd700 1 -- 172.21.15.29:0/3866738212 learned_addr learned my addr 172.21.15.29:0/3866738212 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4f7fe700 1 --2- 172.21.15.29:0/3866738212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde500cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4ffff700 1 -- 172.21.15.29:0/3866738212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 msgr2=0x7fde500cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4ffff700 1 --2- 172.21.15.29:0/3866738212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde500cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4ffff700 1 -- 172.21.15.29:0/3866738212 >> v1:172.21.15.29:6789/0 conn(0x7fde500cdab0 legacy=0x7fde5015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4ffff700 1 -- 172.21.15.29:0/3866738212 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5015e290 con 0x7fde5015cbd0 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4e7fc700 1 -- 172.21.15.29:0/3866738212 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252951292 0 0) 0x7fde500cb7c0 con 0x7fde500cdab0 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.269+0000 7fde4f7fe700 1 --2- 172.21.15.29:0/3866738212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde500cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde4ffff700 1 --2- 172.21.15.29:0/3866738212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde5015d020 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fde48009e60 tx=0x7fde48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cfa2d51a5bcc62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde4e7fc700 1 -- 172.21.15.29:0/3866738212 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800e070 con 0x7fde5015cbd0 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde4e7fc700 1 -- 172.21.15.29:0/3866738212 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4800bc30 con 0x7fde5015cbd0 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde4e7fc700 1 -- 172.21.15.29:0/3866738212 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48012430 con 0x7fde5015cbd0 2023-10-08T15:42:33.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde549d0700 1 -- 172.21.15.29:0/3866738212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 msgr2=0x7fde5015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde549d0700 1 --2- 172.21.15.29:0/3866738212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde5015d020 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fde48009e60 tx=0x7fde48009780 comp rx=0 tx=0).stop 2023-10-08T15:42:33.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde549d0700 1 -- 172.21.15.29:0/3866738212 shutdown_connections 2023-10-08T15:42:33.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde549d0700 1 --2- 172.21.15.29:0/3866738212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde5015d020 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde549d0700 1 --2- 172.21.15.29:0/3866738212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde500cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde549d0700 1 -- 172.21.15.29:0/3866738212 >> 172.21.15.29:0/3866738212 conn(0x7fde50067660 msgr2=0x7fde50067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde549d0700 1 -- 172.21.15.29:0/3866738212 shutdown_connections 2023-10-08T15:42:33.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.270+0000 7fde549d0700 1 -- 172.21.15.29:0/3866738212 wait complete. 2023-10-08T15:42:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde549d0700 1 Processor -- start 2023-10-08T15:42:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde549d0700 1 -- start start 2023-10-08T15:42:33.275 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde549d0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde5016a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde549d0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde500cdab0 0x7fde500b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde549d0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde500ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde549d0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50169940 con 0x7fde5015cbd0 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde549d0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500c85c0 con 0x7fde500cdab0 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde549d0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500c8d90 con 0x7fde500cd6e0 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde4ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde500ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde4ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde500ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51578/0 (socket says 172.21.15.29:51578) 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.272+0000 7fde4ffff700 1 -- 172.21.15.29:0/3076101841 learned_addr learned my addr 172.21.15.29:0/3076101841 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4effd700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde500cdab0 0x7fde500b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4f7fe700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde5016a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4ffff700 1 -- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 msgr2=0x7fde5016a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4ffff700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde5016a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4ffff700 1 -- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde500cdab0 msgr2=0x7fde500b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4ffff700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde500cdab0 0x7fde500b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4ffff700 1 -- 172.21.15.29:0/3076101841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48009a20 con 0x7fde5015cbd0 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4f7fe700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde5016a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde4ffff700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde500ca4e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fde480097c0 tx=0x7fde48019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde377fe700 1 -- 172.21.15.29:0/3076101841 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48027470 con 0x7fde5015cbd0 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde377fe700 1 -- 172.21.15.29:0/3076101841 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480275d0 con 0x7fde5015cbd0 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde377fe700 1 -- 172.21.15.29:0/3076101841 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48027990 con 0x7fde5015cbd0 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde50169eb0 con 0x7fde5015cbd0 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.273+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde500c8ab0 con 0x7fde5015cbd0 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.274+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5016a040 con 0x7fde5015cbd0 2023-10-08T15:42:33.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.275+0000 7fde377fe700 1 -- 172.21.15.29:0/3076101841 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde48024070 con 0x7fde5015cbd0 2023-10-08T15:42:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.275+0000 7fde377fe700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fde3c066f30 0x7fde3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.275+0000 7fde377fe700 1 -- 172.21.15.29:0/3076101841 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde48086d50 con 0x7fde5015cbd0 2023-10-08T15:42:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.275+0000 7fde4f7fe700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fde3c066f30 0x7fde3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.276+0000 7fde4f7fe700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fde3c066f30 0x7fde3c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fde40006f00 tx=0x7fde40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.279+0000 7fde377fe700 1 -- 172.21.15.29:0/3076101841 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde4808a030 con 0x7fde5015cbd0 2023-10-08T15:42:33.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.470+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde50089310 con 0x7fde3c066f30 2023-10-08T15:42:33.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.478+0000 7fde377fe700 1 -- 172.21.15.29:0/3076101841 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282077 (secure 0 0 0) 0x7fde50089310 con 0x7fde3c066f30 2023-10-08T15:42:33.482 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.481+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fde3c066f30 msgr2=0x7fde3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.481+0000 7fde549d0700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fde3c066f30 0x7fde3c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fde40006f00 tx=0x7fde40008040 comp rx=0 tx=0).stop 2023-10-08T15:42:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.481+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 msgr2=0x7fde500ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.481+0000 7fde549d0700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde500ca4e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fde480097c0 tx=0x7fde48019000 comp rx=0 tx=0).stop 2023-10-08T15:42:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.482+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 shutdown_connections 2023-10-08T15:42:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.482+0000 7fde549d0700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fde3c066f30 0x7fde3c0693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.482+0000 7fde549d0700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde5015cbd0 0x7fde500ca4e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.482+0000 7fde549d0700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde500cd6e0 0x7fde5016a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.482+0000 7fde549d0700 1 --2- 172.21.15.29:0/3076101841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde500cdab0 0x7fde500b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.482+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 >> 172.21.15.29:0/3076101841 conn(0x7fde50067660 msgr2=0x7fde50156d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.482+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 shutdown_connections 2023-10-08T15:42:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.482+0000 7fde549d0700 1 -- 172.21.15.29:0/3076101841 wait complete. 2023-10-08T15:42:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:42:33.495 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T15:42:32.331886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558859,"statfs":{"total":1600000000,"available":1596272197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.736567"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601687+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:55.570870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.607221+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:27.352801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600112+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603556+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601537+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:23.538777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604309+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609114+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604009+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.912660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609243+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601952+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:18.203834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602669+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:53:46.032289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606649+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.598789+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:08.078340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608838+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608523+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:08.654848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603897+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606862+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:28.903245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601477+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:13.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601923+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:00.938697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602385+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:55.487938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601623+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604457+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:46.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601106+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:43.244678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.599077+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601152+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:04.459275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603368+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604222+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601020+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:26.101902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602846+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:45.541087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602092+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601319+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:43.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603844+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606249+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611920+0000","last_change":"2023-10-08T15:42:27.611920+0000","last_active":"2023-10-08T15:42:27.611920+0000","last_peered":"2023-10-08T15:42:27.611920+0000","last_clean":"2023-10-08T15:42:27.611920+0000","last_became_active":"2023-10-08T15:42:27.611355+0000","last_became_peered":"2023-10-08T15:42:27.611355+0000","last_unstale":"2023-10-08T15:42:27.611920+0000","last_undegraded":"2023-10-08T15:42:27.611920+0000","last_fullsized":"2023-10-08T15:42:27.611920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601458+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606608+0000","last_change":"2023-10-08T15:42:27.606608+0000","last_active":"2023-10-08T15:42:27.606608+0000","last_peered":"2023-10-08T15:42:27.606608+0000","last_clean":"2023-10-08T15:42:27.606608+0000","last_became_active":"2023-10-08T15:42:27.604697+0000","last_became_peered":"2023-10-08T15:42:27.604697+0000","last_unstale":"2023-10-08T15:42:27.606608+0000","last_undegraded":"2023-10-08T15:42:27.606608+0000","last_fullsized":"2023-10-08T15:42:27.606608+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:51.458648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603012+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.607668+0000","last_change":"2023-10-08T15:42:27.607668+0000","last_active":"2023-10-08T15:42:27.607668+0000","last_peered":"2023-10-08T15:42:27.607668+0000","last_clean":"2023-10-08T15:42:27.607668+0000","last_became_active":"2023-10-08T15:42:27.607433+0000","last_became_peered":"2023-10-08T15:42:27.607433+0000","last_unstale":"2023-10-08T15:42:27.607668+0000","last_undegraded":"2023-10-08T15:42:27.607668+0000","last_fullsized":"2023-10-08T15:42:27.607668+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603465+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608294+0000","last_change":"2023-10-08T15:42:27.608294+0000","last_active":"2023-10-08T15:42:27.608294+0000","last_peered":"2023-10-08T15:42:27.608294+0000","last_clean":"2023-10-08T15:42:27.608294+0000","last_became_active":"2023-10-08T15:42:27.607485+0000","last_became_peered":"2023-10-08T15:42:27.607485+0000","last_unstale":"2023-10-08T15:42:27.608294+0000","last_undegraded":"2023-10-08T15:42:27.608294+0000","last_fullsized":"2023-10-08T15:42:27.608294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603629+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:47.705816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606991+0000","last_change":"2023-10-08T15:42:27.606991+0000","last_active":"2023-10-08T15:42:27.606991+0000","last_peered":"2023-10-08T15:42:27.606991+0000","last_clean":"2023-10-08T15:42:27.606991+0000","last_became_active":"2023-10-08T15:42:27.605095+0000","last_became_peered":"2023-10-08T15:42:27.605095+0000","last_unstale":"2023-10-08T15:42:27.606991+0000","last_undegraded":"2023-10-08T15:42:27.606991+0000","last_fullsized":"2023-10-08T15:42:27.606991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604097+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:17.846696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611581+0000","last_change":"2023-10-08T15:42:27.611581+0000","last_active":"2023-10-08T15:42:27.611581+0000","last_peered":"2023-10-08T15:42:27.611581+0000","last_clean":"2023-10-08T15:42:27.611581+0000","last_became_active":"2023-10-08T15:42:27.610685+0000","last_became_peered":"2023-10-08T15:42:27.610685+0000","last_unstale":"2023-10-08T15:42:27.611581+0000","last_undegraded":"2023-10-08T15:42:27.611581+0000","last_fullsized":"2023-10-08T15:42:27.611581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:31.175452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.598953+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606948+0000","last_change":"2023-10-08T15:42:27.606948+0000","last_active":"2023-10-08T15:42:27.606948+0000","last_peered":"2023-10-08T15:42:27.606948+0000","last_clean":"2023-10-08T15:42:27.606948+0000","last_became_active":"2023-10-08T15:42:27.606480+0000","last_became_peered":"2023-10-08T15:42:27.606480+0000","last_unstale":"2023-10-08T15:42:27.606948+0000","last_undegraded":"2023-10-08T15:42:27.606948+0000","last_fullsized":"2023-10-08T15:42:27.606948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602459+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:44.805051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611515+0000","last_change":"2023-10-08T15:42:27.611515+0000","last_active":"2023-10-08T15:42:27.611515+0000","last_peered":"2023-10-08T15:42:27.611515+0000","last_clean":"2023-10-08T15:42:27.611515+0000","last_became_active":"2023-10-08T15:42:27.611282+0000","last_became_peered":"2023-10-08T15:42:27.611282+0000","last_unstale":"2023-10-08T15:42:27.611515+0000","last_undegraded":"2023-10-08T15:42:27.611515+0000","last_fullsized":"2023-10-08T15:42:27.611515+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:32.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608500+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:17.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610407+0000","last_change":"2023-10-08T15:42:27.610407+0000","last_active":"2023-10-08T15:42:27.610407+0000","last_peered":"2023-10-08T15:42:27.610407+0000","last_clean":"2023-10-08T15:42:27.610407+0000","last_became_active":"2023-10-08T15:42:27.610216+0000","last_became_peered":"2023-10-08T15:42:27.610216+0000","last_unstale":"2023-10-08T15:42:27.610407+0000","last_undegraded":"2023-10-08T15:42:27.610407+0000","last_fullsized":"2023-10-08T15:42:27.610407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:07.651992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601242+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:01.687127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612937+0000","last_change":"2023-10-08T15:42:27.612937+0000","last_active":"2023-10-08T15:42:27.612937+0000","last_peered":"2023-10-08T15:42:27.612937+0000","last_clean":"2023-10-08T15:42:27.612937+0000","last_became_active":"2023-10-08T15:42:27.611760+0000","last_became_peered":"2023-10-08T15:42:27.611760+0000","last_unstale":"2023-10-08T15:42:27.612937+0000","last_undegraded":"2023-10-08T15:42:27.612937+0000","last_fullsized":"2023-10-08T15:42:27.612937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:00.974267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602300+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:57.494832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608865+0000","last_change":"2023-10-08T15:42:27.608865+0000","last_active":"2023-10-08T15:42:27.608865+0000","last_peered":"2023-10-08T15:42:27.608865+0000","last_clean":"2023-10-08T15:42:27.608865+0000","last_became_active":"2023-10-08T15:42:27.608647+0000","last_became_peered":"2023-10-08T15:42:27.608647+0000","last_unstale":"2023-10-08T15:42:27.608865+0000","last_undegraded":"2023-10-08T15:42:27.608865+0000","last_fullsized":"2023-10-08T15:42:27.608865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600569+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612650+0000","last_change":"2023-10-08T15:42:27.612650+0000","last_active":"2023-10-08T15:42:27.612650+0000","last_peered":"2023-10-08T15:42:27.612650+0000","last_clean":"2023-10-08T15:42:27.612650+0000","last_became_active":"2023-10-08T15:42:27.612488+0000","last_became_peered":"2023-10-08T15:42:27.612488+0000","last_unstale":"2023-10-08T15:42:27.612650+0000","last_undegraded":"2023-10-08T15:42:27.612650+0000","last_fullsized":"2023-10-08T15:42:27.612650+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:28.756571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602996+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610802+0000","last_change":"2023-10-08T15:42:27.610802+0000","last_active":"2023-10-08T15:42:27.610802+0000","last_peered":"2023-10-08T15:42:27.610802+0000","last_clean":"2023-10-08T15:42:27.610802+0000","last_became_active":"2023-10-08T15:42:27.610563+0000","last_became_peered":"2023-10-08T15:42:27.610563+0000","last_unstale":"2023-10-08T15:42:27.610802+0000","last_undegraded":"2023-10-08T15:42:27.610802+0000","last_fullsized":"2023-10-08T15:42:27.610802+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:41.327009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600707+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.603910+0000","last_change":"2023-10-08T15:42:27.603910+0000","last_active":"2023-10-08T15:42:27.603910+0000","last_peered":"2023-10-08T15:42:27.603910+0000","last_clean":"2023-10-08T15:42:27.603910+0000","last_became_active":"2023-10-08T15:42:27.603674+0000","last_became_peered":"2023-10-08T15:42:27.603674+0000","last_unstale":"2023-10-08T15:42:27.603910+0000","last_undegraded":"2023-10-08T15:42:27.603910+0000","last_fullsized":"2023-10-08T15:42:27.603910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:38.140823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609074+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610059+0000","last_change":"2023-10-08T15:42:27.610059+0000","last_active":"2023-10-08T15:42:27.610059+0000","last_peered":"2023-10-08T15:42:27.610059+0000","last_clean":"2023-10-08T15:42:27.610059+0000","last_became_active":"2023-10-08T15:42:27.609836+0000","last_became_peered":"2023-10-08T15:42:27.609836+0000","last_unstale":"2023-10-08T15:42:27.610059+0000","last_undegraded":"2023-10-08T15:42:27.610059+0000","last_fullsized":"2023-10-08T15:42:27.610059+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:56.732723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600106+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610874+0000","last_change":"2023-10-08T15:42:27.610874+0000","last_active":"2023-10-08T15:42:27.610874+0000","last_peered":"2023-10-08T15:42:27.610874+0000","last_clean":"2023-10-08T15:42:27.610874+0000","last_became_active":"2023-10-08T15:42:27.610604+0000","last_became_peered":"2023-10-08T15:42:27.610604+0000","last_unstale":"2023-10-08T15:42:27.610874+0000","last_undegraded":"2023-10-08T15:42:27.610874+0000","last_fullsized":"2023-10-08T15:42:27.610874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600168+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611354+0000","last_change":"2023-10-08T15:42:27.611354+0000","last_active":"2023-10-08T15:42:27.611354+0000","last_peered":"2023-10-08T15:42:27.611354+0000","last_clean":"2023-10-08T15:42:27.611354+0000","last_became_active":"2023-10-08T15:42:27.611057+0000","last_became_peered":"2023-10-08T15:42:27.611057+0000","last_unstale":"2023-10-08T15:42:27.611354+0000","last_undegraded":"2023-10-08T15:42:27.611354+0000","last_fullsized":"2023-10-08T15:42:27.611354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:33.021077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603169+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609472+0000","last_change":"2023-10-08T15:42:27.609472+0000","last_active":"2023-10-08T15:42:27.609472+0000","last_peered":"2023-10-08T15:42:27.609472+0000","last_clean":"2023-10-08T15:42:27.609472+0000","last_became_active":"2023-10-08T15:42:27.608911+0000","last_became_peered":"2023-10-08T15:42:27.608911+0000","last_unstale":"2023-10-08T15:42:27.609472+0000","last_undegraded":"2023-10-08T15:42:27.609472+0000","last_fullsized":"2023-10-08T15:42:27.609472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603716+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:41.709042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.607991+0000","last_change":"2023-10-08T15:42:27.607991+0000","last_active":"2023-10-08T15:42:27.607991+0000","last_peered":"2023-10-08T15:42:27.607991+0000","last_clean":"2023-10-08T15:42:27.607991+0000","last_became_active":"2023-10-08T15:42:27.607138+0000","last_became_peered":"2023-10-08T15:42:27.607138+0000","last_unstale":"2023-10-08T15:42:27.607991+0000","last_undegraded":"2023-10-08T15:42:27.607991+0000","last_fullsized":"2023-10-08T15:42:27.607991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:31.175452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600894+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610071+0000","last_change":"2023-10-08T15:42:27.610071+0000","last_active":"2023-10-08T15:42:27.610071+0000","last_peered":"2023-10-08T15:42:27.610071+0000","last_clean":"2023-10-08T15:42:27.610071+0000","last_became_active":"2023-10-08T15:42:27.609559+0000","last_became_peered":"2023-10-08T15:42:27.609559+0000","last_unstale":"2023-10-08T15:42:27.610071+0000","last_undegraded":"2023-10-08T15:42:27.610071+0000","last_fullsized":"2023-10-08T15:42:27.610071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602794+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612790+0000","last_change":"2023-10-08T15:42:27.612790+0000","last_active":"2023-10-08T15:42:27.612790+0000","last_peered":"2023-10-08T15:42:27.612790+0000","last_clean":"2023-10-08T15:42:27.612790+0000","last_became_active":"2023-10-08T15:42:27.612554+0000","last_became_peered":"2023-10-08T15:42:27.612554+0000","last_unstale":"2023-10-08T15:42:27.612790+0000","last_undegraded":"2023-10-08T15:42:27.612790+0000","last_fullsized":"2023-10-08T15:42:27.612790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:12.141956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604615+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.605851+0000","last_change":"2023-10-08T15:42:27.605851+0000","last_active":"2023-10-08T15:42:27.605851+0000","last_peered":"2023-10-08T15:42:27.605851+0000","last_clean":"2023-10-08T15:42:27.605851+0000","last_became_active":"2023-10-08T15:42:27.605608+0000","last_became_peered":"2023-10-08T15:42:27.605608+0000","last_unstale":"2023-10-08T15:42:27.605851+0000","last_undegraded":"2023-10-08T15:42:27.605851+0000","last_fullsized":"2023-10-08T15:42:27.605851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.375934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603082+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611050+0000","last_change":"2023-10-08T15:42:27.611050+0000","last_active":"2023-10-08T15:42:27.611050+0000","last_peered":"2023-10-08T15:42:27.611050+0000","last_clean":"2023-10-08T15:42:27.611050+0000","last_became_active":"2023-10-08T15:42:27.610828+0000","last_became_peered":"2023-10-08T15:42:27.610828+0000","last_unstale":"2023-10-08T15:42:27.611050+0000","last_undegraded":"2023-10-08T15:42:27.611050+0000","last_fullsized":"2023-10-08T15:42:27.611050+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601943+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609930+0000","last_change":"2023-10-08T15:42:27.609930+0000","last_active":"2023-10-08T15:42:27.609930+0000","last_peered":"2023-10-08T15:42:27.609930+0000","last_clean":"2023-10-08T15:42:27.609930+0000","last_became_active":"2023-10-08T15:42:27.609628+0000","last_became_peered":"2023-10-08T15:42:27.609628+0000","last_unstale":"2023-10-08T15:42:27.609930+0000","last_undegraded":"2023-10-08T15:42:27.609930+0000","last_fullsized":"2023-10-08T15:42:27.609930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:38.140823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606284+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611758+0000","last_change":"2023-10-08T15:42:27.611758+0000","last_active":"2023-10-08T15:42:27.611758+0000","last_peered":"2023-10-08T15:42:27.611758+0000","last_clean":"2023-10-08T15:42:27.611758+0000","last_became_active":"2023-10-08T15:42:27.610993+0000","last_became_peered":"2023-10-08T15:42:27.610993+0000","last_unstale":"2023-10-08T15:42:27.611758+0000","last_undegraded":"2023-10-08T15:42:27.611758+0000","last_fullsized":"2023-10-08T15:42:27.611758+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:56.732723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601542+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608823+0000","last_change":"2023-10-08T15:42:27.608823+0000","last_active":"2023-10-08T15:42:27.608823+0000","last_peered":"2023-10-08T15:42:27.608823+0000","last_clean":"2023-10-08T15:42:27.608823+0000","last_became_active":"2023-10-08T15:42:27.608592+0000","last_became_peered":"2023-10-08T15:42:27.608592+0000","last_unstale":"2023-10-08T15:42:27.608823+0000","last_undegraded":"2023-10-08T15:42:27.608823+0000","last_fullsized":"2023-10-08T15:42:27.608823+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.375934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.605112+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609511+0000","last_change":"2023-10-08T15:42:27.609511+0000","last_active":"2023-10-08T15:42:27.609511+0000","last_peered":"2023-10-08T15:42:27.609511+0000","last_clean":"2023-10-08T15:42:27.609511+0000","last_became_active":"2023-10-08T15:42:27.609249+0000","last_became_peered":"2023-10-08T15:42:27.609249+0000","last_unstale":"2023-10-08T15:42:27.609511+0000","last_undegraded":"2023-10-08T15:42:27.609511+0000","last_fullsized":"2023-10-08T15:42:27.609511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603342+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:50.886815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606761+0000","last_change":"2023-10-08T15:42:27.606761+0000","last_active":"2023-10-08T15:42:27.606761+0000","last_peered":"2023-10-08T15:42:27.606761+0000","last_clean":"2023-10-08T15:42:27.606761+0000","last_became_active":"2023-10-08T15:42:27.606539+0000","last_became_peered":"2023-10-08T15:42:27.606539+0000","last_unstale":"2023-10-08T15:42:27.606761+0000","last_undegraded":"2023-10-08T15:42:27.606761+0000","last_fullsized":"2023-10-08T15:42:27.606761+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:58.871512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600519+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611631+0000","last_change":"2023-10-08T15:42:27.611631+0000","last_active":"2023-10-08T15:42:27.611631+0000","last_peered":"2023-10-08T15:42:27.611631+0000","last_clean":"2023-10-08T15:42:27.611631+0000","last_became_active":"2023-10-08T15:42:27.611438+0000","last_became_peered":"2023-10-08T15:42:27.611438+0000","last_unstale":"2023-10-08T15:42:27.611631+0000","last_undegraded":"2023-10-08T15:42:27.611631+0000","last_fullsized":"2023-10-08T15:42:27.611631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601913+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:40:27.513848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.605559+0000","last_change":"2023-10-08T15:42:27.605559+0000","last_active":"2023-10-08T15:42:27.605559+0000","last_peered":"2023-10-08T15:42:27.605559+0000","last_clean":"2023-10-08T15:42:27.605559+0000","last_became_active":"2023-10-08T15:42:27.605319+0000","last_became_peered":"2023-10-08T15:42:27.605319+0000","last_unstale":"2023-10-08T15:42:27.605559+0000","last_undegraded":"2023-10-08T15:42:27.605559+0000","last_fullsized":"2023-10-08T15:42:27.605559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:57.757560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603273+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:10.469412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606745+0000","last_change":"2023-10-08T15:42:27.606745+0000","last_active":"2023-10-08T15:42:27.606745+0000","last_peered":"2023-10-08T15:42:27.606745+0000","last_clean":"2023-10-08T15:42:27.606745+0000","last_became_active":"2023-10-08T15:42:27.605869+0000","last_became_peered":"2023-10-08T15:42:27.605869+0000","last_unstale":"2023-10-08T15:42:27.606745+0000","last_undegraded":"2023-10-08T15:42:27.606745+0000","last_fullsized":"2023-10-08T15:42:27.606745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:00.684271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602215+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:20.240936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608140+0000","last_change":"2023-10-08T15:42:27.608140+0000","last_active":"2023-10-08T15:42:27.608140+0000","last_peered":"2023-10-08T15:42:27.608140+0000","last_clean":"2023-10-08T15:42:27.608140+0000","last_became_active":"2023-10-08T15:42:27.607915+0000","last_became_peered":"2023-10-08T15:42:27.607915+0000","last_unstale":"2023-10-08T15:42:27.608140+0000","last_undegraded":"2023-10-08T15:42:27.608140+0000","last_fullsized":"2023-10-08T15:42:27.608140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:58.871512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T15:42:26.598021+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:42:26.598021+0000","last_peered":"2023-10-08T15:42:26.598021+0000","last_clean":"2023-10-08T15:42:26.598021+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:42:26.598021+0000","last_undegraded":"2023-10-08T15:42:26.598021+0000","last_fullsized":"2023-10-08T15:42:26.598021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088903,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.40000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.40699999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.505,"15min":0.505},"min":{"1min":0.36399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.69999999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41299999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.441},{"interface":"front","average":{"1min":0.626,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.39000000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70699999999999996,"5min":1.135,"15min":1.135},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72099999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68799999999999994,"5min":1.238,"15min":1.238},"last":0.36899999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59499999999999997,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67700000000000005,"5min":1.486,"15min":1.486},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70499999999999996,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51200000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.253}]},{"osd":5,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.626,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.61199999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.38100000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.752,"15min":0.752},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.437}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.314},{"interface":"front","average":{"1min":0.314,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44400000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.23899999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.46500000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48499999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.29899999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.435,"15min":0.438},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.374},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56599999999999995,"5min":1.046,"15min":1.046},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86799999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.40100000000000002}]},{"osd":5,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89000000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40899999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58599999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78600000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.439}]},{"osd":7,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85499999999999998,"5min":1.012,"15min":1.012},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088903,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.5,"5min":2.794,"15min":2.794},"last":0.377},{"interface":"front","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.25,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51900000000000002,"5min":2.073,"15min":2.073},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.496,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61799999999999999,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60299999999999998,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":2.863,"15min":2.863},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.754,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.70299999999999996,"15min":0.71799999999999997},"min":{"1min":0.45200000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82499999999999996,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.73299999999999998,"15min":0.751},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85999999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":2.004,"15min":2.004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83499999999999996,"5min":1.014,"15min":1.014},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48499999999999999,"5min":1.171,"15min":1.171},"last":0.252},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60699999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.373}]},{"osd":1,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48699999999999999,"5min":1.111,"15min":1.111},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53500000000000003,"5min":1.232,"15min":1.232},"last":0.33600000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51800000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.434,"15min":0.441},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68600000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84199999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83899999999999997,"5min":1.085,"15min":1.085},"last":0.40799999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82399999999999995,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.748,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51400000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.87,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.74199999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":1.286,"15min":1.286},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.32700000000000001,"15min":0.32100000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28100000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46500000000000002}]},{"osd":5,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83299999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.42899999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.505},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69499999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68999999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65600000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58499999999999996,"15min":0.59799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.34799999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.434}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.438},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.35999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.61099999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.48899999999999999,"15min":0.47299999999999998},"min":{"1min":0.38600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.35999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.622}]},{"osd":3,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.49099999999999999,"15min":0.47899999999999998},"min":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.505}]},{"osd":6,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79600000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65900000000000003}]}]}],"pool_statfs":[]}} 2023-10-08T15:42:33.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-08T15:42:33.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601687+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:54:55.570870+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:42:33.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-08T15:42:33.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.607221+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:34:27.352801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.600112+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603556+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601537+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:49:23.538777+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.604309+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-08T15:42:33.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.609114+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.604009+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:12:52.912660+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.609243+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601952+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:30:18.203834+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602669+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:53:46.032289+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-08T15:42:33.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.606649+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:42:33.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-08T15:42:33.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.598789+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:49:08.078340+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:33.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.608838+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.608523+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T15:48:08.654848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603897+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.606862+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:34:28.903245+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-08T15:42:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601477+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:07:13.144811+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601923+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:21:00.938697+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602385+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:17:55.487938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601623+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.604457+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:28:46.292631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-08T15:42:33.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601106+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:54:43.244678+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.599077+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601152+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:53:04.459275+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603368+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.604222+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-08T15:42:33.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601020+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:13:26.101902+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:42:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-08T15:42:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602846+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:31:45.541087+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-08T15:42:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602092+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-08T15:42:33.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601319+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:47:43.852853+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T15:42:33.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-08T15:42:33.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603844+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-08T15:42:33.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.606249+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-08T15:42:33.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601458+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:33.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-08T15:42:33.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603012+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-08T15:42:33.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603465+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-08T15:42:33.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603629+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:23:47.705816+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-08T15:42:33.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.604097+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:28:17.846696+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-08T15:42:33.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.598953+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T15:42:33.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-08T15:42:33.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602459+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:13:44.805051+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-08T15:42:33.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.608500+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:30:17.181661+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:42:33.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-08T15:42:33.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601242+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:26:01.687127+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-08T15:42:33.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602300+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:54:57.494832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:33.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-08T15:42:33.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.600569+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-08T15:42:33.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602996+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:42:33.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-08T15:42:33.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.600707+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-08T15:42:33.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.609074+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T15:42:33.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-08T15:42:33.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.600106+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-08T15:42:33.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.600168+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-08T15:42:33.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603169+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:42:33.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-08T15:42:33.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603716+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:57:41.709042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-08T15:42:33.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.600894+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-08T15:42:33.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602794+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:42:33.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-08T15:42:33.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.604615+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-08T15:42:33.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603082+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-08T15:42:33.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601943+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.606284+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601542+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.605112+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603342+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:39:50.886815+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-08T15:42:33.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.600519+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T15:42:33.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-08T15:42:33.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.601913+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:40:27.513848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T15:42:33.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-08T15:42:33.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.603273+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:05:10.469412+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-08T15:42:33.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T15:42:27.594698+0000', 'last_change': '2023-10-08T15:42:27.602215+0000', 'last_active': '2023-10-08T15:42:27.594698+0000', 'last_peered': '2023-10-08T15:42:27.594698+0000', 'last_clean': '2023-10-08T15:42:27.594698+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T15:42:27.594698+0000', 'last_undegraded': '2023-10-08T15:42:27.594698+0000', 'last_fullsized': '2023-10-08T15:42:27.594698+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'last_clean_scrub_stamp': '2023-10-08T15:42:27.594698+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:50:20.240936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T15:42:33.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T15:42:33.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.678+0000 7ff0a780d700 1 Processor -- start 2023-10-08T15:42:33.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.678+0000 7ff0a780d700 1 -- start start 2023-10-08T15:42:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a780d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 0x7ff0a00b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a780d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff0a00cba50 0x7ff0a00cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a780d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a00caa60 con 0x7ff0a00cc720 2023-10-08T15:42:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a780d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a00cf330 con 0x7ff0a00cba50 2023-10-08T15:42:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a780d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00cf570 con 0x7ff0a00c9200 2023-10-08T15:42:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a55a9700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff0a00cc720 0x7ff0a00cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43936/0 (socket says 172.21.15.29:43936) 2023-10-08T15:42:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a55a9700 1 -- 172.21.15.29:0/2214504699 learned_addr learned my addr 172.21.15.29:0/2214504699 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:33.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 0x7ff0a00b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff0a5daa700 1 --2- 172.21.15.29:0/2214504699 >> v2:172.21.15.183:3300/0 conn(0x7ff0a00cba50 0x7ff0a00cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929021734 0 0) 0x7ff0a00caa60 con 0x7ff0a00cc720 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff08c003570 con 0x7ff0a00cc720 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3844515617 0 0) 0x7ff08c003570 con 0x7ff0a00cc720 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 msgr2=0x7ff0a00b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 0x7ff0a00b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 >> v2:172.21.15.183:3300/0 conn(0x7ff0a00cba50 msgr2=0x7ff0a00cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 --2- 172.21.15.29:0/2214504699 >> v2:172.21.15.183:3300/0 conn(0x7ff0a00cba50 0x7ff0a00cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00cb5c0 con 0x7ff0a00cc720 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.679+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7ff09c001470 con 0x7ff0a00cc720 2023-10-08T15:42:33.683 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 0x7ff0a00b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a5daa700 1 --2- 172.21.15.29:0/2214504699 >> v2:172.21.15.183:3300/0 conn(0x7ff0a00cba50 0x7ff0a00cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 >> v1:172.21.15.29:6789/0 conn(0x7ff0a00cc720 legacy=0x7ff0a00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff08c003a60 0x7ff08c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff08c004810 0x7ff08c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 0x7ff08c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00cf330 con 0x7ff08c004810 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00cf570 con 0x7ff08c003a60 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c00ba60 con 0x7ff0a00c9200 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff08c004810 0x7ff08c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a55a9700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff08c003a60 0x7ff08c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a5daa700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 0x7ff08c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a4da8700 1 -- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 msgr2=0x7ff08c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0a00c9200 0x7ff08c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a4da8700 1 -- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff08c003a60 msgr2=0x7ff08c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff08c003a60 0x7ff08c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a4da8700 1 -- 172.21.15.29:0/2214504699 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090009420 con 0x7ff08c004810 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a55a9700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff08c003a60 0x7ff08c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff08c004810 0x7ff08c004c80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff090009df0 tx=0x7ff0900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff4145ce2fd5290 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090009740 con 0x7ff08c004810 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09000e920 con 0x7ff08c004810 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.680+0000 7ff097fff700 1 -- 172.21.15.29:0/2214504699 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09000ece0 con 0x7ff08c004810 2023-10-08T15:42:33.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.681+0000 7ff0a780d700 1 -- 172.21.15.29:0/2214504699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff08c004810 msgr2=0x7ff08c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.681+0000 7ff0a780d700 1 --2- 172.21.15.29:0/2214504699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff08c004810 0x7ff08c004c80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff090009df0 tx=0x7ff0900091a0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.681+0000 7ff0a5daa700 1 -- 172.21.15.29:0/2214504699 reap_dead start 2023-10-08T15:42:33.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.681+0000 7ff0a780d700 1 -- 172.21.15.29:0/2214504699 shutdown_connections 2023-10-08T15:42:33.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.681+0000 7ff0a780d700 1 -- 172.21.15.29:0/2214504699 >> 172.21.15.29:0/2214504699 conn(0x7ff0a006c6e0 msgr2=0x7ff0a0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.681+0000 7ff0a780d700 1 -- 172.21.15.29:0/2214504699 shutdown_connections 2023-10-08T15:42:33.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.681+0000 7ff0a780d700 1 -- 172.21.15.29:0/2214504699 wait complete. 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.682+0000 7ff0a780d700 1 Processor -- start 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.682+0000 7ff0a780d700 1 -- start start 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a780d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff08c004810 0x7ff0a015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a780d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a015ded0 0x7ff0a0159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a780d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0a00c7d50 0x7ff0a00c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a780d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00c8700 con 0x7ff0a015ded0 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a780d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a016a220 con 0x7ff0a00c7d50 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a780d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a015bfc0 con 0x7ff08c004810 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a4da8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a015ded0 0x7ff0a0159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a4da8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a015ded0 0x7ff0a0159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51586/0 (socket says 172.21.15.29:51586) 2023-10-08T15:42:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a4da8700 1 -- 172.21.15.29:0/694698313 learned_addr learned my addr 172.21.15.29:0/694698313 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a5daa700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0a00c7d50 0x7ff0a00c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a55a9700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff08c004810 0x7ff0a015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a4da8700 1 -- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff08c004810 msgr2=0x7ff0a015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff08c004810 0x7ff0a015b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a4da8700 1 -- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0a00c7d50 msgr2=0x7ff0a00c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0a00c7d50 0x7ff0a00c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a4da8700 1 -- 172.21.15.29:0/694698313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a015c2a0 con 0x7ff0a015ded0 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a5daa700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0a00c7d50 0x7ff0a00c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.683+0000 7ff0a55a9700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff08c004810 0x7ff0a015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.684+0000 7ff0a4da8700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a015ded0 0x7ff0a0159460 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff08c004690 tx=0x7ff09001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.684+0000 7ff0957fa700 1 -- 172.21.15.29:0/694698313 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090022070 con 0x7ff0a015ded0 2023-10-08T15:42:33.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.684+0000 7ff0957fa700 1 -- 172.21.15.29:0/694698313 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff090009740 con 0x7ff0a015ded0 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.684+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a015c580 con 0x7ff0a015ded0 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.684+0000 7ff0957fa700 1 -- 172.21.15.29:0/694698313 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09001c450 con 0x7ff0a015ded0 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.684+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a01599a0 con 0x7ff0a015ded0 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.685+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a016a3d0 con 0x7ff0a015ded0 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.685+0000 7ff0957fa700 1 -- 172.21.15.29:0/694698313 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff090026070 con 0x7ff0a015ded0 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.686+0000 7ff0957fa700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff084066f30 0x7ff0840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.686+0000 7ff0957fa700 1 -- 172.21.15.29:0/694698313 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff090085cc0 con 0x7ff0a015ded0 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.686+0000 7ff0a55a9700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff084066f30 0x7ff0840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:33.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.686+0000 7ff0a55a9700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff084066f30 0x7ff0840693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff09c001d20 tx=0x7ff09c0011c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:33.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.690+0000 7ff0957fa700 1 -- 172.21.15.29:0/694698313 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0a016a3d0 con 0x7ff0a015ded0 2023-10-08T15:42:33.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.965+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff0a016a390 con 0x7ff0a015ded0 2023-10-08T15:42:33.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.965+0000 7ff0957fa700 1 -- 172.21.15.29:0/694698313 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1448 (secure 0 0 0) 0x7ff09002d5c0 con 0x7ff0a015ded0 2023-10-08T15:42:33.966 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:33.966 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"aa16b01f-3858-4fc7-9751-d7cb76fff138","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":147,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1696779612,"num_in_osds":8,"osd_in_since":1696779609,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":3727803,"bytes_avail":1596272197,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":34,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5706}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-08T15:42:18.328919+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T15:42:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff084066f30 msgr2=0x7ff0840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff084066f30 0x7ff0840693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff09c001d20 tx=0x7ff09c0011c0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a015ded0 msgr2=0x7ff0a0159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a015ded0 0x7ff0a0159460 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff08c004690 tx=0x7ff09001a000 comp rx=0 tx=0).stop 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 shutdown_connections 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7ff084066f30 0x7ff0840693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0a00c7d50 0x7ff0a00c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff08c004810 0x7ff0a015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 --2- 172.21.15.29:0/694698313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0a015ded0 0x7ff0a0159460 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 >> 172.21.15.29:0/694698313 conn(0x7ff0a006c6e0 msgr2=0x7ff0a00b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 shutdown_connections 2023-10-08T15:42:33.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:33.968+0000 7ff0a780d700 1 -- 172.21.15.29:0/694698313 wait complete. 2023-10-08T15:42:33.980 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T15:42:33.980 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T15:42:34.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.098+0000 7fa65328b700 1 Processor -- start 2023-10-08T15:42:34.099 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.098+0000 7fa65328b700 1 -- start start 2023-10-08T15:42:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa65328b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa64c15cbd0 0x7fa64c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa65328b700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c0cb7c0 con 0x7fa64c0cd6e0 2023-10-08T15:42:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa65328b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c15e290 con 0x7fa64c0cdab0 2023-10-08T15:42:34.102 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa65328b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c15e850 con 0x7fa64c15cbd0 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa652289700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa64c0cd6e0 0x7fa64c0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:43940/0 (socket says 172.21.15.29:43940) 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa652289700 1 -- 172.21.15.29:0/2690782768 learned_addr learned my addr 172.21.15.29:0/2690782768 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa652a8a700 1 --2- 172.21.15.29:0/2690782768 >> v2:172.21.15.183:3300/0 conn(0x7fa64c15cbd0 0x7fa64c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 <== mon.0 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064809049 0 0) 0x7fa64c0cb7c0 con 0x7fa64c0cd6e0 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.099+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa634003570 con 0x7fa64c0cd6e0 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 <== mon.0 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589419650 0 0) 0x7fa634003570 con 0x7fa64c0cd6e0 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 >> v2:172.21.15.183:3300/0 conn(0x7fa64c15cbd0 msgr2=0x7fa64c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 --2- 172.21.15.29:0/2690782768 >> v2:172.21.15.183:3300/0 conn(0x7fa64c15cbd0 0x7fa64c15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 >> v1:172.21.15.183:6789/0 conn(0x7fa64c0cdab0 legacy=0x7fa64c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c15e570 con 0x7fa64c0cd6e0 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 <== mon.0 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2992114252 0 0) 0x7fa63c001470 con 0x7fa64c0cd6e0 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652a8a700 1 --2- 172.21.15.29:0/2690782768 >> v2:172.21.15.183:3300/0 conn(0x7fa64c15cbd0 0x7fa64c15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 >> v1:172.21.15.29:6789/0 conn(0x7fa64c0cd6e0 legacy=0x7fa64c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa634003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa634004810 0x7fa634004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6340051c0 0x7fa63400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c15e850 con 0x7fa634003a60 2023-10-08T15:42:34.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63400c050 con 0x7fa634004810 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63400c210 con 0x7fa6340051c0 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652289700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa634003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651a88700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa634004810 0x7fa634004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652a8a700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6340051c0 0x7fa63400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652289700 1 -- 172.21.15.29:0/2690782768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6340051c0 msgr2=0x7fa63400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652289700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa6340051c0 0x7fa63400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652289700 1 -- 172.21.15.29:0/2690782768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa634004810 msgr2=0x7fa634004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652289700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa634004810 0x7fa634004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652a8a700 1 -- 172.21.15.29:0/2690782768 reap_dead start 2023-10-08T15:42:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652289700 1 -- 172.21.15.29:0/2690782768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa634003570 con 0x7fa634003a60 2023-10-08T15:42:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa652289700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa634003e30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c3c0 tx=0x7fa63c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68133567e9e35b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00cc10 con 0x7fa634003a60 2023-10-08T15:42:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.100+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00cd70 con 0x7fa634003a60 2023-10-08T15:42:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.101+0000 7fa651287700 1 -- 172.21.15.29:0/2690782768 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c005b70 con 0x7fa634003a60 2023-10-08T15:42:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.101+0000 7fa65328b700 1 -- 172.21.15.29:0/2690782768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 msgr2=0x7fa634003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.101+0000 7fa65328b700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa634003e30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c3c0 tx=0x7fa63c001e70 comp rx=0 tx=0).stop 2023-10-08T15:42:34.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.101+0000 7fa65328b700 1 -- 172.21.15.29:0/2690782768 shutdown_connections 2023-10-08T15:42:34.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.101+0000 7fa65328b700 1 --2- 172.21.15.29:0/2690782768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa634003e30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.101+0000 7fa65328b700 1 -- 172.21.15.29:0/2690782768 >> 172.21.15.29:0/2690782768 conn(0x7fa64c067660 msgr2=0x7fa64c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:34.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.101+0000 7fa65328b700 1 -- 172.21.15.29:0/2690782768 shutdown_connections 2023-10-08T15:42:34.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.101+0000 7fa65328b700 1 -- 172.21.15.29:0/2690782768 wait complete. 2023-10-08T15:42:34.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.102+0000 7fa65328b700 1 Processor -- start 2023-10-08T15:42:34.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.102+0000 7fa65328b700 1 -- start start 2023-10-08T15:42:34.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa65328b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa64c14a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa65328b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa64c0b5e80 0x7fa64c0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa65328b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa64c0ca700 0x7fa64c0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa65328b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0cc360 con 0x7fa634003a60 2023-10-08T15:42:34.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa65328b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0c9d30 con 0x7fa64c0b5e80 2023-10-08T15:42:34.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa65328b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0b6720 con 0x7fa64c0ca700 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa652289700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa64c14a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa652289700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa64c14a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51600/0 (socket says 172.21.15.29:51600) 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa652289700 1 -- 172.21.15.29:0/176622141 learned_addr learned my addr 172.21.15.29:0/176622141 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa651a88700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa64c0b5e80 0x7fa64c0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa652a8a700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa64c0ca700 0x7fa64c0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa652289700 1 -- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa64c0ca700 msgr2=0x7fa64c0b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa652289700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa64c0ca700 0x7fa64c0b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa652289700 1 -- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa64c0b5e80 msgr2=0x7fa64c0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.103+0000 7fa652289700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa64c0b5e80 0x7fa64c0ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.104+0000 7fa652289700 1 -- 172.21.15.29:0/176622141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0c9400 con 0x7fa634003a60 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.104+0000 7fa652289700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa64c14a9d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa63c001eb0 tx=0x7fa63c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.104+0000 7fa64a7fc700 1 -- 172.21.15.29:0/176622141 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c022070 con 0x7fa634003a60 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.104+0000 7fa64a7fc700 1 -- 172.21.15.29:0/176622141 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c004e50 con 0x7fa634003a60 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.104+0000 7fa64a7fc700 1 -- 172.21.15.29:0/176622141 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00cc10 con 0x7fa634003a60 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.104+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c0c96e0 con 0x7fa634003a60 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.104+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c0b62f0 con 0x7fa634003a60 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.105+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c0ca010 con 0x7fa634003a60 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.105+0000 7fa64a7fc700 1 -- 172.21.15.29:0/176622141 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa63c007510 con 0x7fa634003a60 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.106+0000 7fa64a7fc700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa638066f30 0x7fa6380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T15:42:34.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.106+0000 7fa64a7fc700 1 -- 172.21.15.29:0/176622141 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa63c0850b0 con 0x7fa634003a60 2023-10-08T15:42:34.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.106+0000 7fa651a88700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa638066f30 0x7fa6380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T15:42:34.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.106+0000 7fa651a88700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa638066f30 0x7fa6380693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6400010e0 tx=0x7fa640007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T15:42:34.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.110+0000 7fa64a7fc700 1 -- 172.21.15.29:0/176622141 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa63c052320 con 0x7fa634003a60 2023-10-08T15:42:34.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.298+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 --> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa64c0b6510 con 0x7fa638066f30 2023-10-08T15:42:34.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.306+0000 7fa64a7fc700 1 -- 172.21.15.29:0/176622141 <== mgr.4100 v2:172.21.15.183:6832/86000 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282077 (secure 0 0 0) 0x7fa64c0b6510 con 0x7fa638066f30 2023-10-08T15:42:34.310 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:42:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa638066f30 msgr2=0x7fa6380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa638066f30 0x7fa6380693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6400010e0 tx=0x7fa640007d10 comp rx=0 tx=0).stop 2023-10-08T15:42:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 msgr2=0x7fa64c14a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T15:42:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa64c14a9d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa63c001eb0 tx=0x7fa63c015000 comp rx=0 tx=0).stop 2023-10-08T15:42:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 shutdown_connections 2023-10-08T15:42:34.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:6832/86000,v1:172.21.15.183:6833/86000] conn(0x7fa638066f30 0x7fa6380693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa64c0ca700 0x7fa64c0b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa634003a60 0x7fa64c14a9d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 --2- 172.21.15.29:0/176622141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa64c0b5e80 0x7fa64c0ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T15:42:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.309+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 >> 172.21.15.29:0/176622141 conn(0x7fa64c067660 msgr2=0x7fa64c0c7180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T15:42:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.310+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 shutdown_connections 2023-10-08T15:42:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T15:42:34.310+0000 7fa65328b700 1 -- 172.21.15.29:0/176622141 wait complete. 2023-10-08T15:42:34.313 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-10-08T15:42:34.322 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T15:42:32.331886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558859,"statfs":{"total":1600000000,"available":1596272197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.736567"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601687+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:55.570870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.607221+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:27.352801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600112+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603556+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601537+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:23.538777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604309+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609114+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604009+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:52.912660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609243+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601952+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:30:18.203834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602669+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:53:46.032289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606649+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.598789+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:08.078340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608838+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608523+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:08.654848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603897+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606862+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:28.903245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601477+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:13.144811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601923+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:00.938697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602385+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:55.487938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601623+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604457+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:28:46.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601106+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:43.244678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.599077+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601152+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:04.459275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603368+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604222+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601020+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:26.101902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602846+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:45.541087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602092+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601319+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:43.852853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603844+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606249+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:52.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611920+0000","last_change":"2023-10-08T15:42:27.611920+0000","last_active":"2023-10-08T15:42:27.611920+0000","last_peered":"2023-10-08T15:42:27.611920+0000","last_clean":"2023-10-08T15:42:27.611920+0000","last_became_active":"2023-10-08T15:42:27.611355+0000","last_became_peered":"2023-10-08T15:42:27.611355+0000","last_unstale":"2023-10-08T15:42:27.611920+0000","last_undegraded":"2023-10-08T15:42:27.611920+0000","last_fullsized":"2023-10-08T15:42:27.611920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601458+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606608+0000","last_change":"2023-10-08T15:42:27.606608+0000","last_active":"2023-10-08T15:42:27.606608+0000","last_peered":"2023-10-08T15:42:27.606608+0000","last_clean":"2023-10-08T15:42:27.606608+0000","last_became_active":"2023-10-08T15:42:27.604697+0000","last_became_peered":"2023-10-08T15:42:27.604697+0000","last_unstale":"2023-10-08T15:42:27.606608+0000","last_undegraded":"2023-10-08T15:42:27.606608+0000","last_fullsized":"2023-10-08T15:42:27.606608+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:51.458648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603012+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.607668+0000","last_change":"2023-10-08T15:42:27.607668+0000","last_active":"2023-10-08T15:42:27.607668+0000","last_peered":"2023-10-08T15:42:27.607668+0000","last_clean":"2023-10-08T15:42:27.607668+0000","last_became_active":"2023-10-08T15:42:27.607433+0000","last_became_peered":"2023-10-08T15:42:27.607433+0000","last_unstale":"2023-10-08T15:42:27.607668+0000","last_undegraded":"2023-10-08T15:42:27.607668+0000","last_fullsized":"2023-10-08T15:42:27.607668+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603465+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608294+0000","last_change":"2023-10-08T15:42:27.608294+0000","last_active":"2023-10-08T15:42:27.608294+0000","last_peered":"2023-10-08T15:42:27.608294+0000","last_clean":"2023-10-08T15:42:27.608294+0000","last_became_active":"2023-10-08T15:42:27.607485+0000","last_became_peered":"2023-10-08T15:42:27.607485+0000","last_unstale":"2023-10-08T15:42:27.608294+0000","last_undegraded":"2023-10-08T15:42:27.608294+0000","last_fullsized":"2023-10-08T15:42:27.608294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603629+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:47.705816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606991+0000","last_change":"2023-10-08T15:42:27.606991+0000","last_active":"2023-10-08T15:42:27.606991+0000","last_peered":"2023-10-08T15:42:27.606991+0000","last_clean":"2023-10-08T15:42:27.606991+0000","last_became_active":"2023-10-08T15:42:27.605095+0000","last_became_peered":"2023-10-08T15:42:27.605095+0000","last_unstale":"2023-10-08T15:42:27.606991+0000","last_undegraded":"2023-10-08T15:42:27.606991+0000","last_fullsized":"2023-10-08T15:42:27.606991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604097+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:17.846696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611581+0000","last_change":"2023-10-08T15:42:27.611581+0000","last_active":"2023-10-08T15:42:27.611581+0000","last_peered":"2023-10-08T15:42:27.611581+0000","last_clean":"2023-10-08T15:42:27.611581+0000","last_became_active":"2023-10-08T15:42:27.610685+0000","last_became_peered":"2023-10-08T15:42:27.610685+0000","last_unstale":"2023-10-08T15:42:27.611581+0000","last_undegraded":"2023-10-08T15:42:27.611581+0000","last_fullsized":"2023-10-08T15:42:27.611581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:31.175452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.598953+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:57.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606948+0000","last_change":"2023-10-08T15:42:27.606948+0000","last_active":"2023-10-08T15:42:27.606948+0000","last_peered":"2023-10-08T15:42:27.606948+0000","last_clean":"2023-10-08T15:42:27.606948+0000","last_became_active":"2023-10-08T15:42:27.606480+0000","last_became_peered":"2023-10-08T15:42:27.606480+0000","last_unstale":"2023-10-08T15:42:27.606948+0000","last_undegraded":"2023-10-08T15:42:27.606948+0000","last_fullsized":"2023-10-08T15:42:27.606948+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602459+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:44.805051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611515+0000","last_change":"2023-10-08T15:42:27.611515+0000","last_active":"2023-10-08T15:42:27.611515+0000","last_peered":"2023-10-08T15:42:27.611515+0000","last_clean":"2023-10-08T15:42:27.611515+0000","last_became_active":"2023-10-08T15:42:27.611282+0000","last_became_peered":"2023-10-08T15:42:27.611282+0000","last_unstale":"2023-10-08T15:42:27.611515+0000","last_undegraded":"2023-10-08T15:42:27.611515+0000","last_fullsized":"2023-10-08T15:42:27.611515+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:32.673627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.608500+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:17.181661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610407+0000","last_change":"2023-10-08T15:42:27.610407+0000","last_active":"2023-10-08T15:42:27.610407+0000","last_peered":"2023-10-08T15:42:27.610407+0000","last_clean":"2023-10-08T15:42:27.610407+0000","last_became_active":"2023-10-08T15:42:27.610216+0000","last_became_peered":"2023-10-08T15:42:27.610216+0000","last_unstale":"2023-10-08T15:42:27.610407+0000","last_undegraded":"2023-10-08T15:42:27.610407+0000","last_fullsized":"2023-10-08T15:42:27.610407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:07.651992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601242+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:01.687127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612937+0000","last_change":"2023-10-08T15:42:27.612937+0000","last_active":"2023-10-08T15:42:27.612937+0000","last_peered":"2023-10-08T15:42:27.612937+0000","last_clean":"2023-10-08T15:42:27.612937+0000","last_became_active":"2023-10-08T15:42:27.611760+0000","last_became_peered":"2023-10-08T15:42:27.611760+0000","last_unstale":"2023-10-08T15:42:27.612937+0000","last_undegraded":"2023-10-08T15:42:27.612937+0000","last_fullsized":"2023-10-08T15:42:27.612937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:00:00.974267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602300+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:57.494832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608865+0000","last_change":"2023-10-08T15:42:27.608865+0000","last_active":"2023-10-08T15:42:27.608865+0000","last_peered":"2023-10-08T15:42:27.608865+0000","last_clean":"2023-10-08T15:42:27.608865+0000","last_became_active":"2023-10-08T15:42:27.608647+0000","last_became_peered":"2023-10-08T15:42:27.608647+0000","last_unstale":"2023-10-08T15:42:27.608865+0000","last_undegraded":"2023-10-08T15:42:27.608865+0000","last_fullsized":"2023-10-08T15:42:27.608865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600569+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612650+0000","last_change":"2023-10-08T15:42:27.612650+0000","last_active":"2023-10-08T15:42:27.612650+0000","last_peered":"2023-10-08T15:42:27.612650+0000","last_clean":"2023-10-08T15:42:27.612650+0000","last_became_active":"2023-10-08T15:42:27.612488+0000","last_became_peered":"2023-10-08T15:42:27.612488+0000","last_unstale":"2023-10-08T15:42:27.612650+0000","last_undegraded":"2023-10-08T15:42:27.612650+0000","last_fullsized":"2023-10-08T15:42:27.612650+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:28.756571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602996+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610802+0000","last_change":"2023-10-08T15:42:27.610802+0000","last_active":"2023-10-08T15:42:27.610802+0000","last_peered":"2023-10-08T15:42:27.610802+0000","last_clean":"2023-10-08T15:42:27.610802+0000","last_became_active":"2023-10-08T15:42:27.610563+0000","last_became_peered":"2023-10-08T15:42:27.610563+0000","last_unstale":"2023-10-08T15:42:27.610802+0000","last_undegraded":"2023-10-08T15:42:27.610802+0000","last_fullsized":"2023-10-08T15:42:27.610802+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:41.327009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600707+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:02:34.104782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.603910+0000","last_change":"2023-10-08T15:42:27.603910+0000","last_active":"2023-10-08T15:42:27.603910+0000","last_peered":"2023-10-08T15:42:27.603910+0000","last_clean":"2023-10-08T15:42:27.603910+0000","last_became_active":"2023-10-08T15:42:27.603674+0000","last_became_peered":"2023-10-08T15:42:27.603674+0000","last_unstale":"2023-10-08T15:42:27.603910+0000","last_undegraded":"2023-10-08T15:42:27.603910+0000","last_fullsized":"2023-10-08T15:42:27.603910+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:38.140823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.609074+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610059+0000","last_change":"2023-10-08T15:42:27.610059+0000","last_active":"2023-10-08T15:42:27.610059+0000","last_peered":"2023-10-08T15:42:27.610059+0000","last_clean":"2023-10-08T15:42:27.610059+0000","last_became_active":"2023-10-08T15:42:27.609836+0000","last_became_peered":"2023-10-08T15:42:27.609836+0000","last_unstale":"2023-10-08T15:42:27.610059+0000","last_undegraded":"2023-10-08T15:42:27.610059+0000","last_fullsized":"2023-10-08T15:42:27.610059+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:56.732723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600106+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610874+0000","last_change":"2023-10-08T15:42:27.610874+0000","last_active":"2023-10-08T15:42:27.610874+0000","last_peered":"2023-10-08T15:42:27.610874+0000","last_clean":"2023-10-08T15:42:27.610874+0000","last_became_active":"2023-10-08T15:42:27.610604+0000","last_became_peered":"2023-10-08T15:42:27.610604+0000","last_unstale":"2023-10-08T15:42:27.610874+0000","last_undegraded":"2023-10-08T15:42:27.610874+0000","last_fullsized":"2023-10-08T15:42:27.610874+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:02.582428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600168+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:53.621140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611354+0000","last_change":"2023-10-08T15:42:27.611354+0000","last_active":"2023-10-08T15:42:27.611354+0000","last_peered":"2023-10-08T15:42:27.611354+0000","last_clean":"2023-10-08T15:42:27.611354+0000","last_became_active":"2023-10-08T15:42:27.611057+0000","last_became_peered":"2023-10-08T15:42:27.611057+0000","last_unstale":"2023-10-08T15:42:27.611354+0000","last_undegraded":"2023-10-08T15:42:27.611354+0000","last_fullsized":"2023-10-08T15:42:27.611354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:33.021077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603169+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:46.878627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609472+0000","last_change":"2023-10-08T15:42:27.609472+0000","last_active":"2023-10-08T15:42:27.609472+0000","last_peered":"2023-10-08T15:42:27.609472+0000","last_clean":"2023-10-08T15:42:27.609472+0000","last_became_active":"2023-10-08T15:42:27.608911+0000","last_became_peered":"2023-10-08T15:42:27.608911+0000","last_unstale":"2023-10-08T15:42:27.609472+0000","last_undegraded":"2023-10-08T15:42:27.609472+0000","last_fullsized":"2023-10-08T15:42:27.609472+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603716+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:41.709042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.607991+0000","last_change":"2023-10-08T15:42:27.607991+0000","last_active":"2023-10-08T15:42:27.607991+0000","last_peered":"2023-10-08T15:42:27.607991+0000","last_clean":"2023-10-08T15:42:27.607991+0000","last_became_active":"2023-10-08T15:42:27.607138+0000","last_became_peered":"2023-10-08T15:42:27.607138+0000","last_unstale":"2023-10-08T15:42:27.607991+0000","last_undegraded":"2023-10-08T15:42:27.607991+0000","last_fullsized":"2023-10-08T15:42:27.607991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:31.175452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600894+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.610071+0000","last_change":"2023-10-08T15:42:27.610071+0000","last_active":"2023-10-08T15:42:27.610071+0000","last_peered":"2023-10-08T15:42:27.610071+0000","last_clean":"2023-10-08T15:42:27.610071+0000","last_became_active":"2023-10-08T15:42:27.609559+0000","last_became_peered":"2023-10-08T15:42:27.609559+0000","last_unstale":"2023-10-08T15:42:27.610071+0000","last_undegraded":"2023-10-08T15:42:27.610071+0000","last_fullsized":"2023-10-08T15:42:27.610071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.831472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602794+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:36.837069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.612790+0000","last_change":"2023-10-08T15:42:27.612790+0000","last_active":"2023-10-08T15:42:27.612790+0000","last_peered":"2023-10-08T15:42:27.612790+0000","last_clean":"2023-10-08T15:42:27.612790+0000","last_became_active":"2023-10-08T15:42:27.612554+0000","last_became_peered":"2023-10-08T15:42:27.612554+0000","last_unstale":"2023-10-08T15:42:27.612790+0000","last_undegraded":"2023-10-08T15:42:27.612790+0000","last_fullsized":"2023-10-08T15:42:27.612790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:12.141956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.604615+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:11.078011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.605851+0000","last_change":"2023-10-08T15:42:27.605851+0000","last_active":"2023-10-08T15:42:27.605851+0000","last_peered":"2023-10-08T15:42:27.605851+0000","last_clean":"2023-10-08T15:42:27.605851+0000","last_became_active":"2023-10-08T15:42:27.605608+0000","last_became_peered":"2023-10-08T15:42:27.605608+0000","last_unstale":"2023-10-08T15:42:27.605851+0000","last_undegraded":"2023-10-08T15:42:27.605851+0000","last_fullsized":"2023-10-08T15:42:27.605851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.375934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603082+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:08.444950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611050+0000","last_change":"2023-10-08T15:42:27.611050+0000","last_active":"2023-10-08T15:42:27.611050+0000","last_peered":"2023-10-08T15:42:27.611050+0000","last_clean":"2023-10-08T15:42:27.611050+0000","last_became_active":"2023-10-08T15:42:27.610828+0000","last_became_peered":"2023-10-08T15:42:27.610828+0000","last_unstale":"2023-10-08T15:42:27.611050+0000","last_undegraded":"2023-10-08T15:42:27.611050+0000","last_fullsized":"2023-10-08T15:42:27.611050+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:16.178805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601943+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:35.329667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609930+0000","last_change":"2023-10-08T15:42:27.609930+0000","last_active":"2023-10-08T15:42:27.609930+0000","last_peered":"2023-10-08T15:42:27.609930+0000","last_clean":"2023-10-08T15:42:27.609930+0000","last_became_active":"2023-10-08T15:42:27.609628+0000","last_became_peered":"2023-10-08T15:42:27.609628+0000","last_unstale":"2023-10-08T15:42:27.609930+0000","last_undegraded":"2023-10-08T15:42:27.609930+0000","last_fullsized":"2023-10-08T15:42:27.609930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:38.140823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.606284+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:18.044344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611758+0000","last_change":"2023-10-08T15:42:27.611758+0000","last_active":"2023-10-08T15:42:27.611758+0000","last_peered":"2023-10-08T15:42:27.611758+0000","last_clean":"2023-10-08T15:42:27.611758+0000","last_became_active":"2023-10-08T15:42:27.610993+0000","last_became_peered":"2023-10-08T15:42:27.610993+0000","last_unstale":"2023-10-08T15:42:27.611758+0000","last_undegraded":"2023-10-08T15:42:27.611758+0000","last_fullsized":"2023-10-08T15:42:27.611758+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:56.732723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601542+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:12:52.795031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608823+0000","last_change":"2023-10-08T15:42:27.608823+0000","last_active":"2023-10-08T15:42:27.608823+0000","last_peered":"2023-10-08T15:42:27.608823+0000","last_clean":"2023-10-08T15:42:27.608823+0000","last_became_active":"2023-10-08T15:42:27.608592+0000","last_became_peered":"2023-10-08T15:42:27.608592+0000","last_unstale":"2023-10-08T15:42:27.608823+0000","last_undegraded":"2023-10-08T15:42:27.608823+0000","last_fullsized":"2023-10-08T15:42:27.608823+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:43.375934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.605112+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:00:34.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.609511+0000","last_change":"2023-10-08T15:42:27.609511+0000","last_active":"2023-10-08T15:42:27.609511+0000","last_peered":"2023-10-08T15:42:27.609511+0000","last_clean":"2023-10-08T15:42:27.609511+0000","last_became_active":"2023-10-08T15:42:27.609249+0000","last_became_peered":"2023-10-08T15:42:27.609249+0000","last_unstale":"2023-10-08T15:42:27.609511+0000","last_undegraded":"2023-10-08T15:42:27.609511+0000","last_fullsized":"2023-10-08T15:42:27.609511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603342+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:50.886815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606761+0000","last_change":"2023-10-08T15:42:27.606761+0000","last_active":"2023-10-08T15:42:27.606761+0000","last_peered":"2023-10-08T15:42:27.606761+0000","last_clean":"2023-10-08T15:42:27.606761+0000","last_became_active":"2023-10-08T15:42:27.606539+0000","last_became_peered":"2023-10-08T15:42:27.606539+0000","last_unstale":"2023-10-08T15:42:27.606761+0000","last_undegraded":"2023-10-08T15:42:27.606761+0000","last_fullsized":"2023-10-08T15:42:27.606761+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:58.871512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.600519+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:40.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.611631+0000","last_change":"2023-10-08T15:42:27.611631+0000","last_active":"2023-10-08T15:42:27.611631+0000","last_peered":"2023-10-08T15:42:27.611631+0000","last_clean":"2023-10-08T15:42:27.611631+0000","last_became_active":"2023-10-08T15:42:27.611438+0000","last_became_peered":"2023-10-08T15:42:27.611438+0000","last_unstale":"2023-10-08T15:42:27.611631+0000","last_undegraded":"2023-10-08T15:42:27.611631+0000","last_fullsized":"2023-10-08T15:42:27.611631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:15:28.617687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.601913+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:40:27.513848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.605559+0000","last_change":"2023-10-08T15:42:27.605559+0000","last_active":"2023-10-08T15:42:27.605559+0000","last_peered":"2023-10-08T15:42:27.605559+0000","last_clean":"2023-10-08T15:42:27.605559+0000","last_became_active":"2023-10-08T15:42:27.605319+0000","last_became_peered":"2023-10-08T15:42:27.605319+0000","last_unstale":"2023-10-08T15:42:27.605559+0000","last_undegraded":"2023-10-08T15:42:27.605559+0000","last_fullsized":"2023-10-08T15:42:27.605559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:57.757560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.603273+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:10.469412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.606745+0000","last_change":"2023-10-08T15:42:27.606745+0000","last_active":"2023-10-08T15:42:27.606745+0000","last_peered":"2023-10-08T15:42:27.606745+0000","last_clean":"2023-10-08T15:42:27.606745+0000","last_became_active":"2023-10-08T15:42:27.605869+0000","last_became_peered":"2023-10-08T15:42:27.605869+0000","last_unstale":"2023-10-08T15:42:27.606745+0000","last_undegraded":"2023-10-08T15:42:27.606745+0000","last_fullsized":"2023-10-08T15:42:27.606745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:00.684271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T15:42:27.594698+0000","last_change":"2023-10-08T15:42:27.602215+0000","last_active":"2023-10-08T15:42:27.594698+0000","last_peered":"2023-10-08T15:42:27.594698+0000","last_clean":"2023-10-08T15:42:27.594698+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T15:42:27.594698+0000","last_undegraded":"2023-10-08T15:42:27.594698+0000","last_fullsized":"2023-10-08T15:42:27.594698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:27.594698+0000","last_clean_scrub_stamp":"2023-10-08T15:42:27.594698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:20.240936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T15:42:27.608140+0000","last_change":"2023-10-08T15:42:27.608140+0000","last_active":"2023-10-08T15:42:27.608140+0000","last_peered":"2023-10-08T15:42:27.608140+0000","last_clean":"2023-10-08T15:42:27.608140+0000","last_became_active":"2023-10-08T15:42:27.607915+0000","last_became_peered":"2023-10-08T15:42:27.607915+0000","last_unstale":"2023-10-08T15:42:27.608140+0000","last_undegraded":"2023-10-08T15:42:27.608140+0000","last_fullsized":"2023-10-08T15:42:27.608140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:42:26.591842+0000","last_clean_scrub_stamp":"2023-10-08T15:42:26.591842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:58.871512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-08T15:42:26.598021+0000","last_change":"2023-10-08T15:40:14.140801+0000","last_active":"2023-10-08T15:42:26.598021+0000","last_peered":"2023-10-08T15:42:26.598021+0000","last_clean":"2023-10-08T15:42:26.598021+0000","last_became_active":"2023-10-08T15:40:14.140572+0000","last_became_peered":"2023-10-08T15:40:14.140572+0000","last_unstale":"2023-10-08T15:42:26.598021+0000","last_undegraded":"2023-10-08T15:42:26.598021+0000","last_fullsized":"2023-10-08T15:42:26.598021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T15:40:13.130970+0000","last_clean_scrub_stamp":"2023-10-08T15:40:13.130970+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:48.200682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088903,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68300000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.40000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.40699999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.505,"15min":0.505},"min":{"1min":0.36399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.69999999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.313,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41299999999999998}]},{"osd":5,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.441},{"interface":"front","average":{"1min":0.626,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.34100000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68000000000000005,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69599999999999995,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.39000000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70699999999999996,"5min":1.135,"15min":1.135},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72099999999999997,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68799999999999994,"5min":1.238,"15min":1.238},"last":0.36899999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59499999999999997,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67700000000000005,"5min":1.486,"15min":1.486},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70499999999999996,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51200000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.64200000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.253}]},{"osd":5,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.626,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.61199999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.38100000000000001}]},{"osd":7,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.752,"15min":0.752},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66400000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.437}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.314},{"interface":"front","average":{"1min":0.314,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.24399999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44400000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.23899999999999999}]},{"osd":2,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.46500000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48499999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.29899999999999999}]},{"osd":3,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.435,"15min":0.438},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.58999999999999997,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.374},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56599999999999995,"5min":1.046,"15min":1.046},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86799999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.40100000000000002}]},{"osd":5,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.44600000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89000000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40899999999999997}]},{"osd":6,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58599999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78600000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59899999999999998,"15min":0.59399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.439}]},{"osd":7,"last update":"Sun Oct 8 15:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85499999999999998,"5min":1.012,"15min":1.012},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088903,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.5,"5min":2.794,"15min":2.794},"last":0.377},{"interface":"front","average":{"1min":0.374,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.25,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51900000000000002,"5min":2.073,"15min":2.073},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.496,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61799999999999999,"5min":2.8260000000000001,"15min":2.8260000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.45700000000000002,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60299999999999998,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.27300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55800000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.317,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68000000000000005,"5min":2.863,"15min":2.863},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.754,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.70299999999999996,"15min":0.71799999999999997},"min":{"1min":0.45200000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82499999999999996,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.67100000000000004,"15min":0.68500000000000005},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.73299999999999998,"15min":0.751},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85999999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80700000000000005,"5min":2.004,"15min":2.004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.83499999999999996,"5min":1.014,"15min":1.014},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.375,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48499999999999999,"5min":1.171,"15min":1.171},"last":0.252},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60699999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.373}]},{"osd":1,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48699999999999999,"5min":1.111,"15min":1.111},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.53500000000000003,"5min":1.232,"15min":1.232},"last":0.33600000000000002}]},{"osd":3,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51800000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.434,"15min":0.441},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.68600000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84199999999999997,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83899999999999997,"5min":1.085,"15min":1.085},"last":0.40799999999999997}]},{"osd":5,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82399999999999995,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.748,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51400000000000001}]},{"osd":6,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.623,"15min":0.627},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.87,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.61799999999999999,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.74199999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":1.286,"15min":1.286},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.32700000000000001,"15min":0.32100000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28100000000000003}]},{"osd":1,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46500000000000002}]},{"osd":5,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83299999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83299999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.42899999999999999}]},{"osd":7,"last update":"Sun Oct 8 15:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":307,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195005,"statfs":{"total":200000000,"available":199685526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74099999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.505},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69499999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.59099999999999997,"15min":0.59799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68999999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65600000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.57099999999999995,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58499999999999996,"15min":0.59799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.34799999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66800000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.434}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194999,"statfs":{"total":200000000,"available":199679271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.438},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.35999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.61099999999999999}]},{"osd":1,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.48899999999999999,"15min":0.47299999999999998},"min":{"1min":0.38600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.35999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.622}]},{"osd":3,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.49099999999999999,"15min":0.47899999999999998},"min":{"1min":0.38500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.505}]},{"osd":6,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78300000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.79600000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Oct 8 15:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65900000000000003}]}]}],"pool_statfs":[]}} 2023-10-08T15:42:35.477 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-10-08T15:42:35.477 DEBUG:teuthology.task.console_log:Killing console logger for smithi029 2023-10-08T15:42:35.477 DEBUG:teuthology.task.console_log:Killing console logger for smithi183 2023-10-08T15:42:35.478 DEBUG:teuthology.exit:Finished running handlers